Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
6.8
3.9
Journals
Sensors
Special Issues
Deep Learning-Based Human Intention and Trajectory Prediction Systems Using Sensors
sensors-logo
Submit to Sensors Review for Sensors Propose a Special Issue

Journal Menu

► Journal Menu

Journal Browser

► Journal Browser
share announcement

Deep Learning-Based Human Intention and Trajectory Prediction Systems Using Sensors

A special issue of Sensors (ISSN 1424-8220). This special issue belongs to the section "Intelligent Sensors".

Deadline for manuscript submissions: closed (15 April 2023) | Viewed by 11114

Special Issue Editors

Dr. Alwin Poulose

E-Mail Website
Guest Editor
School of Data Science, Indian Institute of Science Education and Research (IISER), Thiruvananthapuram 695551, Kerala, India
Interests: indoor localization; human activity recognition; facial emotion recognition; behavior prediction; localization and mapping
Special Issues, Collections and Topics in MDPI journals
Prof. Dr. Antonio Fernández-Caballero

E-Mail Website
Guest Editor
Instituto de Investigación en Informática de Albacete, Universidad de Castilla-La Mancha, 02071 Albacete, Spain
Interests: pattern recognition; human–computer interaction; affective computing; computer vision; multi-sensor fusion
Special Issues, Collections and Topics in MDPI journals

Special Issue Information

Dear Colleagues,

Human intention prediction (HIP) is an emerging research area and has a significant role in daily life. In the HIP, the system gathers data from wearable sensors and predicts human behavior. The most common sensors used in the HIP system are smartphone IMU sensors, camera sensors, smartwatches, and Wi-Fi access points. The HIP system effectively utilizes these sensors and predicts human intention. However, the existing HIP systems are not free from sensor errors, and combining different sensor data for intention prediction is also a very challenging task for HIP researchers. The HIP system consists of indoor localization, human activity recognition (HAR), and facial emotion recognition (FER). We estimate the user's trajectory from the smartphone IMU sensor and Wi-Fi access points in indoor localization. The localization system continuously tracks the user movements and calculates the user’s position. The smartphone IMU sensor data are also used for HAR and identify human activities such as walking, standing, sitting, running, jumping, sit-ups, dancing, lying, push-ups, etc. In FER, we use smartphone cameras to estimate users' emotions, including happiness, sadness, anger, fear, surprise, neutral, and disgust. This Special Issue focuses on papers that provide up-to-date information on human intention prediction, including indoor localization, human activity recognition, and facial emotion recognition. Authors are invited to submit original contributions or survey papers for publication in the open-access Sensors journal.

Topics of interest include (but are not limited to) the following:

  1. Indoor Localization :
    1. Image-based localization technologies;
    2. Dead Reckoning;
    3. Wi-Fi RSSI/Cellular/Bluetooth-based indoor positioning;
    4. RFID/UWB/Infrared/Ultrasonic/Zigbee/VLC/Acoustic Signal based indoor positioning;
    5. Hybrid positioning;
    6. Localization techniques: Triangulation, Lateration, CSI,RSS,TOA,TDOA,RTOF, Localization algorithms, Angulation, AOS,AOD,POA, NFER;
  2. Human Activity Recognition (HAR):
    1. Wearable sensor-based HAR;
    2. Radiofrequency-based HAR;
    3. Vision-based HAR;
    4. Sensors fusion for HAR;
    5. Deep and machine learning techniques for HAR;
    6. HAR applications and architectures;
    7. The human body and pose estimation;
    8. Novel datasets for activity recognition;
    9. Sensing technologies for activity recognition;
    10. Gesture recognition;
    11. Behavior recognition;
  3. Facial Emotion Recognition (FER):
    1. Sensor-based emotion recognition;
    2. Image or signal enhancement for emotion recognition;
    3. Computer vision for FER;
    4. Speech emotion recognition (SER);
    5. Security and privacy concerns in emotional detection;
    6. FER datasets;
    7. FER for autonomous driving systems;
    8. Driver monitoring system (DMS);
    9. Gaze recognition;
    10. Facial landmark detection.

Dr. Alwin Poulose
Prof. Dr. Antonio Fernández-Caballero
Guest Editors

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Sensors is an international peer-reviewed open access semimonthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 2600 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Keywords

  • Indoor Localization
  • Dead Reckoning Wi-Fi
  • Bluetooth
  • RFID
  • Localization algorithms
  • SLAM
  • Trilateration
  • Fingerprinting
  • Human Activity Recognition (HAR)
  • Deep Learning
  • Facial Emotion Recognition (FER)
  • Driver Monitoring Systems (DMS)

Published Papers (4 papers)

Download All Papers
Order results
Result details
Show export options expand_more Show export options expand_less
Select all
Export citation of selected articles as:

Research

16 pages, 3862 KiB  
Article
Pashto Handwritten Invariant Character Trajectory Prediction Using a Customized Deep Learning Technique
by Fazli Khaliq, Muhammad Shabir, Inayat Khan, Shafiq Ahmad, Muhammad Usman, Muhammad Zubair and Shamsul Huda
Sensors 2023, 23(13), 6060; https://0-doi-org.brum.beds.ac.uk/10.3390/s23136060 - 30 Jun 2023
Cited by 1 | Viewed by 1428
Abstract
Before the 19th century, all communication and official records relied on handwritten documents, cherished as valuable artefacts by different ethnic groups. While significant efforts have been made to automate the transcription of major languages like English, French, Arabic, and Chinese, there has been [...] Read more.
Before the 19th century, all communication and official records relied on handwritten documents, cherished as valuable artefacts by different ethnic groups. While significant efforts have been made to automate the transcription of major languages like English, French, Arabic, and Chinese, there has been less research on regional and minor languages, despite their importance from geographical and historical perspectives. This research focuses on detecting and recognizing Pashto handwritten characters and ligatures, which is essential for preserving this regional cursive language in Pakistan and its status as the national language of Afghanistan. Deep learning techniques were employed to detect and recognize Pashto characters and ligatures, utilizing a newly developed dataset specific to Pashto. A further enhancement was done on the dataset by implementing data augmentation, i.e., scaling and rotation on Pashto handwritten characters and ligatures, which gave us many variations of a single trajectory. Different morphological operations for minimizing gaps in the trajectories were also performed. The median filter was used for the removal of different noises. This dataset will be combined with the existing PHWD-V2 dataset. Various deep-learning techniques were evaluated, including VGG19, MobileNetV2, MobileNetV3, and a customized CNN. The customized CNN demonstrated the highest accuracy and minimal loss, achieving a training accuracy of 93.98%, validation accuracy of 92.08% and testing accuracy of 92.99%. Full article
(This article belongs to the Special Issue Deep Learning-Based Human Intention and Trajectory Prediction Systems Using Sensors)
►▼ Show Figures

Figure 1

17 pages, 2712 KiB  
Article
Vehicle Trajectory Prediction via Urban Network Modeling
by Xinyan Qin, Zhiheng Li, Kai Zhang, Feng Mao and Xin Jin
Sensors 2023, 23(10), 4893; https://0-doi-org.brum.beds.ac.uk/10.3390/s23104893 - 19 May 2023
Cited by 1 | Viewed by 1266
Abstract
Taxis are an important component of the transportation system, and empty taxis represent a significant waste of transportation resources. To alleviate the imbalance between supply and demand and relieve traffic congestion, real-time prediction of taxi trajectories is necessary. Most existing trajectory prediction studies [...] Read more.
Taxis are an important component of the transportation system, and empty taxis represent a significant waste of transportation resources. To alleviate the imbalance between supply and demand and relieve traffic congestion, real-time prediction of taxi trajectories is necessary. Most existing trajectory prediction studies focus on extracting time-series information but do not capture spatial information sufficiently. In this paper, we focus on the construction of an urban network and propose an urban topology-encoding spatiotemporal attention network (UTA) to address destination prediction problems. Firstly, this model discretizes the production and attraction units of transportation, combining them with key nodes in the road network to form an urban topological network. Secondly, GPS records are matched to the urban topological map to construct a topological trajectory, which significantly improves trajectory consistency and endpoint certainty, helping to model destination prediction problems. Thirdly, semantic information concerning surrounding space is attached to effectively mine the spatial dependencies of trajectories. Finally, after the topological encoding of city space and trajectories, this algorithm proposes a topological graph neural network to model the attention calculation with the trajectory context, comprehensively considering the spatiotemporal characteristics of the trajectories and improving prediction accuracy. We solve the prediction problems with the UTA model and also compare it with some other classical models, such as the HMM, RNN, LSTM, and transformer. The results suggest that all the models work well in combination with the proposed urban model (with a rough increase of 2%), while the UTA model is less affected by data sparsity. Full article
(This article belongs to the Special Issue Deep Learning-Based Human Intention and Trajectory Prediction Systems Using Sensors)
►▼ Show Figures

Figure 1

26 pages, 32032 KiB  
Article
Online Boosting-Based Target Identification among Similar Appearance for Person-Following Robots
by Redhwan Algabri and Mun-Taek Choi
Sensors 2022, 22(21), 8422; https://0-doi-org.brum.beds.ac.uk/10.3390/s22218422 - 02 Nov 2022
Cited by 2 | Viewed by 5601
Abstract
It is challenging for a mobile robot to follow a specific target person in a dynamic environment, comprising people wearing similar-colored clothes and having the same or similar height. This study describes a novel framework for a person identification model that identifies a [...] Read more.
It is challenging for a mobile robot to follow a specific target person in a dynamic environment, comprising people wearing similar-colored clothes and having the same or similar height. This study describes a novel framework for a person identification model that identifies a target person by merging multiple features into a single joint feature online. The proposed framework exploits the deep learning output to extract four features for tracking the target person without prior knowledge making it generalizable and more robust. A modified intersection over union between the current frame and the last frame is proposed as a feature to distinguish people, in addition to color, height, and location. To improve the performance of target identification in a dynamic environment, an online boosting method was adapted by continuously updating the features in every frame. Through extensive real-life experiments, the effectiveness of the proposed method was demonstrated by showing experimental results that it outperformed the previous methods. Full article
(This article belongs to the Special Issue Deep Learning-Based Human Intention and Trajectory Prediction Systems Using Sensors)
►▼ Show Figures

Figure 1

15 pages, 4430 KiB  
Article
Human Arm Motion Prediction for Collision Avoidance in a Shared Workspace
by Pu Zheng, Pierre-Brice Wieber, Junaid Baber and Olivier Aycard
Sensors 2022, 22(18), 6951; https://0-doi-org.brum.beds.ac.uk/10.3390/s22186951 - 14 Sep 2022
Cited by 6 | Viewed by 1886
Abstract
Industry 4.0 transforms classical industrial systems into more human-centric and digitized systems. Close human–robot collaboration is becoming more frequent, which means security and efficiency issues need to be carefully considered. In this paper, we propose to equip robots with exteroceptive sensors and online [...] Read more.
Industry 4.0 transforms classical industrial systems into more human-centric and digitized systems. Close human–robot collaboration is becoming more frequent, which means security and efficiency issues need to be carefully considered. In this paper, we propose to equip robots with exteroceptive sensors and online motion generation so that the robot is able to perceive and predict human trajectories and react to the motion of the human in order to reduce the occurrence of the collisions. The dataset for training is generated in a real environment in which a human and a robot are sharing their workspace. An Encoder–Decoder based network is proposed to predict the human hand trajectories. A Model Predictive Control (MPC) framework is also proposed, which is able to plan a collision-free trajectory in the shared workspace based on this human motion prediction. The proposed framework is validated in a real environment that ensures collision free collaboration between humans and robots in a shared workspace. Full article
(This article belongs to the Special Issue Deep Learning-Based Human Intention and Trajectory Prediction Systems Using Sensors)
►▼ Show Figures

Figure 1

Show export options expand_more Show export options expand_less
Select all
Export citation of selected articles as:
 
Displaying articles 1-4
Back to TopTop