Next Article in Journal
Estimating Time Since the Last Stand-Replacing Disturbance (TSD) from Spaceborne Simulated GEDI Data: A Feasibility Study
Previous Article in Journal
Integration of InSAR Time-Series Data and GIS to Assess Land Subsidence along Subway Lines in the Seoul Metropolitan Area, South Korea
Previous Article in Special Issue
Component Decomposition-Based Hyperspectral Resolution Enhancement for Mineral Mapping
Letter

Deep Transfer Learning for Vulnerable Road Users Detection using Smartphone Sensors Data

1
Centre for Accident Research & Road Safety, Queensland University of Technology, Brisbane, QLD 4059, Australia
2
Booz Allen Hamilton, Washington, DC 20003, USA
3
Department of Civil Engineering, College of Engineering, King Saud University, P.O. Box 2454, Riyadh 11451, Saudi Arabia
4
Department of Civil and Environmental Engineering, Virginia Tech, Blacksburg, VA 24061, USA
*
Author to whom correspondence should be addressed.
All authors contributed equally to this work.
Remote Sens. 2020, 12(21), 3508; https://0-doi-org.brum.beds.ac.uk/10.3390/rs12213508
Received: 23 September 2020 / Revised: 16 October 2020 / Accepted: 20 October 2020 / Published: 25 October 2020
As the Autonomous Vehicle (AV) industry is rapidly advancing, the classification of non-motorized (vulnerable) road users (VRUs) becomes essential to ensure their safety and to smooth operation of road applications. The typical practice of non-motorized road users’ classification usually takes significant training time and ignores the temporal evolution and behavior of the signal. In this research effort, we attempt to detect VRUs with high accuracy be proposing a novel framework that includes using Deep Transfer Learning, which saves training time and cost, to classify images constructed from Recurrence Quantification Analysis (RQA) that reflect the temporal dynamics and behavior of the signal. Recurrence Plots (RPs) were constructed from low-power smartphone sensors without using GPS data. The resulted RPs were used as inputs for different pre-trained Convolutional Neural Network (CNN) classifiers including constructing 227 × 227 images to be used for AlexNet and SqueezeNet; and constructing 224 × 224 images to be used for VGG16 and VGG19. Results show that the classification accuracy of Convolutional Neural Network Transfer Learning (CNN-TL) reaches 98.70%, 98.62%, 98.71%, and 98.71% for AlexNet, SqueezeNet, VGG16, and VGG19, respectively. Moreover, we trained resnet101 and shufflenet for a very short time using one epoch of data and then used them as weak learners, which yielded 98.49% classification accuracy. The results of the proposed framework outperform other results in the literature (to the best of our knowledge) and show that using CNN-TL is promising for VRUs classification. Because of its relative straightforwardness, ability to be generalized and transferred, and potential high accuracy, we anticipate that this framework might be able to solve various problems related to signal classification. View Full-Text
Keywords: transportation mode classification; vulnerable road users; recurrence plots; computer vision; image classification system transportation mode classification; vulnerable road users; recurrence plots; computer vision; image classification system
Show Figures

Graphical abstract

MDPI and ACS Style

Elhenawy, M.; Ashqar, H.I.; Masoud, M.; Almannaa, M.H.; Rakotonirainy, A.; Rakha, H.A. Deep Transfer Learning for Vulnerable Road Users Detection using Smartphone Sensors Data. Remote Sens. 2020, 12, 3508. https://0-doi-org.brum.beds.ac.uk/10.3390/rs12213508

AMA Style

Elhenawy M, Ashqar HI, Masoud M, Almannaa MH, Rakotonirainy A, Rakha HA. Deep Transfer Learning for Vulnerable Road Users Detection using Smartphone Sensors Data. Remote Sensing. 2020; 12(21):3508. https://0-doi-org.brum.beds.ac.uk/10.3390/rs12213508

Chicago/Turabian Style

Elhenawy, Mohammed, Huthaifa I. Ashqar, Mahmoud Masoud, Mohammed H. Almannaa, Andry Rakotonirainy, and Hesham A. Rakha 2020. "Deep Transfer Learning for Vulnerable Road Users Detection using Smartphone Sensors Data" Remote Sensing 12, no. 21: 3508. https://0-doi-org.brum.beds.ac.uk/10.3390/rs12213508

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop