Next Article in Journal
Discrete Optimization of a Gear Pump after Tooth Root Undercutting by Means of Multi-Dimensional Logic Functions
Next Article in Special Issue
Development and Application of Advanced Technological Solutions within Construction of Experimental Vehicle
Previous Article in Journal
Study on Cold Resistance Performance of Composite Subgrade Structure in Seasonal Frozen Regions
Previous Article in Special Issue
Analysis of the Risks of Hydrogen Leakage from Hydrogen-Powered Cars and Their Possible Impact on Automotive Market Share Increase
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Study on the Evaluation Method of Autonomous Emergency Vehicle Braking for Pedestrians Test Using Monocular Cameras

1
Department of Mechanical Engineering, Keimyung University, Daegu 42601, Korea
2
Division of Mechanical and Automotive Engineering, Keimyung University, Daegu 42601, Korea
*
Author to whom correspondence should be addressed.
Submission received: 15 June 2020 / Revised: 29 June 2020 / Accepted: 6 July 2020 / Published: 7 July 2020
(This article belongs to the Special Issue Advanced Engine Technologies and Innovative Vehicle Driving Systems)

Abstract

:
Traffic accidents continue to increase in Korea as traffic increases, and the resulting loss of life is also on the rise. According to data surveyed by the South Korean National Police Agency, 45,921 pedestrian traffic accidents were reported in 2019, resulting in 1487 deaths and 46,400 injuries. Due to the increased interest in traffic accident safety, the Advanced Driver Assistance System (ADAS) concept is rapidly developing and playing a significant role in coping with activities that are not recognized by the driver. Autonomous Emergency Braking (AEB), a representative ADAS system, is a system that is useful for preventing and mitigating accidents by braking vehicles in emergencies. For the study of AEBs’ safety evaluation methods for pedestrians, a distance measurement method using a monocular camera with excellent accessibility, and measurement equipment required to validate data on the movement of vehicles, and a dummy to replace pedestrians are used. Based on the evaluation scenario considering the proposed Korea road environment, the relative distance obtained from equipment like DGPS and the relative distance using a monocular camera is compared and analyzed to verify safety. Comparative analysis shows that the minimum deviation is 2.3 cm, the third test result of 30 km/h of Car-to-Pedestrian Nearside Child (CPNC), and the maximum deviation is 25 cm, the first test result of 25 km/h of Car-to-Pedestrian Nearside Adult (CPNA). The main factor in error generation is that the lane recognition in the camera image is not accurate, and the perception of small children is slow, which is why emergency braking is considered to have been slow. It is deemed that a safety assessment in weather conditions of adverse conditions will be required in the future.

1. Introduction

As the volume of domestic traffic increases, traffic accidents continue to increase, leading to increased casualties. According to data surveyed in 2019 by the Korea National Police Agency, the death rate due to traffic accidents has been decreasing every year as of 1991, but the number of injuries continues to increase.
A total of 45,921 pedestrian traffic accidents were reported in 2019, with 1487 deaths and 46,400 injuries. Among them, children under the age of 13 were very vulnerable to traffic accidents, with 34 deaths, and 12,543 injuries [1].
Safety concerns are also increasing due to traffic accidents. As a way to solve this problem, the Advanced Driver Assistance System (ADAS) concept, which helps vehicles prevent or mitigate accidents and reduces drivers’ fatigue by responding to incidents that the driver does not recognize, is developing rapidly and at the same time playing an important role.
A typical ADAS function is the Autonomous Emergency Braking (AEB) system that performs braking in an emergency. By using car-sensing devices (radars, cameras, and sensors), the AEB system can recognize the surrounding driving environment [2,3]. This system operates when the preceding vehicle suddenly brakes due to an accident, or when there is an object that is suddenly entering the driveway of the vehicle in the road. The AEB system can effectively improve the driving safety of vehicles, reduce the occurrence of collision traffic accidents [4], and the working intensity of drivers. For that reason, it is evaluated as a useful system for preventing and mitigating accidents [5].
After looking at the research trends of ADAS tests and pedestrian AEB, Woo et al. [6] proceeded with the design and simulation of a vehicle test bed based on intelligent transport systems (ITS). The ITS- based intelligent vehicle test bed was constructed to meet the growing demand for test and verification for ADAS and ITS systems. This test bed is carefully designed to meet the requirements of the International Organization for Standardization (ISO)/Technical Committee (TC)204 standards. Yang et al. [7] presented a driver study on longitudinal active collision avoidance of the AEB-P system. The lower-layer controller of the Autonomous Emergency Braking-Pedestrian (AEB-P) system was designed based on the Proportional Integral Derivative (PID) controller theory, which realizes the conversion of the expected speed reduction to the pressure of a vehicle braking pipeline. The relevant pedestrian test scenarios were set up based on the China-New Car Assessment Program (C-NCAP) test standards. The CarSim and Simulink co-simulation model of the AEB-P system was established, and a multi-condition simulation analysis was performed. Lenard et al. [8] studied typical pedestrian accident scenarios for the development of autonomous emergency braking test protocols. This paper aimed to contribute to the development of relevant test conditions by describing pedestrian accidents’ typical circumstances. Cluster analysis was applied to two large British databases, and both highlighted an urban scenario in daylight and fine weather where a small pedestrian walks across the road, especially from the near curb, in clear view of a driver who is traveling straight ahead. For each dataset, the main test configuration was defined to represent the conditions of the most common accident scenario along with test variations to reflect the characteristics of less common accident scenarios. Hamdane et al. [9] studied issues and challenges for pedestrian active safety systems based on real world accidents. The purpose of this study was to analyze real crashes involving pedestrians in order to evaluate the potential effectiveness of AEB in pedestrian protection. These were assessed to determine their impact on pedestrian safety. The influence of the detection and the activation of the AEB system were explored by varying the field of view (FOV) of the sensor and the level of deceleration. A FOV of 35° was estimated to be required to detect and react to the majority of crash scenarios. Siddiqui et al. [10] analyzed an empirical study of the braking performance of AEB-P. The Insurance Institute for Highway Safety (IIHS) has performed tests on eleven such vehicles; these data are publicly available and were analyzed for this study. This study’s first objective was to compare forward collision warning (FCW) engagement distance to a target, AEB-P brake application time, and incidences of impact across different manufacturers. The second objective was to analyze the brake application characteristics of AEB-P and how it varies across the different vehicles tested. Kwon et al. [11] conducted a study on the test evaluation method of AEB (vehicle to pedestrian), Considering the road environment in Korean and The European New Car Assessment Program (Euro NCAP) Test Protocol V3.0.1. In Euro NCAP, the AEB vulnerable road user (VRU) test protocol V3.0.2 was established. This paper analyzes the scenario of Euro NCAP VRU test protocol V3.0.1, which will be established in 2020, and proposes test conditions according to the Korean road traffic law. In addition, the reliability of the proposed scenario and test conditions were verified by comparing and analyzing the proposed theoretical evaluation formulas and actual test results.
In addition, Jeppsson et al. [12] studied the real life safety benefits of increasing brake deceleration in car-to-pedestrian accidents using a simulation of vacuum emergency braking (VEB). The objective of this study was to predict the real-life benefits, namely the number of injuries avoided rather than the reduction in impact speed, offered by a vacuum emergency brake added to an AEB-P system. Lubbe et al. [13] studied drivers’ comfort boundaries in pedestrian crossings in a study on driver braking characteristics as a function of pedestrian walking speed. In this study, driver discomfort can be inferred from brake onset, which refers to the start of brake pedal depression, as the most intuitive way for a driver to resolve a conflicting situation. Using the Euro NCAP AEB VRU test protocol v3.0.2. [14] to support the driver in avoiding when possible or mitigating such crashes, car manufacturers offer avoidance technology that reacts to the situation by autonomous braking and at higher speeds may issue warnings to alert the driver. Systems that specifically look for and react to vulnerable road users like pedestrians and cyclists are called AEB VRU systems. This protocol specifies the AEB VRU test procedure for both AEB pedestrians and AEB cyclists, which are part of the vulnerable road user protection scheme. Shi et al. [15] analysed pedestrian-to-ground impact injury risks in vehicle-to-pedestrian collisions based on rotation angles. Due to the diversity of pedestrian-to-ground impact (secondary impact) mechanisms, secondary impacts always result in more unpredictable injuries as compared to initial vehicle-to-pedestrian collisions (primary impact). This study investigates the effects of frontal vehicle structure, vehicle impact velocity, and pedestrian size and gait on pedestrian-to-ground impact injury risk. Murmu et al. [16] studied relative velocity measurements using a low cost single camera-based stereo vision system. This article presents a novel low cost, low-resolution stereo vision system based on a single camera, which may be used to measure the position and relative velocity of a moving object. This new system is very simple in design, low cost, and capable of measuring the depth and relative velocity with desirable accuracy. Mudassar et al. [17] studies a framework for estimating the distance and dimension attributes of pedestrians in real-time environments using a monocular camera. This work describes a method that uses simple mathematical estimations to automatically discover the distance and dimensions (height and width) of a moving pedestrian lying at distant locations from the camera. The proposed system is confined to immovable monocular camera environments. Outcomes are compared to the found results of existing methods as well as with the real measurements. The results show the robustness of the proposed framework with noteworthy delay rates. Zaarane et al. [18] studied a measurement system for autonomous vehicles using a stereo camera.
In the current paper, we propose an inter-vehicle distance measurement system for self-driving vehicles based on image processing. The proposed system uses two cameras mounted as one stereo camera system in the host vehicle behind the rear-view mirror. Bae et al. [19] conducted a study on a distance calculation method with a vehicle using a forward-facing single camera. This paper calculates the lane width from the image with the lane being detected from the image of the monocular camera, and based on geometric information. A theoretical formula was proposed to calculate the distance from the vehicle in front.
The general AEB test evaluation has many restrictive conditions because of the expensive measurement equipment and advanced utilizable technology. However, in the case of a monocular camera, it has relatively good accessibility and non-restrictive conditions, so in this study AEB research on pedestrian safety using a monocular camera was conducted, because it was judged to be insufficient and required. Therefore, in this study, an AEB safety evaluation method using a monocular camera is proposed and verified for the study of AEB evaluation method for pedestrian safety using a monocular camera by comparing and analyzing the result of measuring the relative distance using a monocular camera and the result of measuring the relative distance using measurement equipment based on the test evaluation scenario in the domestic road environment proposed in the previous study [11,19].

2. Test Evaluation Method

2.1. Theory of Distance Measurement Using a Monocular Camera

In a previous study, a distance calculation method using geometric information of lanes, vanishing points, and preceding vehicles detected in the camera image mounted on the vehicle was proposed. The method is as follows [10]: First, the lane width in the image may be calculated by using the lane and vanishing point detected in the camera image. The detected lanes and vanishing points are shown in Figure 1.
Where L 1 is the width of the lane for the contact portion of the rear tire of the preceding vehicle with the ground, L 2 is the width of the lane from the top of the car hood, and H 1 is the vertical distance between L 1 and L 2 . H 2 is the vertical distance from the vanishing point to L 1 .
Figure 2 shows the principle of distance calculation using geometric information with the preceding vehicle.
Equation (1) can be obtained using a proportional expression in Figure 2:
a = b h 1 / h 2 c
where h 1 is the height of the camera from the ground, h 2 is the height from the hood to the camera, b is the distance from the camera to the top of the hood, and c is the distance from the camera to the front bumper.
The term a is the distance from the camera, which is the length of the hood of the car to the front bumper. It can be calculated from the camera’s installation height, installation angle, and vehicle specifications. θ   can be calculated as the difference of a from the angle from the camera to the rear wheel of the vehicle, and l is the height visible from the image to the rear wheel of the preceding vehicle in the ground covered by the hood of the vehicle. l can be calculated as the difference of l from the camera installation height. Therefore, it can be expressed by Equations (2)–(4) using the width of the lane calculated in the image:
l = h 1 L 2 L 1 / L 2
Θ = tan 1 a + c / h _ 1
α = Θ + tan 1 a + c / h 1 1
The method to obtain the distance from the image by using Equations (1)–(4) is defined by Equation (5):
d image = l tan Θ + α
d image is a distance calculated from the lane height in the image. However, it is assumed that the specifications of the preceding vehicle (rear overhang ( d O . H )) are known from the image.
The relative distance from the preceding vehicle can be defined based on geometrical information. It is shown in Equation (6):
d real = d image + a d O . H
where d real is the distance from the preceding vehicle and can be expressed by a , Equations (1)–(5).
Equation (6) is in the curve, the distance to the leading vehicle or pedestrian is expressed in a straight line. Also, in the case without d O . H , it is expressed as the distance to the rear tire of the leading vehicle, not the value for the end of the bumper, but for pedestrians, d O . H is 0.

2.2. Test Scenario

The AEB recognizes pedestrians as well as vehicles and obstacles in front and plays an essential role in reducing traffic accidents between vehicles and pedestrians. Euro NCAP acknowledges this role and is enacting additional scenarios for V2P each year to reflect new trends [20].
The scenario proposed in the previous study suggested a scenario considering the speed limit of 30 km/h in the child protection zone under Article 19 of the Enforcement Decree of the Road Traffic Act regarding Euro NCAP AEB VRU test protocol v3.0.2. [11,14].
The AEB V2P scenario added a scenario (including the longitudinal and transverse movement of traffic vulnerabilities) involving children running to the scenario of the AEB VRU test protocol v3.0.2, and utilizing the suggested scenario.
Among the suggested scenarios, there are three scenarios in which the vehicle test was conducted, and each one is shown in Figure 3, Figure 4 and Figure 5.
Figure 3 shows a car-to-pedestrian nearside adult (CPNA) scenario and is the proposed scenario 1. It is an evaluation scenario for an adult walking sideways in front of a moving subject vehicle (SV). At this time, SV recognizes the walking adult and checks whether the AEB is operating normally. The test conditions are shown in Table 1.
Figure 4 shows a car-to-pedestrian farside child (CPFC) scenario and is the proposed scenario 2. It is an evaluation scenario for a child running sideways in front of a driving SV. At this time, SV recognizes the running child and checks whether the AEB is operating normally. The test conditions are shown in Table 1.
Figure 5 shows a Car-to-Pedestrian Nearside Child (CPNC) scenario and is the proposed scenario 3. This is an evaluation scenario in the case where a child jumps in front of LV 1, and LV 2 stopped on the shoulder and appeared laterally in front of the driving SV. At this time, SV recognizes the running child and checks whether the AEB is operating normally. The test conditions are shown in Table 1.

3. Vehicle Test

3.1. Vehicle for Vehicle Test

To verify the actual functional safety of AEB, the Genesis G90 was selected based on vehicle tests on a real road. It is shown in Figure 6. The Genesis G90 is equipped with an Active Safety System, based on sensors such as camera sensors and radar sensors which is considered excellent.

3.2. Place for Vehicle Test

The place where the AEB safety evaluation test was conducted is a vehicle-road link test intersection among driving test roads of the Korea Intelligent Automobile Parts Promotion Institute (KIAPI)’, and is shown in Figure 7. Since the friction coefficient and the width of the real road are applied in the driving test road, it was determined that the driving test road was suitable for the test site.
At this time, ‘skid-resistance’ (STANLEY LONDON) was used to confirm that the average friction coefficient of the test road was 1.08. The friction coefficient at least 0.9 or more of the general road was judged to be suitable for the test environment.

3.3. Condition for Vehicle Test

The equipment necessary to acquire data through the vehicle test was attached to the SV. Figure 8 shows the equipment that is mounted in the test vehicle. Differential global positioning system (DGPS), data acquisition (DAQ) and camera modules were used, and the equipment specifications are summarized in Table 2.
Figure 9 shows the dummies of adults and children to implement the proposed scenario. The characteristics are listed in Table 3.
Figure 10 is a monocular camera that is mounted in the test vehicle and was used to calculate the relative distance in Equation (6). The specifications of the monocular camera are summarized in Table 4.
The DGPS was mounted on the vehicle center of gravity (CG) point, and the distance from the right side of the vehicle to the DGPS, the distance from the vehicle bumper to the DGPS, and the distance from the road surface to the DGPS were measured and corrected. In addition, the accuracy was set to 3 cm or less by triangular correction using an additional antenna installed in KIAPI and DGPS mounted on the test vehicle. The DAQ was connected to the DGPS, and Placed in the rear seat of the test vehicle, and corrected the initial value of CAN and Bluetooth communication. The camera module was mounted on the test vehicle’s dashboard to record the front to check the scenario in the data analysis process. The monocular camera was mounted on the top center of the front glass to record the front in the same measurement location in the theoretically proposed measurement location. After power was supplied to the test equipment before the test, the location was corrected. Furthermore, the data was measured by conducting three repeated tests, after the vehicle was designated as 0 points in contact with the dummy. Also, it was set again each time an event such as a collision occurred due to AEB being non-activated during the test.

4. Comparative Analysis of Results

4.1. Distance Measurement Results Using A Monocular Camera

The vehicle test for distance measurement using a monocular camera was conducted to acquire images of each scenario.
Table 5, Table 6 and Table 7 are data of the images recorded during the vehicle tests with a monocular camera, which can be calculated using Equation (6).
By measuring L 1 and L 2 , d image , a were theoretically calculated, and d real of CPNA was calculated from a minimum of 173 cm to a maximum of 288 cm. CPFC was calculated from a minimum of 148 cm to a maximum of 237 cm, and CPNC was calculated from a minimum of 51 cm to a maximum of 286 cm.

4.2. Vehicle Test Results

The results of the test for speed, acceleration, and relative distance for CPNA conducted at the vehicle-road link test intersection of the KIAPI were shown in Figure 11, CPFC is shown in Figure 12, CPNA is shown in Figure 13, respectively. The graphs of Figure 11, Figure 12 and Figure 13 show the results of measurements using measurement equipment. The measured value using DGPS were measured as a relative distance by setting the point to 0 m because the target is in the defined position. The test was repeated three times for each scenario. Besides, Table 8 shows the relative distances measured by measurement equipment for each test. By measuring L 1 and L 2 , d image , a were theoretically calculated, and d real of CPNA was calculated from a minimum of 173 cm to a maximum of 288 cm. CPFC was calculated from a minimum of 148 cm to a maximum of 237 cm, and CPNC was calculated from a minimum of 51 cm to a maximum of 286 cm.
Only a few of the 10 scenarios proposed in the preceding study were conducted. The reason is that AEB function was not activated when the driver steered the vehicle for sale. Even the user’s manual of the vehicle warns that the AEB’s performance may be deteriorated and it may not brake. The test was impossible as the AEB function was released when the driver operated the vehicle following a radius of rotation.

4.3. Results Comparative Analysis

Table 9, Table 10 and Table 11 are vehicle tests for scenarios by dummy and speed. The deviation of the obtained relative distances, such as the relative distance of the monocular camera and DGPS, were compared and organized. The minimum deviation of CPNA was 13 cm in the test result of 30-3, and the maximum deviation was 25 cm in the test result of 25-1. The minimum deviation of CPFC was 2.3 cm in the test result of 30-3, and the maximum deviation was 21.9 cm in the test result of 25-1. The minimum deviation of CPNC was 3 cm in the test results of 25-3, and the maximum deviation was 12 cm in the test results of 20-2, 20-3, and 25-1.
The cause of the maximum deviation in each scenario is due to the inaccurate lane recognition in the camera image. In particular, an additional reason for significant deviations in scenario 20-1, 25-1, is believed that the emergency braking activated late, as the recognition of the small child dummy was made late.

5. Conclusions

In this paper, the relative distance was measured, compared, and analyzed to verify the safety evaluation method of the AEB function utilizing a monocular camera after the AEB was operated with a monocular camera and DGPS equipment using the pedestrian evaluation scenario suggested in the previous study. The KIAPI conducted vehicle testing, and the following conclusions were drawn:
(1)
In a previous study, using a vanishing point detected in the video taken by the monocular camera and geometric information that calculates the lane width from a lane, a theoretical formula was proposed to calculate the relative distance from the vehicle in front.
(2)
A vehicle test was conducted using a pedestrian safety emergency braking scenario tailored to the domestic road environment.
(3)
The vehicle test was conducted by a real vehicle at the vehicle-road link test intersection of the KIAPI. It was repeated three times with the same equipment and the driver to ensure objectivity, dummies of adults and children were used for pedestrians, and the vehicle used was a Genesis G90.
(4)
In the same test vehicle, the relative distance measured by measurement equipment like precise DGPS and relative distances using a monocular camera was compared. In the results of CPNA, the minimum deviation was 13 cm in 30-3, and the maximum deviation were 25 cm in 25-1. In the results of CPFC, the minimum deviation was 2.3 cm in 30-3, and the maximum deviation was 21.9 cm in 25-1. In the results of CPNC, the minimum deviation was 3 cm in 25-3, and the maximum deviation was 12 cm in 20-2, 20-3 and 25-1.
(5)
The cause of each scenario and the maximum deviation is because the lane recognition in the camera image was not accurate. In particular, in the scenario CPFC 20-1, 25-1, it is judged that the emergency braking operation was delayed due to the belated recognition of the small children’s dummy.
In this study, to verify pedestrians’ safety evaluation method using a monocular camera, the distance measurement method using the monocular camera of the previous study was applied to the AEB evaluation scenario.
The result of comparative analysis by acquiring the relative distance through the vehicle test showed a minimum deviation of 2.3 cm in 30-3 of the CPFC, and the maximum deviation is 25 cm of the CPNA.
Accordingly, the evaluation results of The AEB using a monocular camera in the driving state of the real vehicle was seen that the stopping distance is slightly longer compared to the evaluation results of the existing DGPS. The reason was judged on the measurement error when measuring the variables required for Equation (6).
However, the AEB applied to the current mass-produced car is based on expensive sensors like rider radar, so there is a considerable disadvantage to the cost. It is considered that the cost burden can be reduced by applying AEB with a monocular camera only. It was also found that it is possible to use it as a safety evaluation method in an environment where a vehicle test is impossible. In the future, it is considered that a safety evaluation in bad weather is necessary.

Author Contributions

Conceptualization: S.-B.L., methodology: S.-B.L., actual test: B.-J.K. and S.-B.L., data analysis: B.-J.K. and S.-B.L., investigation: B.-J.K., writing-original draft preparation: B.-J.K. and S.-B.L., writing-review and editing: B.-J.K. and S.-B.L. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Technology Innovation Program (10079967, Technical development of demonstration for evaluation of autonomous vehicle system) funded By the Ministry of Trade, Industry & Energy (MOTIE, Korea).

Acknowledgments

This work was supported by the Technology Innovation Program (10079967, Technical development of demonstration for evaluation of autonomous vehicle system) funded By the Ministry of Trade, Industry & Energy (MOTIE, Korea).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. TTAS (Traffic Accident Analysis System) Statistical Report 2019. Available online: http://taas.koroad.or.kr/web/bdm/srs/selectStaticalReportsDetail.do (accessed on 1 June 2020).
  2. Cicchino, J.B. Real-world effects of rear automatic braking and other backing assistance systems. J. Saf. Res. 2019, 68, 41–47. [Google Scholar] [CrossRef]
  3. Zhang, X.; Yang, W.; Tang, X.; Liu, J. A Fast Learning Method for Accurate and Robust Lane Detection Using Two-Stage Feature Extraction with YOLO v3. Sensors 2018, 18, 4308. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Hamid, U.Z.A.; Zakuan, F.R.A.; Zulkepli, K.A.; Azmi, M.Z.; Zamzuri, H.; Rahman, M.A.A.; Zakaria, M.A. Autonomous emergency braking system with potential field risk assessment for frontal collision mitigation. In Proceedings of the 2017 IEEE Conference on Systems, Process and Control (ICSPC 2017), Malacca, Malaysia, 15–17 December 2017; pp. 71–76. [Google Scholar]
  5. Rosen, E. Autonomous Emergency Braking for Vulnerable Road Users. In Proceedings of the International Research Council on the Biomechanics of Injury, IRCOBI, Gothenburg, Sweden, 11–13 September 2013; p. 735. [Google Scholar]
  6. Woo, J.W.; Yu, S.B.; Lee, S.B. Design and simulation of a vehicle test bed based on intelligent transport systems. Int. J. Automot. Technol. 2016, 17, 353–359. [Google Scholar] [CrossRef]
  7. Yang, W.; Zhang, X.; Lei, Q.; Cheng, X. Research on Longitudinal Active Collision Avoidance of Autonomous Emergency Braking Pedestrian System (AEB-P). Sensors 2019, 19, 4671. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Lenard, J.; Badea-Romero, A.; Dantron, R. Typical pedestrian accident scenarios for the development of autonomous emergency braking test protocols. J. Accid. Anal. Prev. 2014, 73, 73–80. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  9. Hamdane, H.; Serre, T.; Masson, C.; Anderson, R. Issues and challenges for pedestrian active safety systems based on real world accidents. Accid. Anal. Prev. 2015, 82, 53–60. Available online: https://0-www-sciencedirect-com.brum.beds.ac.uk/science/article/pii/S0001457515001979 (accessed on 1 June 2020).
  10. Siddiqui, O.; Famiglietti, N.; Nguyen, B.; Hoang, R.; Landerville, J. Empirical Study of the Braking Performance of Pedestrian Autonomous Emergency Braking (P-AEB); SAE International: Warrendale, PA, USA, 2020. [Google Scholar] [CrossRef]
  11. Kwon, B.H.; Lee, S.B. A Study on the Test Evaluation Method of AEB (V2P) Considering the Road Environment in Korea and Euro NCAP Test Protocol v3.0.1. J. Korean Auto-Veh. Saf. Assoc. 2019, 11, 28–38. [Google Scholar]
  12. Jeppsson, H.; Östling, M.; Lubbe, N. Real life safety benefits of increasing brake deceleration in car-to-pedestrian accidents: Simulation of Vacuum Emergency Braking. Accid. Anal. Prev. 2018, 111, 311–320. [Google Scholar] [CrossRef] [PubMed]
  13. Lubbe, N.; Davidsson, J. Drivers’ comfort boundaries in pedestrian crossings: A study in driver braking characteristics as a function of pedestrian walking speed. Saf. Sci. 2015, 75, 100–106. [Google Scholar] [CrossRef]
  14. Euro NCAP. Vulnerable Road User (VUR) Protection—AEB VRU Test Protocol v3.0.2 (2020, 01). Available online: https://cdn.euroncap.com/media/53153/euro-ncap-aeb-vru-test-protocol-v302.pdf (accessed on 1 June 2020).
  15. Shi, L.; Han, Y.; Huang, H.; Li, Q.; Wang, B.; Mizuno, K. Analysis of pedestrian-to-ground impact injury risk in vehicle-to-pedestrian collisions based on rotation angles. J. Saf. Res. 2018, 64, 37–47. [Google Scholar] [CrossRef] [PubMed]
  16. Murmu, N.; Chakraborty, B.; Nandi, D. Relative velocity measurement using low cost single camera-based stereo vision system. J. Meas. 2019, 141, 1–11. [Google Scholar] [CrossRef]
  17. Raza, M.; Chen, Z.; Rehman, S.U.; Wang, P.; Wang, J.K. Framework for estimating distance and dimension attributes of pedestrians in real-time environments using monocular camera. J. Neurocomput. 2018, 275, 533–545. [Google Scholar] [CrossRef]
  18. Zaarane, A.; Slimani, I.; al Okaishi, W.; Atouf, I.; Hamdoun, A. Distance measurement system for autonomous vehicles using stereo camera. J. Array 2020, 5, 100016. [Google Scholar] [CrossRef]
  19. Bae, G.H.; Lee, S.B. A Study on Calculation Method of Distance with Forward Vehicle Using Single-Camera. Proc. Symp. Korean Inst. Commun. Inf. Sci. 2019, 256–257. [Google Scholar]
  20. Euro NCAP. Technical Papers—Euro NCAP 2025 Roadmap (2017, 09). Available online: https://cdn.euroncap.com/media/30700/euroncap-roadmap-2025-v4.pdf (accessed on 20 June 2020).
Figure 1. Lane and loss points detected from the image.
Figure 1. Lane and loss points detected from the image.
Applsci 10 04683 g001
Figure 2. Principle of distance calculation.
Figure 2. Principle of distance calculation.
Applsci 10 04683 g002
Figure 3. CPNA scenario of V2P.
Figure 3. CPNA scenario of V2P.
Applsci 10 04683 g003
Figure 4. CPFC scenario of V2P.
Figure 4. CPFC scenario of V2P.
Applsci 10 04683 g004
Figure 5. CPNC scenario of V2P.
Figure 5. CPNC scenario of V2P.
Applsci 10 04683 g005
Figure 6. Test vehicle (GENESIS G90).
Figure 6. Test vehicle (GENESIS G90).
Applsci 10 04683 g006
Figure 7. Vehicle-road connection test intersection.
Figure 7. Vehicle-road connection test intersection.
Applsci 10 04683 g007
Figure 8. Test measurement equipment (a) RT-3002 (DGPS) (b) SIRIUS (DAQ) (c) Camera Module.
Figure 8. Test measurement equipment (a) RT-3002 (DGPS) (b) SIRIUS (DAQ) (c) Camera Module.
Applsci 10 04683 g008
Figure 9. Dummy (a) Child Dummy (b) Adult Dummy.
Figure 9. Dummy (a) Child Dummy (b) Adult Dummy.
Applsci 10 04683 g009
Figure 10. Monocular camera.
Figure 10. Monocular camera.
Applsci 10 04683 g010
Figure 11. Test results(CPNA) (a) 20 km/h test velocity & cumulative delay time (b) 20 km/h test acceleration (c) 20 km/h test relative distance (d) 25 km/h velocity & cumulative delay time (e) 25 km/h test acceleration (f) 25 km/h test relative distance (g) 30 km/h velocity & cumulative delay time (h) 30 km/h test acceleration (i) 30 km/h test relative distance (j) legend.
Figure 11. Test results(CPNA) (a) 20 km/h test velocity & cumulative delay time (b) 20 km/h test acceleration (c) 20 km/h test relative distance (d) 25 km/h velocity & cumulative delay time (e) 25 km/h test acceleration (f) 25 km/h test relative distance (g) 30 km/h velocity & cumulative delay time (h) 30 km/h test acceleration (i) 30 km/h test relative distance (j) legend.
Applsci 10 04683 g011
Figure 12. Test results (CPFC) (a) 20 km/h test velocity & cumulative delay time (b) 20 km/h test acceleration (c) 20 km/h test relative distance (d) 25 km/h velocity & cumulative delay time (e) 25 km/h test acceleration (f) 25 km/h test relative distance (g) 30 km/h velocity & cumulative delay time (h) 30 km/h test acceleration (i) 30 km/h test relative distance.
Figure 12. Test results (CPFC) (a) 20 km/h test velocity & cumulative delay time (b) 20 km/h test acceleration (c) 20 km/h test relative distance (d) 25 km/h velocity & cumulative delay time (e) 25 km/h test acceleration (f) 25 km/h test relative distance (g) 30 km/h velocity & cumulative delay time (h) 30 km/h test acceleration (i) 30 km/h test relative distance.
Applsci 10 04683 g012
Figure 13. Test results(CPNC) (a) 20 km/h test velocity & cumulative delay time (b) 20 km/h test acceleration (c) 20 km/h test relative distance (d) 25 km/h velocity & cumulative delay time (e) 25km/h test acceleration (f) 25 km/h test relative distance (g) 30 km/h velocity & cumulative delay time (h) 30 km/h test acceleration (i) 30 km/h test relative distance.
Figure 13. Test results(CPNC) (a) 20 km/h test velocity & cumulative delay time (b) 20 km/h test acceleration (c) 20 km/h test relative distance (d) 25 km/h velocity & cumulative delay time (e) 25km/h test acceleration (f) 25 km/h test relative distance (g) 30 km/h velocity & cumulative delay time (h) 30 km/h test acceleration (i) 30 km/h test relative distance.
Applsci 10 04683 g013
Table 1. AEB pedestrian scenario test conditions.
Table 1. AEB pedestrian scenario test conditions.
ConditionSVDummy
CPNAVelocity [km/h]20, 25, 305
Acceleration [m/s2]00
CPFCVelocity [km/h]20, 25, 305
Acceleration [m/s2]00
CPNCVelocity [km/h]20, 25, 305
Acceleration [m/s2]00
Table 2. Test measurement equipment spec.
Table 2. Test measurement equipment spec.
NameSpec.
RT-3002 (DGPS)
-
single antenna model
-
velocity accuracy: 0.05 km/h RMS
-
roll, pitch: 0.03 deg, heading 0.1 deg
-
GPS accuracy: 2 cm RMS
SIRIUS (DAQ)
-
power supply: 9–36VDC
-
operating temperature: −10–50 ℃
-
storage temperature: −40–85 ℃
-
humidity: 5–95% at 60 ℃
Camera module
-
full HD 1080p video call and clear stereo audio
-
FOV: about 78°
Table 3. Dummy spec.
Table 3. Dummy spec.
NameSpec.
Adult dummy
-
height [m]: 1.7
-
width [m]: 0.75
-
length [m]: 0.5
Child dummy
-
height [m]: 1.1
-
width [m]: 0.65
-
length [m]: 0.4
Table 4. Monocular camera spec.
Table 4. Monocular camera spec.
NameSpec.
K-900 QD
-
Front: Quad HD (2560 × 1440 p) 5.48 M effective pixels SONY IMX326 sensor, 30 fps, FOV: about 120° (diagonal), effective FOV: about 103° (horizontally), about 53° (vertically)
-
Rear: full HD (1920 × 1080 p) 2.13 M effective pixels SONY IMX322 sensor, 30 fps, FOV: about 125° (diagonal), effective FOV: about 105° (horizontally), about 54° (vertically)
Table 5. Relative distance using a monocular camera (CPNA), [cm].
Table 5. Relative distance using a monocular camera (CPNA), [cm].
No. L 1 L 2 d image a d real
20-121.91513.9−215387.7173
20-220.40313.9−187387.7200
20-320.65713.8−195387.7193
25-118.89313.98−153387.7235
25-217.73613.98−124387.7263
25-317.81313.56−140387.7247
30-117.57913.67−131387.7257
30-216.70813.86−100387.7288
30-321.51813.98−206387.7182
Table 6. Relative distance using a monocular camera (CPFC), [cm].
Table 6. Relative distance using a monocular camera (CPFC), [cm].
No. L 1 L 2 d image a d real
20-122.4113.98−221387.7167
20-223.6814.27−234387.7154
20-323.6013.98−240387.7148
25-119.0314.07−153387.7235
25-223.1314.08−230387.7158
25-320.5114.13−183387.7205
30-121.7414.16−205387.7183
30-218.8013.98−151387.7237
30-320.5713.86−192387.7196
Table 7. Relative distance using a monocular camera (CPNC), [cm].
Table 7. Relative distance using a monocular camera (CPNC), [cm].
No. L 1 L 2 d image a d real
20-116.8710.17−233387.7154
20-215.4910.17−202387.7186
20-314.6310.13−181387.7207
25-112.2310.12−101387.7286
25-214.8810.22−184387.7204
25-315.1310.27−189387.7199
30-116.0010.35−208387.7180
30-223.5810.51−326387.762
30-324.6710.55−336387.751
Table 8. Results value (relative distance) using measurement equipment, [cm].
Table 8. Results value (relative distance) using measurement equipment, [cm].
ScenarioResults Value Using Measurement Equipment
CPNACPFCCPNC
20-1154147147
20-2183139.5174
20-3176135.1195
25-1210213.1274
25-2246141.4194
25-3234193196
30-1239191.9170
30-226422253
30-3169198.344
Table 9. Error factor by scenario of measured value using monocular camera vs results value using measurement equipment (CPNA), [cm].
Table 9. Error factor by scenario of measured value using monocular camera vs results value using measurement equipment (CPNA), [cm].
ScenarioMeasured Value Using Monocular CameraResults Value Using Measurement EquipmentDeviation
20-117315419
20-220018317
20-319317617
25-123521025
25-226324617
25-324723413
30-125723918
30-228826424
30-318216913
Table 10. Error factor by scenario of measured value using monocular camera vs results value using measurement equipment (CPFC), [cm].
Table 10. Error factor by scenario of measured value using monocular camera vs results value using measurement equipment (CPFC), [cm].
ScenarioMeasured Value Using Monocular CameraResults Value Using Measurement EquipmentDeviation
20-1167147.020
20-2154139.514.5
20-3148135.112.9
25-1235213.121.9
25-2158141.416.6
25-3205193.012
30-1183191.98.9
30-2237222.015
30-3196198.32.3
Table 11. Error factor by scenario of measured value using monocular camera vs results value using measurement equipment (CPNC), [cm].
Table 11. Error factor by scenario of measured value using monocular camera vs results value using measurement equipment (CPNC), [cm].
ScenarioMeasured Value Using Monocular CameraResults Value Using Measurement EquipmentDeviation
20-11541477
20-218617412
20-320719512
25-128627412
25-220419410
25-31991963
30-118017010
30-262539
30-351447

Share and Cite

MDPI and ACS Style

Kim, B.-J.; Lee, S.-B. A Study on the Evaluation Method of Autonomous Emergency Vehicle Braking for Pedestrians Test Using Monocular Cameras. Appl. Sci. 2020, 10, 4683. https://0-doi-org.brum.beds.ac.uk/10.3390/app10134683

AMA Style

Kim B-J, Lee S-B. A Study on the Evaluation Method of Autonomous Emergency Vehicle Braking for Pedestrians Test Using Monocular Cameras. Applied Sciences. 2020; 10(13):4683. https://0-doi-org.brum.beds.ac.uk/10.3390/app10134683

Chicago/Turabian Style

Kim, Bong-Ju, and Seon-Bong Lee. 2020. "A Study on the Evaluation Method of Autonomous Emergency Vehicle Braking for Pedestrians Test Using Monocular Cameras" Applied Sciences 10, no. 13: 4683. https://0-doi-org.brum.beds.ac.uk/10.3390/app10134683

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop