Next Article in Journal
An Approach to Advance Circular Practices in the Maritime Industry through a Database as a Bridging Solution
Next Article in Special Issue
Innovative Approaches to Sustainable Computer Numeric Control Machining: A Machine Learning Perspective on Energy Efficiency
Previous Article in Journal
Hybrid Intelligence for Marine Biodiversity: Integrating Citizen Science with AI for Enhanced Intertidal Conservation Efforts at Cape Santiago, Taiwan
Previous Article in Special Issue
Determining Factors Influencing Short-Term International Aviation Traffic Demand Using SHAP Analysis: Before COVID-19 and Now
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Comprehensive Safety Index for Road Safety Management System

1
Department of Civil Engineering, Seoul National University of Science and Technology, Seoul 01811, Republic of Korea
2
Korea Transportation Safety Authority, Seoul 03937, Republic of Korea
3
Faculty of Economics and Management, University of Carthage, Carthage 1054, Tunisia
4
School of Liberal Studies, Kunsan National University, Kunsan 54150, Republic of Korea
5
Department of Smart City Engineering, Hanyang University ERICA Campus, Ansan 15588, Republic of Korea
*
Authors to whom correspondence should be addressed.
Sustainability 2024, 16(1), 450; https://0-doi-org.brum.beds.ac.uk/10.3390/su16010450
Submission received: 20 September 2023 / Revised: 2 December 2023 / Accepted: 27 December 2023 / Published: 4 January 2024
(This article belongs to the Special Issue Selected Papers on Sustainability from IMETI 2022)

Abstract

:
A safety-index-based road safety management system (RSMS) is a tool to help identify locations where safety intervention is needed. To date, various safety indices have been developed and utilized, but it is rare to consider the plan–do–check–act structure in an RSMS when studying the decision-making methodology. In this study, 36 indicators and a system of evaluation indicators were selected based on the major classifications of performance, effect, and improvement. Performance was categorized by safety system components and effect was reflected in the safety status, such as the number of injuries. The indicators were validated, and a classification methodology for safety groups was proposed through cluster analysis. It was found that there was no correlation between the indicators and the population, budget, or road area by administrative district. It was also found that no particular indicators had a significant impact on the overall result in the major category or the overall index. It was determined that the developed indicators were suitable for administrative district-specific safety monitoring. It is expected that these indicators will be continuously utilized and enhanced in the national evaluation of road traffic safety.

1. Introduction

Sustainability and traffic safety are inseparable and interrelated since they both concepts are related to improving living environments. Sustainable traffic safety implies that the traffic environment is designed to minimize traffic accidents and mitigate the severity of the accidents. The fundamental principle of sustainable traffic safety is that a road traffic system cannot be sustainable if it is not safe for people. Traffic safety is now acknowledged worldwide, and the international standard for road traffic-safety-management systems, ISO 39001 [1], takes into account all organizations that use, design, and build roads and vehicles and incorporates safety-related performance factors. Furthermore, aligning with the global movement towards incorporating international standardization of road traffic safety systems in Korea, this study specifically concentrated on synthesizing factors related to safety performance. There are safety indicators for the government to maintain road traffic safety [2,3,4], but the data are limited on indicators for local governments that take into account the plan–do–check–act (PDCA) model presented in ISO 39001. The model, known as the Deming cycle or plan–do–study–act (PDSA), serves as a fundamental management system extensively employed in both management and work contexts. It endeavors to enhance management within the quality-management domain through an iterative four-step approach, fostering continuous improvement of services and problem resolution. This paper describes the development of a comprehensive safety index for local government road safety management systems (RSMSs). In the context of local governments, Korean standards have been applied with necessary modifications, and non-Seoul local governments engage in ongoing exchanges and research. This underscores the importance of categorization to enable the implementation of policies customized to the distinctive characteristics of each administrative district. Korean data were utilized to obtain indicators that local governments can use for safety management by reflecting the PDCA model. The data can also be used to make academic contributions to road traffic-safety-management systems.
Road safety management systems (RSMSs) have been developed by various organizations including the Organization for Economic Cooperation and Development (OECD), the World Bank, and the European Union (EU) [5,6,7]. The safety-system approach has been widely applied in the industrial sector. Traffic accidents are now increasingly perceived, by both individuals and the public, as being a shared responsibility. This is due to the public’s role in establishing safety standards and managing vehicles and roads. Consequently, it is imperative to assess whether individuals and the public are making suitable efforts for traffic safety. This implies that safety is regarded as a product and a service. This RSMS model complies with New Zealand’s target-setting framework (Land Transport Safety Authority, 2000) [8] and the World Bank guidelines for developing prototype safety management capacity evaluation indicators.
In the United States, the state government establishes road-safety policies, is responsible for safety management such as regulations, and implements post-improvement measures in a continuous manner [9,10,11]. In recent years, there have been many cases of utilizing road traffic-safety-management systems as suggested in ISO 39001 [12,13,14]. To implement road traffic-safety-management systems, it is necessary to establish a performance index that considers the government’s perspective on road traffic safety and the system-management perspective [15]. Although numerous safety indicators have been developed, no indicator that simultaneously reflects the two perspectives has yet been identified.
When it comes to road traffic-safety-management systems, planning, monitoring, and feedback are crucial [16,17,18]. From the government’s perspective, continuous management of the established plan is required, and systematic management of the national plan at the provincial level is essential [19,20,21,22]. To this end, indicators (for example, pedestrian crossing stop line compliance rate, rate of turn signal illumination, traffic signal compliance rate, seatbelt use rate, helmet use rate of two-wheeled vehicle users, use of mobile devices while driving, driving under the influence, speed-limit violations, pedestrian crossing traffic signal compliance rate, rate of pedestrians using mobile devices while crossing street, and jaywalking) are necessary to evaluate the efficacy and consistency of objectives presented in national and local plans [23]. In Korea, for instance, when a national road safety master plan is established, local government develops their own plans which are evaluated accordingly. In this paper a comprehensive safety index for local government road safety management systems (RSMSs) is developed.
In Section 2, existing research on road safety indicators in terms of RSMSs is reviewed. Section 3 details, in stages, the indicator development methodology. The outcomes of the analysis are presented in Section 4, while discussions and conclusions are summarized in Section 5.

2. Literature Review

Until recently, road safety indicators had been the subject of ongoing research. Illustratively, in the instance of the OECD’s Towards Zero mentioned earlier, elements outlined in the Ambitious Road Safety Targets, encompassing traffic systems, road safety, vehicle safety, membership, and countermeasures, were incorporated. This resulted in the formulation of a comprehensive indicator capable of systematic evaluation, utilizing both individual and macro indicators. This contribution aimed to enhance academic understanding and contribute to the advancement of safety indices. Riccardi et al. (2022) developed a safety index to contribute to the development of safety evaluation procedures for the entire road network, and attempted to prioritize the safety issues that had the greatest influence on collision reduction, and conducted the study with a focus on a particular region. In their study, the calculation procedure for the safety index was validated in 50 samples from Rome, Italy, and the correlation between the safety-index score and the collision estimate, by lane type, was demonstrated [24]. Demasi, F. et al. (2018) proposed an analysis methodology for estimating road traffic safety in detailed road networks within a city and attempted to identify and index the causal factors between driving-safety-related defects and traffic collisions to assess the fatality or injury rate. A risk index for each section constituting the road, such as traffic volume, average speed, and prediction of vulnerable roads, can be indicated in the event of a traffic collision. Demasi, F., et al. (2018) attempted to highlight the design of road traffic safety in the city and the use of risk management [25]. Chen, F., et al. (2016) developed a road safety performance indicator (SPI) to derive a universally accepted approach for road traffic safety enhancement, and combined it into a comprehensive indicator, to establish a systematic safety-index methodology through key activities to verify outstanding road traffic safety [26]. Papadimitriou E. and Yannis G. (2013) implemented SPIs for RSMS utilizing data from 30 European nations as a theoretical framework [27].
The development and utilization of safety-related indicators by domestic and international organizations are currently underway. In the case of the EU, a number of indicators characterizing road traffic safety outcomes and road-safety-policy performance were aggregated into a single figure, which represented a country’s overall road safety index. This includes structure and culture, safety measures and programs, SPIs, the number killed and injured, and social costs, each of which is categorized into the three target hierarchies of outcome, policy performance, and policy context (International Transport Forum (ITF), 2022) [28]. In 2018, the Statistics Research Institute of Korea established safety indicators in three categories: hazard factors (total safety, social safety, and environmental health and safety), vulnerable factors, and safety management. As one of the transportation policy evaluation indicators, the Korea Transport Institute reflected traffic collision costs (by means, by accident severity, and by traffic collision cost composition) in its 2021 report. Evaluation studies based on safety indicators have been continuously conducted both domestically and internationally. Amoros (2003) incorporated regional characteristics and road types as exposure variables based on the collision rate and collision severity distribution in certain regions of France and presented a model to predict the number of collisions and collision severity by region [29]. AL Haji (2005) developed a methodology for calculating the road safety development index by establishing six categories of exposure indicators: road traffic safety level, user safety level, vehicle safety level, road level, user behavior, and socioeconomic conditions. On this basis, the level of road traffic safety in Sweden and major Southeast Asian nations was compared [30]. The primary objective of this study was to construct a comprehensive set of exposure and risk indicators, encompassing key parameters of road safety pertaining to human–vehicle–road dynamics and national patterns. This approach moves beyond the consideration of single and isolated indicators, such as accident rates. Instead, it incorporates relevant characteristics for multiple countries, particularly developing nations. Utilizing the road safety development index (RSDI) indicators, Singapore and Brunei emerged with the most favorable RSDI records among ASEAN countries, while Laos, Cambodia, and Vietnam exhibited lower RSDI records. These promising RSDI outcomes warrant further exploration through additional applications with samples from larger countries and diverse regions worldwide.
The reviewed safety indicators had a cross-sectional structure, and there were no indicators that considered the PDCA model. In this investigation, the cross-sectional structure was delineated as a data framework wherein multiple variables were concurrently collected within the same period. Regional comparisons of road traffic safety were also conducted, but it was not possible to compare safety-related indicators comprehensively from the perspective of road traffic safety management (no indicators were considered for road safety management system (RSMS) activity or organization). Therefore, we systematically analyzed the indicators and developed an evaluation methodology for each local government.

3. Methodology

In order to employ an RSMS, we established a hierarchy and chose sub-indicators for each hierarchy. The indicators were founded on the tasks outlined in Korea’s National Road Safety Master Plan. Utilizing cluster analysis, we derived specific indicators for each administrative district in Korea, which were then incorporated into an interregional evaluation system. The safety system of an RSMS categorizes the three-stage division into a pyramid shape, aiming to attain the desired level of results. Concerning performance, it is posited that enhancements in safety-related performance can occur only through concerted efforts at the institutional management and policy levels, rooted in public responsibility and operational strategies.
We conducted case studies of the operation of road traffic safety evaluation systems by overseas region, area, and local government for regional road traffic safety, and compiled 163 detailed indicators currently implemented at home and abroad. Using the collected indicators, we selected those that conformed to the safety plans announced in Korea, could be collected, and could be applied to an RSMS. During this process, we consolidated overlapping indicators and gave priority to indicators that continued to be collected. Finally, we came up with 36 indicators. The selected indicators were reconstructed in accordance with the performance, effect, and improvement hierarchy applicable to the RSMS.
We compiled and selected domestic and international evaluation indicators for road traffic safety. An RSMS considers that evaluation of road safety management systems is possible by public effort, and safety systems have the characteristics of a pyramid, which comprises interventions to obtain a proper level of results and institutional management that supports these interventions [31]. “Institutional management” is the foundation of road safety management systems and can be defined as organizational systems, budgets, plans, laws, and systems associated with road traffic safety [8,28]. “Interventions” can be defined as influences that prevent traffic collisions in advance or reduce their severity, such as the safe design and operation of vehicles, roads, and associated facilities, as well as education, training, and public awareness for road users. Lastly, “results” addresses the number of traffic collisions, human casualties, and resulting social costs [8,28,32] (Figure 1).
The concepts of “results”, “interventions”, and “institutional management” were constructed from the PDCA perspective of RSMSs into “performance”, “effect”, and “improvement” (Figure 2).
The initial stages of exploration of the available road safety indices and factor exploration analysis (RSMSs) involved collecting, to the greatest extent possible, existing indicators utilized in Korea. The objective was to incorporate diverse and practical indicators, and to subsequently filter them. This process was integral to categorizing the pyramid-specific attributes of the RSMSs, and represented the phase of data collection and characteristic classification preceding the derivation of the final indicator.
Using the indicators at the administrative-district level, we performed a cluster analysis to determine the implications of using the developed indicators for regional safety level comparison. K-means clustering was utilized for cluster analysis [33,34]. K-means clustering [35] is an analysis technique that groups n data into k clusters. It is a cluster analysis that enables the collection of data over short distances by using averages that can represent each k cluster. Clustering is the process of determining the number of clusters, setting the average value of each cluster at random, and then setting the average value with the smallest Euclidean distance as one cluster by averaging all data values and the Euclidean distance [35,36]. We used the elbow method to examine the number of clusters (final k) for which the variability within clusters decreased drastically as the number of clusters increased.
Regarding K-means cluster analysis and hierarchical cluster analysis, density-based clustering employs a methodology that clusters regions with dense concentrations of points. This algorithm can be applied to a wide range of data types for analysis, as it recalculates the average and updates the initial values. It allows for the meaningful analysis of data without requiring prior information about the internal structure of the given dataset.

4. Results

4.1. Indicator Exploration

A total of 163 indicators were extracted in Korea by classifying them according to the measurement method (e.g., observational study, statistical research, or questionnaire survey), data stability (use of existing data or conducting a separate survey), data cycle, data form (e.g., quantitative or qualitative, population or sample), detailed calculation formula, and factors (e.g., vehicles, humans, or facilities). Those indicators were standardized by eliminating redundancies, and we evaluated their relevance to the National Road Safety Master Plan. Then, the indicators were reclassified based on the hierarchy and divided into performance, effect, and improvement, and they were derived and reviewed to select the final indicators. Table 1 is an example of established safety indices, classifying them according to the measurement method (e.g., observational study, statistical research, or questionnaire survey), data stability (use of existing data or conducting a separate survey), data cycle, data form (e.g., quantitative or qualitative, population or sample), detailed calculation formula, and factors (e.g., vehicles, humans, or facilities). Indicators were standardized by eliminating redundancies, and we evaluated their relevance to the National Road Safety Master Plan. Then, the indicators were reclassified based on the hierarchy divided into performance, effect, and improvement, and they were derived and reviewed to select the final indicators. Table 1 is an example of established safety indices. Consequently, the classification was conducted based on the characteristics of indicators in Korea. Subsequently, an exclusion process was implemented to eliminate indicators that did not align with these characteristics, aiming to reduce errors in the parameter data characteristics.
In this study, the search was performed by classifying indicators according to their individual characteristics. In the case of factors, 42 indicators were assigned to facilities, 45 indicators to humans, 50 indicators to local governments, and 26 indicators to vehicles. In terms of data forms, 36 quantitative population indicators, 85 quantitative sample indicators, and 42 qualitative indicators were classified. In the classification by stage, 40 indicators for prevention, 17 indicators for response, 28 indicators for preparation, and 78 indicators for improvement were categorized. In terms of data stability, the indicators were separated into 42 indicators for utilizing existing data and 121 indicators for a separate survey. Regarding the detailed calculation method, classifications were made for 21 observational studies, 17 literature reviews, 15 questionnaire surveys, 55 statistical research studies, 33 statistical indicators, and 22 undetermined cases.

4.2. Result of Indicator Selection

The performance category was categorized further into traffic system, road safety, vehicle safety, members, and countermeasures. This was in line with the factors outlined in the OECD’s Towards Zero: Ambitious Road Safety Targets and the Safe System Approach. In the effect category, the number of road casualties (fatalities and injuries) was represented in two ways: the target achievement rate and performance achievement. Lastly, the improvement category was subdivided into YoY improvement in the detailed factors in the effect category, efforts for safety improvement, and the feedback category. In this study, however, feedback and other efforts were deemed qualitative variables. The final results are organized according to these categories in Table 2.
The final evaluation sub-indicators were chosen based on data availability, representativeness, and compatibility with existing indicators. We then normalized the derived indicators on a 10-point scale for administrative district-level comparisons. However, feedback and other efforts were evaluated as qualitative areas among the improvement areas.
The indicators for each administrative district in Korea, based on 2021 data (evaluated in 2022) for performance, effect, and improvement by city and province, are summarized in Table 3. Individual indicators were aggregated under the assumption that they all carried the same weight. In terms of performance, Gyeonggi-do scored highest, followed by Busan, Seoul, Daejeon, and In-cheon. Gyeonggi-do again scored top in terms of effect, followed by Incheon, Gyeongnam, Sejong, and Seoul. Jeollanam-do ranked first for the improvement indicator, followed by Daegu, Jeolla-buk-do, Incheon, and Gwangju. In terms of the average of the three indicators, Gyeonggi-do received the highest score, followed by Incheon, Seoul, Busan, and Gwangju.
The results for each indicator, by administrative district, are shown graphically in Figure 3, Figure 4 and Figure 5. There was no correlation between indicators, and there was no dominant indicator in each main category, according to the analysis. Consequently, there were no inappropriate indicators for the evaluation by administrative district.
Table 2 presents a concise overview of the evaluation index formulas and associated statistical metrics for each classification factor, representing the outcome of the ultimate selection of traffic safety indicators.
Table 3 provides a comprehensive summary of the study’s final indicator results, offering index analysis results based on the primary categorization of 17 administrative districts.
Table 3 also provides a concise summary of indicator results for administrative districts in Korea. It is based on 2021 data related to performance, effect, and improvement across both cities and provinces, with evaluations conducted in 2022. These individual indicators were aggregated with an assumption of equal weighting.
Figure 3, Figure 4 and Figure 5 correspond to the calculated results of individual indicators within each administrative district, categorized under performance, effect, and improvement. These figures serve as detailed supplements to the information presented in Table 3, above.
Upon implementing the elbow method (Figure 6), we established four clusters for k-means clustering. In Figure 7, the k-means clustering analysis results for the three categories—performance, effect, and improvement—are depicted on a three-dimensional graph. There are four clusters in total: Cluster 1 (Seoul, Busan, Incheon, Gwangju, Gyeonggi-do, and Gyeongsangnam-do); Cluster 2 (Ulsan, Sejong, and Chungcheongbuk-do); Cluster 3 (Daegu, Gangwon-do, Jeollabuk-do, Jeollanam-do, and Jeju); and Cluster 4 (Daejeon, Chungcheongnam-do, and Gyeongsangnam-do).
In Figure 8, the k-means clustering of the three categories is the result of resetting the city and provincial characteristics of population, budget, and road area as three axes of a three-dimensional graph. Despite being the result of conducting clustering analysis for each performance, effect, and improvement categorized in this study, the final value exhibited characteristics of division.
Thus, the 17 administrative districts of Korea were divided into four groups: Cluster 1 (six cities and provinces), Cluster 2 (three cities and provinces), Cluster 3 (five cities and provinces), and Cluster 4 (three cities and provinces). The population proportion for each group was as follows: 66.09% (Cluster 1), 5.99% (Cluster 2), 15.92% (Cluster 3), and 12.00% (Cluster 4). The budget proportions were 68.11% (Cluster 1), 4.49% (Cluster 2), 16.74% (Cluster 3), and 10.65% (Cluster 4). The road areas were 39.78% (Cluster 1), 8.65% (Cluster 2), 31.03% (Cluster 3), and 20.54% (Cluster 4). Table 4 displays the populations, budgets, and road areas by city and province for each cluster, while Table 5 displays the sum and proportion of each group’s characteristics.

5. Conclusions and Future Research

Local governments and other local road safety management stakeholders have developed indicators capable of objectively monitoring safety levels, evaluating effects, and constantly assessing the degree of improvement. We created a local government safety performance index based on RSMS criteria. We chose indicators that reflected the PDCA structure and accounted for institutional management, interventions, and results. Based on this, this study selected indicators explaining institutional management, intervention, and results in RSMSs. We reflected the factors outlined in OECD’s Towards Zero: Ambitious Road Safety Targets and the Safe System Approach, which are traffic system, road safety, vehicle safety, members, and countermeasures. We made academic contributions to the development of the safety index by creating comprehensive indicators that can be systematically evaluated as individual indicators or macro indicators.
Safety-related input resources were evaluated in terms of performance, whereas the level of accomplishment was visualized in effect. In terms of improvement, both enhancement efforts and the effect relative to the previous year were reflected. Additionally, we made these indicators comparable by region to determine the level of safety. However, as individual indicators were reflected with the same weight, future research on the composition of an evaluation system that reflects the significance of each indicator will be necessary.
There was no correlation between the indicators and the population, budget, or road area by administrative district. The results were consistent with common knowledge, in which safety-related plans are specific. The distinction between the highest and lowest administrative districts was clearly illustrated, and the distribution was appropriate. It was also found that no particular indicators had a significant impact on the overall result in the major category or the overall index. Therefore, it is believed that a suitable index for evaluating the region’s road safety has been developed. Following this, we anticipate that future research on the validation and enhancement of indicators will take place via annual evaluation. Regarding the indicators substituted in this study, it is noteworthy that the research stage adhered to the effectiveness and practical characteristics, with a particular emphasis on performance evaluation. This emphasis is underscored by the inclusion of actual indicators utilized by public institutions, such as the Korea Transportation Safety Authority.
In Korea, it was determined that safety-management-related administrative districts constitute clusters. They were classified into clusters with good performance, effect, and improvement; clusters in which the safety level was appropriately maintained despite low performance and improvement; clusters with a medium level of performance, effect, and improvement; and clusters in which all performance and effect indicators were low. From the safety-management perspective, these clusters were categorized, in this study, as groups with high performance, caution (potential risk), room for improvement, and high interest. Due to the fact that the results of this study do not reflect the significance weight for performance, effect, and improvement, it is necessary to develop an evaluation system that reflects the government’s policy direction in the institutionalization process.

Author Contributions

Conceptualization, K.H.K.; Methodology, K.-H.S.; Formal analysis, S.E.; Investigation, K.-H.S., S.C. and S.M.L.; Data curation, K.H.K.; Writing—original draft, K.-H.S. and W.S.; Writing—review & editing, W.S.; Project administration, K.H.K.; Funding acquisition, K.H.K. All authors have read and agreed to the published version of the manuscript.

Funding

This study was partly supported by research grants (NRF-2020R1A2C1011060 and NRF-2022K1A3A1A09078712) funded by the Korean government.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. ISO 39001; Road Traffic Safety (RTS) Management Systems—Requirements with Guidance for Use. International Organization for Standardization: Geneva, Switzerland, 2012.
  2. Violence & Injury Prevention & Disability, World Health Organization. Global Status Report on Road Safety: Time for Action; World Health Organization: Geneva, Switzerland, 2009. [Google Scholar]
  3. Hyder, A.A.; Allen, K.A.; Di Pietro, G.; Adriazola, C.A.; Sobel, R.; Larson, K.; Peden, M. Addressing the implementation gap in global road safety: Exploring features of an effective response and introducing a 10-country program. Am. J. Public Health 2012, 102, 1061–1067. [Google Scholar] [CrossRef] [PubMed]
  4. Brycht, N. Assessment of the quality of the repair process of local roads in the rural areas of the Częstochowa and Kłobuck poviats in the context of road safety. Prod. Eng. Arch. 2021, 27, 232–241. [Google Scholar] [CrossRef]
  5. Bliss, T. Implementing the Recommendations of the World Report on Road Traffic Injury Prevention; Transport Note No. TN-1; The World Bank: Washington, DC, USA, 2004. [Google Scholar]
  6. Bliss, T.; Breen, J. Implementing the Recommendations of The World Report on Road Traffic Injury Prevention. Country Guidelines for the Conduct of Road Safety Management Capacity Reviews and the Related Specification of Lead Agency Reforms, Investment Strategies and Safety Programs and Projects; Global Road Safety Facility, World Bank: Washington, DC, USA, 2008. [Google Scholar]
  7. Čabarkapa, M.; Avramović, Z.Ž. The applicability of Smeed’s Law in an evaluation of national road safety management systems: Montenegro versus Great Britain. Int. J. Inj. Control Saf. Promot. 2022, 29, 406–419. [Google Scholar] [CrossRef] [PubMed]
  8. Land Title and Survey Authority. Road Safety Strategy 2010; A Consultation Document; National Road Safety Committee, Land Transport Safety Authority LTSA: Wellington, New Zealand, 2000.
  9. Gibbs, M.; Zein, S.R.; Nabors, D.; McGee, H.W.; Eccles, K.A. Road Safety Audits: Case Studies (No. FHWA-SA-06-017); Office of Safety, Federal Highway Administration: Washington, DC, USA, 2006.
  10. Erwin, T.C. Safety Effects of Preventative Maintenace: Microsurfacing: A Case Study. Master’s Thesis, University of Waterloo, Waterloo, ON, Canada, 2007. [Google Scholar]
  11. Gibbs, M.; Zein, S.R.; Nabors, D. Tribal Road Safety Audits: Case Studies (No. FHWA-SA-08-005); Office of Safety, Federal Highway Administration: Washington, DC, USA, 2008.
  12. Sun, L.L.; Liu, D.; Chen, T.; He, M.T. Road traffic safety: An analysis of the cross-effects of economic, road and population factors. Chin. J. Traumatol. 2019, 22, 290–295. [Google Scholar] [CrossRef]
  13. Papadimitriou, E.; Yannis, G.; Muhlrad, N.; Gitelman, V.; Butler, I.; Dupont, E. Analysis of Road Safety Management in the European Countries; DaCoTA: Loughborough, UK, 2012. [Google Scholar]
  14. Holló, P.; Eksler, V.; Zukowska, J. Road safety performance indicators and their explanatory value: A critical view based on the experience of Central European countries. Saf. Sci. 2010, 48, 1142–1150. [Google Scholar] [CrossRef]
  15. Ahmed, M.; Garvin, M. Review of critical success factors and key performance indicators in performance assessment of P3 transportation projects. J. Manag. Eng. 2022, 38, 04022045. [Google Scholar] [CrossRef]
  16. Wegman, F. Sharing Responsibility: Central and Local Government Partnership; ETSC Best in Europe Conference: Brussels, Belgium, 2000. [Google Scholar]
  17. Stolzer, A.J.; Halford, C.D.; Goglia, J.J. (Eds.) Implementing Safety Management Systems in Aviation; Ashgate Publishing, Ltd.: Farnham, UK, 2011. [Google Scholar]
  18. Hollnagel, E. Safety-I and Safety-II: The Past and Future of Safety Management; CRC Press: Boca Raton, FL, USA, 2018. [Google Scholar]
  19. Poister, T.H. The Future of strategic planning in the public sector: Linking strategic management and performance. Public Adm. Rev. 2010, 70, s246–s254. [Google Scholar] [CrossRef]
  20. Hutchison, B.; Glazier, R. Ontario’s primary care reforms have transformed the local care landscape, but a plan is needed for ongoing improvement. Health Aff. 2013, 32, 695–703. [Google Scholar] [CrossRef]
  21. Wilhite, D.A.; Sivakumar, M.V.; Pulwarty, R. Managing drought risk in a changing climate: The role of national drought policy. Weather Clim. Extrem. 2014, 3, 4–13. [Google Scholar] [CrossRef]
  22. Unlu, A.; Kapucu, N.; Sahin, B. Disaster and crisis management in Turkey: A need for a unified crisis management system. Disaster Prev. Manag. Int. J. 2010, 19, 155–174. [Google Scholar] [CrossRef]
  23. Lockwood, M. Good governance for terrestrial protected areas: A framework, principles and performance outcomes. J. Environ. Manag. 2010, 91, 754–766. [Google Scholar] [CrossRef] [PubMed]
  24. Riccardi, M.R.; Augeri, M.G.; Galante, F.; Mauriello, F.; Nicolosi, V.; Montella, A. Safety Index for evaluation of urban roundabouts. Accid. Anal. Prev. 2022, 178, 106858. [Google Scholar] [CrossRef] [PubMed]
  25. Demasi, F.; Loprencipe, G.; Moretti, L. Road safety analysis of urban roads: Case study of an Italian municipality. Safety 2018, 4, 58. [Google Scholar] [CrossRef]
  26. Chen, F.; Wu, J.; Chen, X.; Wang, J.; Wang, D. Benchmarking road safety performance: Identifying a meaningful reference (best-in-class). Accid. Anal. Prev. 2016, 86, 76–89. [Google Scholar] [CrossRef] [PubMed]
  27. Papadimitriou, E.; Yannis, G. Is road safety management linked to road safety performance? Accid. Anal. Prev. 2013, 59, 593–603. [Google Scholar] [CrossRef] [PubMed]
  28. ITF. Road Safety Annual Report 2022; OECD Publishing: Paris, France, 2022. [Google Scholar]
  29. Amoros, E.; Martin, J.L.; Laumon, B. Comparison of road crashes incidence and severity between some French counties. Accid. Anal. Prev. 2003, 35, 537–547. [Google Scholar] [CrossRef]
  30. Al Haji, G. Towards a Road Safety Development Index (RSDI): Development of an International Index to Measure Road Safety Performance. Doctoral Dissertation, Linköping University, Linköping, Sweden, 2005. [Google Scholar]
  31. Shen, Y.; Hermans, E.; Bax, C.; Wesemann, P.; Gitelman, V.; Goldenbeld, C.; Doveh, E.; Hakkert, S.; Wegman, F.; Aarts, L. Developing a Road Safety Index; DaCoTA: Loughborough, UK, 2013. [Google Scholar]
  32. Bliss, T.; Breen, J. Meeting the management challenges of the Decade of Action for Road Safety. IATSS Res. 2012, 35, 48–55. [Google Scholar] [CrossRef]
  33. Lee, C. Clustering Analysis with Embedding Vectors: An Application to Real Estate Market Delineation. Adv. Technol. Innov. 2012, 7, 30–40. [Google Scholar] [CrossRef]
  34. Chang-Chien, S.-J.; Ali, W.; Yang, M.-S. A Learning-Based EM Clustering for Circular Data with Unknown Number of Clusters. Proc. Eng. Technol. Innov. 2020, 15, 42–51. [Google Scholar] [CrossRef]
  35. Hartigan, J.A.; Wong, M.A. Algorithm AS 136: A K-Means Clustering Algorithm. J. R Stat. Soc. Ser. C Appl. Stat. 1979, 28, 100–108. [Google Scholar] [CrossRef]
  36. Chiang, M.M.T.; Mirkin, B. Intelligent choice of the number of clusters in k-means clustering: An experimental study with different cluster spreads. J. Classif. 2010, 27, 3–40. [Google Scholar] [CrossRef]
Figure 1. RSMS definition diagram.
Figure 1. RSMS definition diagram.
Sustainability 16 00450 g001
Figure 2. Analysis process.
Figure 2. Analysis process.
Sustainability 16 00450 g002
Figure 3. Individual indicators in performance category by metropolitan city and province.
Figure 3. Individual indicators in performance category by metropolitan city and province.
Sustainability 16 00450 g003
Figure 4. Individual indicators in effect category by metropolitan city and province.
Figure 4. Individual indicators in effect category by metropolitan city and province.
Sustainability 16 00450 g004
Figure 5. Individual indicators in improvement category by metropolitan city and province.
Figure 5. Individual indicators in improvement category by metropolitan city and province.
Sustainability 16 00450 g005
Figure 6. Optimal k using the elbow method.
Figure 6. Optimal k using the elbow method.
Sustainability 16 00450 g006
Figure 7. K-means clustering analysis (3-dimensional diagram) based on the characteristics of Indicators (Performance, Effect, Improvement).
Figure 7. K-means clustering analysis (3-dimensional diagram) based on the characteristics of Indicators (Performance, Effect, Improvement).
Sustainability 16 00450 g007
Figure 8. K-means clustering analysis (3-dimensional diagram based on the characteristics of each city and province).
Figure 8. K-means clustering analysis (3-dimensional diagram based on the characteristics of each city and province).
Sustainability 16 00450 g008
Table 1. Example of an index extraction table for each domestic road safety category to select traffic safety indices.
Table 1. Example of an index extraction table for each domestic road safety category to select traffic safety indices.
Evaluation IndicatorSourceMeasuring EntityMeasurement MethodData StabilityData CycleData TimingData FormFactor
Pedestrian crossing stop line compliance rateTraffic safety culture indexKorea Transport Safety AdministrationObservational studySeparate surveyAnnual2021Quantitative sampleVehicle
Rate of turn signal illuminationTraffic safety culture indexKorea Transport Safety AdministrationObservational studySeparate surveyAnnual2021Quantitative sampleVehicle
Traffic signal compliance rateTraffic safety culture indexKorea Transport Safety AdministrationObservational studySeparate surveyAnnual2021Quantitative sampleVehicle
Seatbelt use rateTraffic safety culture indexKorea Transport Safety AdministrationObservational studySeparate surveyAnnual2021Quantitative sampleVehicle
Helmet use rate of two-wheeled vehicle usersTraffic safety culture indexKorea Transport Safety AdministrationObservational studySeparate surveyAnnual2021Quantitative sampleVehicle
Use of mobile devices while drivingTraffic safety culture indexKorea Transport Safety AdministrationQuestionnaire surveySeparate surveyAnnual2021Quantitative sampleHuman
Driving under the influenceTraffic safety culture indexKorea Transport Safety AdministrationQuestionnaire surveySeparate surveyAnnual2021Quantitative sampleHuman
Speed-limit violationTraffic safety culture indexKorea Transport Safety AdministrationQuestionnaire surveySeparate surveyAnnual2021Quantitative sampleHuman
Pedestrian crossing traffic signal compliance rateTraffic safety culture indexKorea Transport Safety AdministrationObservational studySeparate surveyAnnual2021Quantitative sampleHuman
Rate of pedestrians using mobile devices while crossing streetTraffic safety culture indexKorea Transport Safety AdministrationObservational studySeparate surveyAnnual2021Quantitative sampleHuman
JaywalkingTraffic safety culture indexKorea Transport Safety AdministrationQuestionnaire surveySeparate surveyAnnual2021Quantitative sampleHuman
Local governments acquired with traffic safety expertiseTraffic safety culture indexKorea Transport Safety AdministrationLiterature reviewSeparate surveyAnnual2021QualitativeHuman
Table 2. Final evaluation result for road safety indicators.
Table 2. Final evaluation result for road safety indicators.
Main CategoryCategorySubcategoryEvaluation IndicatorNote
PerformanceTraffic systemConstitutions and statutesEnactment and notification of road safety regulations (children’s school routes/pedestrians/vulnerable road users)Individual survey
OrganizationPercentage of road-safety-related personnelPrevious year’s statistical data
Infrastructure➀  Percentage of advanced safety system introduction expensesPrevious year’s statistical data
➁  Percentage of zones prioritizing vulnerable road users per road lengthPrevious year’s statistical data
Road safetyImprovementPercentage of local road safety environment improvement project budgetPrevious year’s statistical data
Enforcement and managementNumber of unmanned traffic enforcement systems installed per road lengthPrevious year’s statistical data
Vehicle safetyImprovementSupport for advanced vehicle safety devicesPrevious year’s statistical data
ManagementSupport for older driver road safety projectsPrevious year’s statistical data
MembersGovernancePerformance of the general coordination body for road safetyIndividual survey
Education➀  Percentage of personnel trained in business vehicle safety managementPrevious year’s statistical data
➁  Percentage of personnel trained in regular road safetyPrevious year’s statistical data
CountermeasuresSafety management level of business vehicles used by local governmentsPrevious year’s statistical data
EffectTarget achievement rateNational road safety indicatorsGoal achievement rate of traffic collision fatalitiesPrevious year’s statistical data
Performance achievementNumber of fatalitiesNumber of fatalities per 100,000 populationPrevious year’s statistical data
Number of injuriesNumber of injuries per 100,000 populationPrevious year’s statistical data
Consolidated indexTraffic safety culture index compliance rate (pedestrian/driving behavior)Previous year’s statistical data
ImprovementYoY improvementImprovement in national road safety indicators➀  Improvement rate in the number of fatalities per 100,000 populationPrevious year’s statistical data
➁  Improvement rate in the number of injuries per 100,000 populationPrevious year’s statistical data
Improvement in performance achievementImprovement rate in traffic safety culture index (pedestrian/driving behavior)Previous year’s statistical data
FeedbackInterventionsEvaluation of exemplary policyIndividual survey (qualitative indicator)
Other effortsOthersOther studies and effortsIndividual survey (qualitative indicator)
Table 3. Table of performance, effect, and improvement indicators by city and province.
Table 3. Table of performance, effect, and improvement indicators by city and province.
City/ProvincePerformanceEffectImprovement
Seoul6.866.806.74
Busan6.955.796.74
Incheon6.367.557.09
Gwangju5.716.636.78
Gyeonggi-do7.779.076.44
Gyeongsangnam-do5.547.205.23
Ulsan3.566.194.23
Sejong3.207.025.50
Chungcheongbuk-do3.025.975.93
Daegu4.995.447.51
Gangwon-do4.855.826.08
Jeollabuk-do4.485.707.18
Jeollanam-do5.304.717.83
Jeju3.834.876.25
Daejeon6.833.516.59
Chungcheongnam-do5.254.284.76
Gyeongsangbuk-do4.593.126.06
Table 4. Cluster analysis results based on the features of each city and province.
Table 4. Cluster analysis results based on the features of each city and province.
City/ProvinceCluster NumberPopulationBudgetRoad Area
Seoul09,509,4586,003,8838359
Busan03,350,3802,093,8153416
Incheon02,948,3751,409,3213317
Gwangju01,441,611904,7841879
Gyeonggi-do013,565,4505,175,48014,813
Gyeongsangnam-do03,314,1831,126,50513,645
Ulsan11,121,592347,3152544
Sejong1371,89590,471423
Chungcheongbuk-do11,597,427664,6336915
Daegu22,385,4121,208,5363015
Gangwon-do21,538,492805,7559857
Jeollabuk-do21,786,855723,5818568
Jeollanam-do21,832,803914,44810,776
Jeju2676,759456,5513217
Daejeon31,452,251615,4452226
Chungcheongnam-do32,119,257871,3397588
Gyeongsangbuk-do32,626,6091,126,50513,645
Table 5. The sum and ratio by features based on clustering.
Table 5. The sum and ratio by features based on clustering.
ClassificationPopulationBudgetRoad Area
TotalProportionTotalProportionTotalProportion
Cluster 134,129,45766.09%16,713,78868.11%45,42939.78%
Cluster 23,090,9145.99%1,102,4194.49%98828.65%
Cluster 38,220,32115.92%4,108,87116.74%35,43331.03%
Cluster 46,198,11712.00%2,613,28910.65%23,45920.54%
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Song, K.-H.; Kim, K.H.; Choi, S.; Elkosantini, S.; Lee, S.M.; Suh, W. Comprehensive Safety Index for Road Safety Management System. Sustainability 2024, 16, 450. https://0-doi-org.brum.beds.ac.uk/10.3390/su16010450

AMA Style

Song K-H, Kim KH, Choi S, Elkosantini S, Lee SM, Suh W. Comprehensive Safety Index for Road Safety Management System. Sustainability. 2024; 16(1):450. https://0-doi-org.brum.beds.ac.uk/10.3390/su16010450

Chicago/Turabian Style

Song, Ki-Han, Kyung Hyun Kim, Solsaem Choi, Sabeur Elkosantini, Seongkwan Mark Lee, and Wonho Suh. 2024. "Comprehensive Safety Index for Road Safety Management System" Sustainability 16, no. 1: 450. https://0-doi-org.brum.beds.ac.uk/10.3390/su16010450

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop