Next Article in Journal
Using Tolerance Bounds for Estimation of Characteristic Fatigue Curves for Composites with Confidence
Next Article in Special Issue
Understanding Factors Underlying Fatigue among Collegiate Aviation Pilots in the United States
Previous Article in Journal
Older Driver Safety: A Renewed Perspective in a Survey Study in Illinois, U.S.
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Study on Single Pilot Resource Management Using Integral Fuzzy Analytical Hierarchy Process

1
Department of Air Transportation and Logistics, Hanseo University, Taean-gun 32158, Korea
2
Department of Logistics and Operations Management, G. Brint Ryan College of Business, University of North Texas, Denton, TX 76203-5017, USA
*
Author to whom correspondence should be addressed.
Submission received: 9 October 2021 / Revised: 29 November 2021 / Accepted: 15 December 2021 / Published: 18 December 2021
(This article belongs to the Special Issue Aviation Safety 2021)

Abstract

:
This research aims to help develop aviation safety policies for the general aviation industry, especially for flight training schools. The analytical hierarchy process (AHP), fuzzy AHP, and fuzzy integral methods were used to find variables that impact aviation safety for training pilots in Korea and the United States using survey participants’ experience and perceptions. The results represent the circumstances of aviation safety in the real world where single pilot resource management, especially situational awareness, is crucial. The authors find that integral fuzzy AHP provides more explicit considerations, making up for the ambiguity of the linguistic responses caused by the AHP and fuzzy AHP.

1. Introduction

Pilots who work in complex environments are routinely exposed to high amounts of situational stress in the workplace, inducing pilot error, which may result in a threat to flight safety [1]. This phenomenon places the more significant risk on the flight crew and passengers of an airplane because it increases the chance of pilot mishaps [2]. Fatigue is pervasive among pilots because of irregular working hours, long-haul flights, circadian disruption, and insufficient sleep [3]. Various reasons and factors are indirectly connected to aviation accidents and incidents that seriously threaten aviation safety [4]. Research on the human error framework, human factors analysis and classification systems (HFACS) [5], the SHELL model—software, hardware, environment, liveware, and central liveware [3,6,7]—crew resource management (CRM) [8], and other areas has been developed to reduce and eliminate aviation accidents and incidents caused by human errors.
These human errors have been emphasized only in multi-crew environments under the concept of CRM [9]. While CRM is aimed at pilots operating in multi-pilot environments, the CRM concepts have been utilized for single pilot resource management (SRM) [10,11]. SRM focuses on a single pilot’s operations, eliminating the emphasis on the role of the team in pilot training [12]. SRM consists of all the resources available to pilots before and during a flight to enhance the safety and efficiency of single pilot operations [11,13]. A structured approach to SRM helps pilots learn to gather information, analyze it, and make sound decisions for safe flying [13]. Pilots, dispatchers, maintenance personnel, and safety-related personnel should receive CRM/SRM training on an initial and recurrent basis.
However, SRM has not been highlighted as an area of academic research or has focused only on the five Ps (plan, plane, pilot, passengers, and programming). Hence, this current study focuses on the integration of SRM with broader concepts, including not only the five Ps, but aeronautical decision making (ADM), risk management (RM), situational awareness (SA), automation management (AM), and task management (TM). Decision-making circumstances involve the need to evaluate a finite number of possible choices (alternatives) based on a finite number of attributes (criteria). In selecting a proper aviation safety management system from many alternatives, it is important to remember that those alternatives should consistently provide safety to the people who are continuously working on options for delivering optimal aeronautical safety. The question, therefore, is how to evaluate the alternatives for risk management adequately and to solve hazard issues that continuously occur in the field between people, such as pilots, air traffic controllers, and mechanics, and the aircraft in the air or on the ground. It becomes imperative to build a decision support system for aviation safety or risk that can be visible, direct, convenient, and, of course, interact with the decision makers [14,15,16,17].
Making crucial decisions about aviation safety in the aeronautical fields is an everyday activity for all who work with aircraft [10]. Researchers spend lots of time dealing with how and when to act in a decision-making process, which affects the best courses of action before, during, and after a safe flight [18,19,20]. Choosing the best decision or set of interrelated decisions for reducing and eliminating aviation accidents is an essential task for those who are concerned about flight safety. This current study reviewed a broad range of academic literature. The authors held interviews with student pilots, flight instructors, air traffic controllers, and mechanics who have practical experience in and opinions regarding actual general aviation. The fuzzy AHP of λ measure is a special case of fuzzy measures defined iteratively, and is applied to analyze the objective importance of SRM categories and variables. The rest of this paper is organized as follows. Section 2 reviews the related literature for SRM and the categories/variables to support SRM. Section 3 discusses the research methodology. Section 4 presents the methodology and data analysis. Section 5 discusses the results and implementation. Section 6 concludes the study, discusses policy implications, and outlines future research.

2. Literature Review

A single pilot operating in general aviation has one of the most demanding civil aviation tasks [21]. Major accidents caused in general aviation are due to poor judgment and decision making and inadequate pre-flight and in-flight planning [13,22,23]. General aviation accident and incident rates far exceed those of the airlines, as do the numbers of people killed or injured and total accidents [22,24,25,26]. In an attempt to address human error accidents, CRM was developed as a program to train pilot teams in the effective use of non-technical skills [27]. The introduction of a form of CRM training into general aviation could optimize the single pilot’s decision-making processes to increase flight safety and improve flight operation efficiency [24]. SRM focuses on single pilot operations, which eliminates the team-oriented training of CRM [28].
Single pilot resource management (SRM) is all about helping pilots learn how to gather information, analyze it, and make decisions [10]. Although the flight is coordinated by a single person and not an onboard flight crew, the use of available resources, such as autopilot and air traffic control (ATC) and automated flight service stations (AFSS), replicates the principles of CRM [20]. The SRM technique involves managing all onboard and outside resources available to a cockpit crew before and during a flight to secure a safe and successful result [10]. Integrating SRM into a general aviation (GA) pilot training program is a vital step toward aviation safety. A structured approach to SRM helps pilots learn to congregate crucial information, examine the information, and make sound decisions during the flight [20].
SRM can be applied using the five-P approach: plan, plane, pilot, passengers, and programming [20]. The plan includes the basic elements of cross-country planning: weather, route, fuel, and current publications, among others [13]. The plan also includes all the events surrounding the flight and allows the pilot to accomplish the mission. The pilot should review and update the plan at regular intervals during the flight, bearing in mind that any of the factors in the original plan can change at any time [29]. The plane includes the airframe, systems, and equipment, including avionics. The pilot should be proficient in the use of all installed equipment and familiar with the aircraft/equipment’s performance characteristics and limitations [30]. As the flight proceeds, the pilot should monitor the aircraft’s systems and instruments in order to detect any abnormal indications at the earliest opportunity [29]. A pilot identifies and mitigates physiological errors at all steps of the flight [20].
The passengers can be of considerable help to the pilot by accomplishing tasks, such as those listed earlier. However, passengers can create plausibly dangerous distractions. If the passenger is a pilot, it is also essential to establish who is doing what. The five-P approach reminds the pilot-in-command to consider and account for these factors [20,31]. Programming can refer to both panel-mounted and handheld instruments. The advanced electronic instrument shows how moving map navigators and autopilots can reduce pilot workload and improve pilots’ situational awareness [30]. However, the task of programming or operating both installed and handheld equipment (e.g., tablets) can create a serious distraction from other flight duties. This part of the five-P approach reminds the pilot to mitigate this risk by having a thorough understanding of the equipment long before takeoff and by planning when and where the programming for approaches, route changes, and airport information gathering should be accomplished, as well as times it should not be attempted [20,30]. SRM should be used consistently, and solid skills can significantly enhance flight safety [20].
Situational awareness (SA) is the precise perception [4] and understanding of the entire array of resources within the four risk elements that influence safety before, during, and after the flight [20], with internal and external resources found in and out of the aircraft cockpit [10]. All the skills involved in decision making apply to maintaining situational awareness. Keeping up situational awareness requires the use of all flight-related skills and understanding their impact on the safety of flights, as well as using checklists, air traffic controllers, and automated flight service stations [10]. Fatigue, stress, and work overload can reduce the overall situational awareness of the pilot [20].
A literature search for aeronautical decision making (ADM) yields references, definitions, and other relevant information about ADM training in the general aviation environment [10,20]. ADM is a systematic perspective on risk and stress management. Understanding ADM also explains how personal attitudes can impact decision making and helps pilots to adapt those attitudes to improve safety in the flight deck [19]. It is essential to see the factors that cause human beings to make decisions and how the decision-making process works and can be improved [20]. Regardless of the technological developments that enhance flight safety, one important thing remains the same: the human factor, which produces errors [20]. ADM includes three P variables—“perceive” from the given set of conditions for the flight, “process” by evaluating the influence of these conditions on flight safety, and “perform” by acting out the best course of action during a flight [10].
Risk management (RM) includes the PAVE variables—P for the pilot’s general health, physical, mental, and emotional state, as well as their proficiency and currency; A for aircraft airworthiness, equipment, and performance capability; V for environment weather hazards, terrain, airports, runways to be used, and conditions; and E for external pressures, such as meetings, people waiting at their destination, et cetera [10]. Pilots perceive hazards by using PAVE to process information and decide whether the identified situation constitutes a risk that should be eliminated, and perform by acting to evaluate the outcome of the hazards [10].
Controlled flight into terrain (CFIT) is when an airworthy aircraft is unintentionally flown into the ground, a mountain, a body of water, or an obstacle under pilot control [32]. In a typical CFIT scenario, the crew is unconscious of the near disaster until too late. CFIT is a significant cause of accidents, causing over 9000 fatalities since the early commercial jet age [33] (Boeing, 2020). Despite the success of advanced technologies, such as the ground proximity warning system (GPWS), enhanced ground proximity warning system (EGPWS), and ground collision avoidance system, at reducing CFIT accidents in the commercial airline industry [32], general aviation aircraft are still not well equipped with this advanced technology.
Automation management (AM) requires a thorough comprehension of how the autopilot system interrelates with the other systems [29]. When flying with advanced avionics, the pilot must know how to control the course deviation indicator (CDI), the navigation source, and the autopilot. Furthermore, a pilot needs to know the peculiarities of the particular automated system being used in the cockpit.
Task management (TM), a significant factor for in-flight safety, is the process by which pilots manage the many concurrent tasks that must be performed to safely and efficiently fly a modern aircraft [20]. A task is a function performed by a human being, as opposed to one performed by a machine (e.g., setting the target heading in the autopilot), and the flight deck is an environment in which potentially many important tasks compete for pilots’ attention at any given time [20]. Task management determines which of perhaps many concurrent tasks the pilot(s) attend to at any particular point in time [20]. TM, specifically, requires monitoring continuous tasks to prioritize their status. The prioritization of tasks is established based on their importance, status, and urgency, the allocation of human and machine resources to high-priority tasks, the interruption and subsequent resumption of lower priority tasks, and the termination of completed or no longer relevant tasks [20]. Effective workload management is achieved by planning, prioritizing, and sequencing tasks to avoid work overload [20]. As experience is gained, a pilot recognizes future workload requirements and prepares for high workload periods during periods of low workload [20].

3. Discussion

Multiple criteria decision making (MCDM) or multiple criteria decision analysis (MCDA) is a research method for evaluating multiple conflicting criteria in decision making both in daily life and in other settings, such as business, government, and medicine [34]. MCDM and MCDA are also known as collaborative decision making when individuals collectively make a choice from the alternatives before them [35].
MCDM and MCDA can include the analytic hierarchy process (AHP), multi-attribute value theory, and multi-attribute utility theory. Each of these methods has its own characteristics that can be adapted adequately to data analysis. Among these methods, the AHP has more merits than the others when structuring and measuring. The AHP is a structured approach for examining complex decisions [36]. The AHP helps decision makers find the best solutions for their goal of solving the problem [37]. It gives a comprehensive and rational framework for structuring a decision problem, quantifying its elements, relating them to overall goals, and evaluating alternatives [37]. The AHP has a hierarchical decision goal with the alternatives and the criteria for evaluating the alternatives, establishes priorities based on pairwise comparisons of the elements, yields a set of overall priorities for the hierarchy, and checks the judgments’ consistency [38].
A hierarchy is a stratified system of ranking and organizing people, things, and ideas, where each element of the system, except for the top one, is subordinate to one or more other elements. Though the concept of a hierarchy is easily grasped intuitively, it can also be described mathematically [39]. Diagrams of hierarchies are often shaped roughly like pyramids, but other than having a single element at the top, there is nothing necessarily pyramid shaped about a hierarchy (see Figure 1). The fundamental nine-point Likert scales of pairwise comparisons are applied [38].
Weighting means conducting a pairwise comparison that indicates the relative importance of or preference for evaluation items. As a process of arranging the pairwise comparison values for each problem and calculating the weights for the problem from this, the pairwise comparison matrix A(aij) is drawn up, and the eigenvalue λ m a x of the matrix is calculated. That is, if λ involves multiplying an n × n square matrix [ A ] by an n × 1 weight matrix [ W ] , the new n × 1 vector matrix [ Y ] can be acquired, as [ A ] × [ W ] = [ Y ] .
λ m a x is calculated by using components Y 1 Y n and weights W 1 W n of [ Y ] , as ( Y 1 W 1 + Y 2 W 2 + Y 3 W 3 +   Y n W n ) / n = λ m a x .
To survey if there is a logical consistency in the value of the preference index, the consistency ratio (CR) should be tested. The method of calculating a CR is to start from the consistency index (CI). The CI is based on the idea that evaluators would make a consistent judgment in the pairwise comparison, as the eigenvalue λ max of the matrix moves closer to the size n of the matrix. CI is defined as CI = ( λ m a x n ) ( n 1 ) . Next, the CR is calculated by dividing the CI by the random index (RI), as C R = C I R I , where the RI can calculate the consistency index after drawing up the reciprocal matrix by extracting the integers from one to nine.
The main problems with AHP are the ambiguity and uncertainty arising from the subjectivity of the respondent individual and the problem of inaccuracy caused by the limitations of the expression method; that is, the limit of mathematical theory can distort the results of the AHP and the subsequent decision-making process [40,41]. Therefore, a methodology that can model what systematically gives rise to ambiguity and uncertainty in the decision-making process is required [42,43]. Problems of vagueness and fuzziness have probably always been present in human decision making [44,45]. A fuzzy method is a concept in which the application boundaries vary according to context or conditions instead of being fixed once [46]. The study of fuzzy concepts and language characteristics is called fuzzy semantics [47,48,49].
Fuzzy AHP is a methodology applied to handle ambiguity and uncertainty effectively [50]. Fuzzy AHP is a systematic approach to an alternative selection and justification problem that uses the concepts of fuzzy set theory and hierarchical structure analysis [51]. It can specify preferences in the form of linguistic or numerical values that are related to the importance of each performance attribute [35]. In the fuzzy AHP method, the pairwise comparisons in the judgment matrix are conducted using fuzzy mathematics and fuzzy aggregation operators [52]. This process enables us to calculate a sequence of weight vectors that can be used to select the main attributes. Decision makers may sometimes not be able to specify preferences between two factors using the nine-point-scaled pairwise comparison [35]. In this current study, we incorporate the traditional AHP to form a “new” fuzzy AHP to address the ambiguous judgments made by the experts during the data collection process [50]. Fuzzy AHP has more advantages than the AHP method, such as deriving pairwise comparison results by using fuzzy numbers, calculating fuzzy triangular numbers by using attributes, and making comparisons between fuzzy triangular numbers and the weights for evaluating group decision-making methods [53]. Let X be a universe of discourse, C be a class of subsets of X, and E, F ∈ C. A function g: C → R where g ( ) = 0 and E     F g ( E )     g ( F ) is called a fuzzy measure. A fuzzy measure is called normalized or regular if g(X) = 1 [54,55].
Fuzzy measures are defined on a semi-ring of sets or a monotone class, which may be as granular as the power set of X, and even in discrete cases, the number of variables can be as large as 2|X|. A symmetric fuzzy measure is defined uniquely by |X| values. Two important fuzzy measures that can be used are the Sugeno or λ-fuzzy measure and k-additive measures, introduced by Sugeno [56] and Grabisch [57]. The Sugeno λ-measure is a particular case of fuzzy measures defined iteratively. Let X = {x1, …, xn} be a finite set and let λ ∈ (−1, +∞). A Sugeno λ-measure is a function of g: 2X → [0, 1], such that g(X) = 1; A, B ⊆X (alternatively, A, B ∈ 2x) with A ∩ B = 0, then g(A ∪ B) = g(A) + g(B) + λ g(A) g(B). As a convention, the value of g in a singleton set is called a density and is denoted by gi = g({xi}). Moreover, let X be a finite set, X = {x1, …, xn} and g(X) be the class of all subsets of X, and thus the fuzzy measure g(X) = g = {x1, …, xn} can be formulated as λ + 1 = i = 1 n ( 1 + λ g i )   [58,59].
For calculating λ with absolute importance for the revision of AHP, we use Formula (1):
i = 1 m ( 1 + λ W i j ) 1 λ = 0   ( j = 1 , , n )
where i is a category and j are variables under each category. The λ is less than zero and the relation is gλ(A ∪ B) < gλ(A) + gλ(B). As each element interactively includes the influence of others, the individual sum of the influence of each element would be larger than that of each elements’ importance. For fuzzy AHP, parameter C is multiplied by the relative importance of AHP; C is the parameter of the fuzzy measure and is attained by the applied boundary condition of Sugeno’s λ fuzzy measure [56]. Thus, we obtain C using Formula (2):
i = 1 m ( 1 + λ W i j C ) 1 λ = 0   ( j = 1 , , n )

4. Materials and Methods

The questionnaires consist of three parts. The first part contains questions to obtain the respondents’ demographic data, such as survey area, status, flight time, nationality, gender, age, and purpose of being a pilot. The second part has the pairwise comparisons made between elements at each level. Pairwise comparisons consist of matrices where first is the main criteria, and then the sub-criteria. Pairwise comparisons were obtained by using the relative importance scale. The respondents were informed about the questionnaire before they answered the questions. The third part of the questionnaire is used to acquire the data for the absolute importance by using the scale from 1 to 7.
The factors for the pairwise comparison of AHP’s relative importance that were calculated are composed of categories and sub-categories. SRM as a meta-category has six categories—aeronautical decision making (ADM), risk management (RM), task management (TM), situational awareness (SA), controlled flight into terrain (CFIT) awareness, and automation management (AM). Each category has its own variables (see Figure 2). The ADM category contains the three P variables—perceive, process, and perform. The RM category includes the PAVE variables—the pilot, aircraft, environment, and external pressure.
The situational awareness category has two variables regarding maintaining the pilot’s situational awareness inside the aircraft (the status of the aircraft systems, the pilot, and passengers) and outside the aircraft (awareness of where the aircraft is in relation to the terrain, traffic, weather, and airspace). CFIT, which is attributed to a majority of CFIT accidents, is measured as 1—weather, 2—unknown environment, 3—abnormal procedures, 4—loss or breakdown of communication, 5—loss of situational awareness, 6—absence of perception of hazards, and 7—absence of sound risk management techniques [60]. The automation management category that is used in the ADM model includes (1) what to expect, relating to the peculiarities of the particular automated system being used, (2) how to monitor for proper operations, and (3) how to take appropriate action if the system does not function as expected [19,20,29]. Task management, which means effective workload management to ensure essential operations, is used in the ADM model and has three factors: (1) planning tasks, (2) prioritizing tasks, and (3) sequencing tasks [19,20].
This research survey was performed from 1 August 2018 to 30 July 2019, both in Korea and in the United States. We distributed 400 questionnaires in Korea and the U.S., received 173 responses (43.3%), and considered a valid sample 162 (40.5%). Approximately 63.6% of valid respondents are from Korean pilot training institutions, and 36.4% are from American pilot training institutions located in: Stockton, California; Phoenix, Arizona; and Las Vegas, Nevada. Among them, 48.8% are flight instructors, 19.8% are instrument rating holders, 16% are airline transport pilot license holders (ATP), and 15.4% are commercial rating holders (see Table 1).
Most of the respondents (95.1%) are men, while women are only 4.9%. The majority of the respondents’ nationality is Korean (90.1%), and 9.9% are American. Approximately 31.9% of the respondents have flight times of less than 250 h, 16.7% have between 251 and 500 h, 24.7% have between 501 and 1000 h, 11.1% have between 1001 and 2000 h, and 16% have between 2001 and 28,000 h. The percentage of respondents between 21 and 25 years old is 21.6%, between 26 and 29 years old is 23.5%, between 30 and 35 years old is 28.4%, between 36 and 40 years old is 10.5%, and between 41 and 63 years old is 16.0%.

5. Results of the Hypotheses Analysis

Based on Section 2 and Section 3, we utilized six categories of SRM and 22 variables for six categories that influence the pilot’s behavior. To measure the relative and absolute importance through pairwise comparisons among categories and variables, AHP and fuzzy AHP techniques were employed. Based on the AHP and fuzzy AHP, we applied an integral fuzzy AHP (Sugeno integral) for the fuzzy measure to obtain a more objective ranking for evaluating the imprecise and vague situations [56,61]. We gathered expert opinions from flight instructors and students in the flight academies in Korea (103 respondents) and the U.S. (59 respondents). We calculated the relative importance of applying pairwise comparisons by the respondents in the context of SRM, which constitutes the evaluation items of ADM, RM, SA, CFIT, AM, and TM. According to [38], the consistency ratio of participants’ responses should be considered in the pairwise comparison, which is usually regarded as a reliable response when the consistency ratio is within 0.10.
In this current study, the respondents’ consistency ratio was examined, and we calculated a consistency ratio of 0.03, which could be used for the weighted analysis of each category. To calculate the weights, a normalization process was performed to adjust the sum of all weights to one. This allowed us to identify the relative size of individual items within the same hierarchy. The categories were weighted in the same way for both categories and variables. Considering the categories and variables, comprehensive priority was given to the 22 final evaluation variables for SRM (see Table 2).
To calculate the absolute importance of the fuzzy scale from 7 to 1, we applied a measuring scale as shown in Table 3. The mean value for absolute importance was calculated using an assessment scale (1 to 7) of the questionnaire, which was marked up by each respondent. The absolute importance analysis for SRM categories and variables using the fuzzy scale with Table 3 is calculated and presented in Table 4.
As noted previously, we applied integral fuzzy AHP using λ and C for the absolute importance of the category and variables. We could obtain λ and C using Formulas (1) and (2). Table 5 shows λ and C, multiplying the relative importance and composite importance of all the variables and ranks of each variable for Korea and the U.S. We applied the following formula to obtain a Korea–U.S. combined ranking. V i j k = n for rank 1, n − 1 for rank 2, …, n − 21 for rank 22, where V i j k   rank score for each variable for i = 1, 2 (1 for Korea, 2 for the U.S.). j = 1, …, m categories and k = 1, …, n variables. As for the combined score, we used Formula (3). For the category score, we use Formula (4), where m refers to categories and n refers to variables.
V j k = V 1 j k + V 2 j k
Σ k = 1 n V i j / n   j   ( j = 1 ,   ,   m )  
We applied the integral fuzzy AHP (Table 5) compilation of relative (AHP, see Table 2) and absolute importance (fuzzy AHP, see Table 4) to produce the comprehensive importance of SRM’s categories and variables (see Table 6). Column (1) of Table 6 shows the SRM’s categories and variables. Column (2) provides the ranking of the variables for Korea and the U.S., along with the differences. Ten variables out of 22 were not found to be different between Korea and the U.S. Most of the variables (18) show differences within ±3. Therefore, the authors do not consider the safety culture, which affects members’ attitudes and behavior concerning an organization’s safety performance [62], between Korea and the U.S. to be different. Furthermore, 90.1% of respondents are Korean even at American pilot training schools. Column (3) provides the rank score, combined scores (Korea and the U.S.) based on the ranks in Column (2) using Formula (3), and the ranks of the variables. Column (4) gives the categories’ score and rank using Formula (4).
Based on the data presented in Table 6, the most crucial variable is “Inside the aircraft”. The next important variable is “Outside the aircraft”. The results show that situational awareness is the most important category that reflects the circumstances of aviation safety in the real world where SRM is applied [9,10,20]. A pilot is expected to examine each situation considering their level of experience, personal minimums, readiness level in terms of current physical and mental conditions, and make their own decision [29]. Poor decision making is the root cause of many—if not most—aviation accidents [29].
On the other hand, good decision making is about avoiding the circumstances that lead to really tough choices. Most pilots have made similar mistakes despite the advanced avionics of their aircraft, which could increase safety with enhanced situational awareness. The errors were prevented before a mishap due to extra margins, sound warning systems, a sharp co-pilot, or just good luck [20]. The single pilot should develop and use situational awareness to avoid information overload.
Aeronautical decision making (ADM) is the next important category with its three P variables—perceive, process, and perform. ADM is an organized framework for risk assessment [19], aiding the decision-making process to improve flight safety [20]. Among the three Ps, the order of importance is as follows: perceive, process, and perform. Using the three Ps, a pilot continuously evaluates every aeronautical decision to recognize and minimize potential threats [10].
Risk management (RM) includes the PAVE variables—pilot, aircraft, environment, and external pressure [10]. The three Ps of ADM and PAVE of RM could be combined [10] to enhance situational awareness [20], and could also be integrated with CARE (consequences, alternatives, reality, and external pressure) and the TEAM (transfer, eliminate, accept, and mitigate) checklist [10]. CARE consists of reviewing hazards and evaluating risks. TEAM involves choosing and implementing controls [10].
Task management (TM) is a crucial component of in-flight safety, where pilots manage multiple tasks that must be carried out safely and efficiently [20]. We find that among the variables of TM, the order of importance is (1) planning, (2) prioritizing, and (3) sequencing tasks. Task management is all about prioritizing and identifying tasks that can be completed before, during, and after a flight to ensure efficient operations without task overload [62].
Controlled flight into terrain (CFIT) is where aircrafts are flown into terrains in a controlled manner, regardless of the crew’s situational awareness [32]. Three accident categories account for more than 60% of worldwide fatalities [32,33]. Of these three categories, CFIT is identified as being responsible for nearly one-quarter of all worldwide fatalities, despite representing only 3% of the number of accidents [32,63]. Among the CFIT variables, the respondents perceive that the loss of situational awareness is the most important. The FAA’s [63] recommendation for CFIT avoidance is to maintain situational awareness using the five Ps before leaving cruising altitude.
Automation management (AM) is vital for a pilot to use avionics effectively [64]. Automation is an essential advancement in aviation technologies [10]. More pilots now rely on automated flight planning tools rather than traditional flights [10]. Our survey findings show that it is up to the pilot to clarify the expectation of the advanced automation system and maintain proficiency in all tasks.

6. Conclusions

This research consists of interviews with student pilots and flight instructors in Korea and the U.S. (Stockton, California; Las Vegas, Nevada; and Phoenix, Arizona). About 400 pilots were selected, and data were collected from questionnaires. Among them, 162 cases were used for analysis for this study. The AHP, fuzzy AHP, and integral fuzzy AHP were applied and analyzed. For the research model, six categories and 22 variables were chosen from the literature review and applied in this study. The importance index of SRM’s categories and variables was obtained using AHP and fuzzy AHP through a pairwise comparison with fuzzy scale, fuzzy measure, and fuzzy integral, applying λ and parameter C.
This current study provides some explanations and provisions for aviation safety through single pilot resource management. Because there are not many previous works about SRM, it is difficult to determine the devices that give sincere aid to find reasons for various accidents and incidents, which resulted in some difficulties for this research. SRM is a form of CRM training in general aviation that could optimize the single pilot’s decision-making processes to increase flight safety and improve flight operation efficiency [24]. The findings from this research indicate that SRM can be shared across decision makers in the general aviation industry and its processes should be considered as safety measures or devices for reducing and eliminating accidents and incidents, both on the ground and in the air.
Among the six SRM categories, we find that situational awareness (SA) is the most important category, followed by the aeronautical decision making (ADM). The pilot’s situational awareness should begin before the aircraft leaves the ground because the pilot needs to anticipate what will happen in the future and examine risks and contingencies [9,65]. Among the CFIT variables, the loss of situational awareness is considered the most crucial. Situational awareness is how well a pilot (RM) assesses the situation appropriately inside and outside the aircraft (RM) and achieves safe and efficient flight safety. Although we attempted to find the importance of SRM’s categories and variables to see how training pilots and instructors perceive it, all of the SRM-related categories and variables are significant to make flying safer. Aeronautical decision making consists of the three P variables—perceive, process, and perform. The findings from this current study show how pilots perceive potential threats, process each situation, and perform tasks with his or her own decision-making process to minimize the threats along with planning and prioritizing tasks.
For future research, the sample could be enlarged within groups working in the various aeronautical fields and conducted within a different cultural context in terms of region, nation, and organization.

Author Contributions

Conceptualization, K.H.I. and W.K.; methodology, K.H.I. and S.-J.H.; software, K.H.I.; validation, S.-J.H. and W.K.; formal analysis, K.H.I.; investigation, S.-J.H.; resources, K.H.I. and S.-J.H.; data curation, K.H.I. and S.-J.H.; writing—original draft preparation, K.H.I.; writing—review and editing, S.-J.H.; visualization, S.-J.H.; supervision, W.K.; project administration, W.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board of Hanseo University.

Informed Consent Statement

All study participants provided informed written consent prior to survey enrollment.

Data Availability Statement

Data available on request due to restrictions of privacy.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Salas, E.; Shawn Burk, C.; Bowers, C.A.; Wilson, K.A. Team Training in the Skies: Does Crew Resource Management (CRM) Training Work? Hum. Factors 2001, 43, 641–674. [Google Scholar] [CrossRef] [PubMed]
  2. Reason, J. Human Error; Cambridge University Press: Cambridge, UK, 1990. [Google Scholar]
  3. ICAO. Human Factors Digest No. 7-Investigation of Human Factors in Accidents and Incidents; ICAO: Montreal, QC, Canada, 1993. [Google Scholar]
  4. Chen, J.-C.; Yu, V.F. Relationship between Human Error Intervention Strategies and Unsafe Acts: The Role of Strategy Implementability. J. Air Transp. Manag. 2018, 69, 112–122. [Google Scholar] [CrossRef]
  5. Wiegmann, D.A.; Shappell, S.A. A Human Error Approach to Aviation Accident Analysis: The Human Factors Analysis and Classification System; Ashgate Publishing Ltd.: Surrey, UK, 2003. [Google Scholar]
  6. Hawkins, F.H. Human Factors in Flight; Ashgate Publishing: Surrey, UK, 1987. [Google Scholar]
  7. Hong, S.-J.; Lee, K.S.; Seol, E.S.; Young, S. Safety Perceptions of Training Pilots Based on Training Institution and Experience. J. Air Transp. Manag. 2016, 55, 213–221. [Google Scholar] [CrossRef]
  8. Helmreich, R.L.; Merritt, A.C.; Wilhelm, J.A. The Evolution of Crew Resource Management Training in Commercial Aviation. Int. J. Aviat. Psychol. 1999, 9, 19–32. [Google Scholar] [CrossRef]
  9. Adams, M.R. Situational Awareness and Decision Making as It Relates to Single Pilot Resource Management; SAFE Library: Daytona Beach, FL, USA, 2009. [Google Scholar]
  10. FAA. Risk Management Handbook; DOT: Washington, DC, USA, 2009. [Google Scholar]
  11. National Business Aviation Association [NBAA]. NBAA Training Guidelines: Single Pilot Operations of Very Light Jets and Technically Advanced Aircraft. 2020. Available online: https://nbaa.org/wp-content/uploads/aircraft-operations/safety/vlj-training-guidelines/vlj-training-guidelines.pdf (accessed on 11 December 2020).
  12. Kearns, S. The Effective of Guided Mental Practice in a Computer Based Single Pilot Resource Management (SRM) Training. Ph.D. Thesis, Capella University, Minneapolis, MN, USA, 2007. [Google Scholar]
  13. FAA. Single Pilot Crew Resource Management; FAA Safety Briefing: Washington, DC, USA, 2015. [Google Scholar]
  14. Hong, S.-J. The Introduction of Knowledge Management Technique in Aviation Safety Management. Korean J. Aerosp. Environ. Med. 2003, 13, 91–98. [Google Scholar]
  15. Hong, S.-J.; Kim, Y. Modeling the Aviation Safety Risk Management. J. Korean Soc. Transp. 2006, 24, 19–28. [Google Scholar]
  16. Kim, Y.; Hong, S.-J.; Ahn, H. A Scheme of Crisis Management for National Aviation Safety. J. Korean Soc. Transp. 2005, 23, 27–34. [Google Scholar]
  17. Lee, W.-K. Risk Assessment Modeling in Aviation Safety Management. J. Air Transp. Manag. 2006, 12, 267–273. [Google Scholar] [CrossRef]
  18. FAA. Helicopter Flying Handbook; DOT: Washington, DC, USA, 2012. [Google Scholar]
  19. FAA. Instrument Flying Handbook; DOT: Washington, DC, USA, 2012. [Google Scholar]
  20. FAA. Pilot’s Handbook of Aeronautical Knowledge; DOT: Washington, DC, USA, 2016. [Google Scholar]
  21. Ritchie, M.L. General Aviation. In Human Factors in Aviation; Wiener, E.L., Nagel, D.C., Eds.; Academic Press: London, UK, 1988. [Google Scholar]
  22. Bureau of Air Safety Investigation [BASI]. Human Factors in Fatal Aircraft Accidents; BASI: Canberra, Australia, 1996. [Google Scholar]
  23. Trollip, S.R.; Jensen, R.S. Human Factors for General Aviation; Jeppesen Sanderson: Englewood, NJ, USA, 1991. [Google Scholar]
  24. Freedman, D.; Nendick, M. Crew Resource Management in General Aviation for Single-Pilot Operations. In Aviation Resource Management; Hayward, B.J., Lowe, A.R., Eds.; Ashgate Publishing: Surrey, UK, 1999. [Google Scholar]
  25. Bureau of Transportation Statistics [BTS]. U.S. General Aviation Safety Data. 2020. Available online: https://www.bts.gov/content/us-general-aviationa-safety-data (accessed on 22 December 2020).
  26. Bureau of Transportation Statistics [BTS]. U.S. Air Carrier Safety Data. 2020. Available online: https://www.bts.gov/content/us-air-carrier-safety-data (accessed on 22 December 2020).
  27. Flin, R.; O’Conner, P.; Mearns, K. Crew Resource Management: Improving Team Work in High Reliability Industries. Team Perform. Manag. 2002, 8, 68–78. [Google Scholar] [CrossRef] [Green Version]
  28. Kearns, S. Online Single-Pilot Resource Management: Assessing the Feasibility of Computer-Based Safety Training. Int. J. Aviat. Psychol. 2011, 21, 175–190. [Google Scholar] [CrossRef]
  29. FAA. Advanced Avionics Handbook; DOT: Washington, DC, USA, 2009. [Google Scholar]
  30. Hoffmann, T. Say Ahh...: A Pilot’s Guide to Self-Assessing Risk. FAA Saf. Brief. 2017, Jan/Feb, 12–15. [Google Scholar]
  31. FAA. Crew Resource Management Training; DOT: Washington, DC, USA, 2004. [Google Scholar]
  32. ICAO. State of Global Aviation Safety; ICAO: Montreal, QC, Canada, 2019. [Google Scholar]
  33. Boeing. Statistical Summary of Commercial Jet Airplane Accidents: Worldwide Operations 1959–2019; Boeing: Seattle, WA, USA, 2020. [Google Scholar]
  34. Forman, E.H.; Gass, S.I. The Analytical Hierarchy Process: An Exposition. Oper. Res. 2001, 49, 469–487. [Google Scholar] [CrossRef]
  35. Güngör, Z.; Serhadhoglu, G.; Kesen, S.E. A Fuzzy AHP Approach to Personnel Selection Problem. Appl. Soft Comput. 2009, 9, 641–646. [Google Scholar] [CrossRef]
  36. Saaty, T.L.; Peniwati, K. Group Decision Making: Drawing Out and Reconciling Differences; RWS Publications: Pittsburgh, PA, USA, 2008. [Google Scholar]
  37. Madurika, H.; Hemakumara, G. GIS Based Analysis for Suitability Location Finding in the Residential Development Areas of Greater Matara Region. Int. J. Sci. Technol. Res. 2015, 4, 96–105. [Google Scholar]
  38. Saaty, T.L. Decision Making for Leaders: The Analytic Hierarchy Process for Decisions in a Complex World; RWS Publications: Pittsburgh, PA, USA, 2008. [Google Scholar]
  39. Saaty, T.L. Mathematical Principles of Decision Making; RWS Publications: Pittsburgh, PA, USA, 2010. [Google Scholar]
  40. Dyer, J.S. Remarks on the Analytic Hierarchy Process. Manag. Sci. 1990, 36, 249–258. [Google Scholar] [CrossRef]
  41. Mikhalevic, M.V. Remarks on the Dyer-Saaty Controversy. Cybern. Syst. Anal. 1994, 30, 75–79. [Google Scholar] [CrossRef]
  42. Dyer, J.S. A Clarification of Remarks on the Analytic Hierarchy Process. Manag. Sci. 1990, 36, 274–275. [Google Scholar] [CrossRef] [Green Version]
  43. Harker, P.T.; Vargas, L.G. Reply to Remarks on the Analytic Hierarchy Process. Manag. Sci. 1993, 36, 269–273. [Google Scholar] [CrossRef] [Green Version]
  44. Christiaanse, E. 1.5 Million Years of Information Systems. In The Past and Future of Information Systems: 1976–2006 and Beyond; Avison, D., Elliot, S., Krogstie, J., Pries-Heje, J., Eds.; Springer: Boston, MA, USA, 2006. [Google Scholar]
  45. Gaines, B.R. Living in an Uncertain Universe. In On Fuzziness; Seising, R., Trillas, E., Moraga, C., Termini, S., Eds.; Springer: Berlin/Heidelberg, Germany, 2013. [Google Scholar]
  46. Haack, S. Deviant Logic, Fuzzy Logic: Beyond the Formalism; University of Chicago Press: Chicago, USA, 1996. [Google Scholar]
  47. Mohan, C. An Introduction to Fuzzy Set Theory and Fuzzy Logic, 2nd ed.; Viva books: New Delhi, India, 2019. [Google Scholar]
  48. Williamson, T. Vagueness; Routledge: London, UK, 1994. [Google Scholar]
  49. Zadeh, L.A. Quantitative Fuzzy Semantics. Inf. Sci. 1971, 3, 159–176. [Google Scholar] [CrossRef]
  50. Chang, D.Y. Application of the Extent Analysis Method on Fuzzy AHP. Eur. J. Oper. Res. 1996, 95, 649–655. [Google Scholar] [CrossRef]
  51. Bozbura, F.; Beakese, A.; Kahraman, C. Prioritization of Human Capital Measurement Indicators using Fuzzy AHP. Expert Syst. Appl. 2007, 32, 1100–1112. [Google Scholar] [CrossRef]
  52. Pöyhönen, M.A.; Hämäläinen, R.P.; Salo, A.A. An Experiment on the Numerical Modelling of Verbal Ratio Statements. J. Multi-Criteria Decis. Anal. 1997, 6, 1–10. [Google Scholar] [CrossRef]
  53. Peniwati, K. Criteria for Evaluating Group Decision-Making Methods. Math. Comput. Model. 2007, 46, 935–947. [Google Scholar] [CrossRef]
  54. Liu, Y.; Eckert, C.M.; Earl, C. A review of fuzzy AHP methods for decision-making with subjective judgements. Expert Syst. Appl. 2020, 161, 113738. [Google Scholar] [CrossRef]
  55. Wang, Y.-M.; Luo, Y.; Hua, Z. On the extent analysis method for fuzzy AHP and its applications. Eur. J. Oper. Res. 2008, 186, 735–747. [Google Scholar] [CrossRef]
  56. Sugeno, M. Theory of Fuzzy Integrals and Its Applications. Doctoral Thesis, Tokyo Institute of Technology, Tokyo, Japan, 1974. [Google Scholar]
  57. Grabisch, M. K-Order Additive Discrete Fuzzy Measures and Their Representation. Fuzzy Sets Syst. 1997, 92, 167–189. [Google Scholar] [CrossRef]
  58. Tahani, H.; Keller, J.M. Information Fusion in Computer Vision Using the Fuzzy Integral. IEEE Trans. Syst. Man Cybernetics 1990, 20, 733–741. [Google Scholar] [CrossRef]
  59. Leszczyński, K.; Penczek, P.; Grochulski, W. Sugeno’s fuzzy measure and fuzzy clustering. Fuzzy Sets Syst. 1985, 15, 147–158. [Google Scholar] [CrossRef]
  60. FAA. General Aviation Controlled Flight into Terrain Awareness; (AC 61-134); DOT: Washington, DC, USA, 2003. [Google Scholar]
  61. Pani, A.K.; Mohanta, H.K. Online Monitoring of Cement Clinker Quality Using Multivariate Statistics and Takagi-Sugeno Fuzzy-Inference Technique. Control. Eng. Pract. 2016, 57, 1–17. [Google Scholar] [CrossRef]
  62. Cooper, M.D. Towards a Model of Safety Culture. Saf. Sci. 2000, 36, 111–136. [Google Scholar] [CrossRef]
  63. FAA. FAA Inspectors and FAAST Managers Training: Module 3 Single-Pilot Resource Management; DOT: Washington, DC, USA, 2009. [Google Scholar]
  64. IATA. Safety Report 2019; IATA: Montreal, QC, Canada, 2020. [Google Scholar]
  65. Hong, S.-J. Aviation Risk Management; SKK: Seoul, Korea, 2009. [Google Scholar]
Figure 1. Analytical Hierarchy Structure.
Figure 1. Analytical Hierarchy Structure.
Safety 07 00084 g001
Figure 2. Research Model: CRM and SRM’s Hierarchical Structure.
Figure 2. Research Model: CRM and SRM’s Hierarchical Structure.
Safety 07 00084 g002
Table 1. Samples of Respondents.
Table 1. Samples of Respondents.
CountryAreaCurrent Status of RespondentsTotal
Flight InstructorCommercial RatingInstrument RatingATP
Korea
(103, 63.6%)
Hanseo Univ.2128-31
Chodang Univ.8194-31
Cheonju Univ.9-6217
ATP, Pusan---2424
U.S.A.
(59, 36.4%)
Stockton, CA10414-28
Phoenix, AZ20---20
Las Vegas, NV11---11
Total79 (48.8%)25 (15.%)32 (19.8%)26 (16.0%)162 (100%)
Table 2. Relative Importance of SRM Category and Variables using AHP.
Table 2. Relative Importance of SRM Category and Variables using AHP.
CategoryRelative ImportanceVariablesRelative ImportanceConsistency Ratio
KoreaU.S.KoreaU.S.KoreaU.S.
ADM0.1830.273Perceive0.4300.5490.0000.004
Process0.2710.247
Perform0.2990.203
RM
(PAVE (1))
0.2110.180Pilot0.4500.4950.0020.005
Aircraft0.2730.259
Environment0.1750.157
External pressure0.1030.089
SA0.2790.315Inside the aircraft0.6300.5170.0000.000
Outside the aircraft0.3700.483
CFIT0.1800.089Weather0.1220.1620.0030.002
Unknown environment0.1190.129
Abnormal procedures0.1080.083
Loss or breakdown of communication0.1030.063
Loss of situational awareness0.2810.323
Absence of perception of hazards0.1810.163
Absence of risk management techniques0.0860.077
AM0.0520.046What to expect0.3450.4050.0000.003
How to monitor0.2990.304
How to promptly take action0.3560.291
TM0.0950.096Planning tasks0.4480.4900.0000.002
Prioritizing tasks0.3750.344
Sequencing tasks0.1780.165
CR (2)0.0020.006-----
Note: (1) PAVE (pilot, aircraft, environment, and external Pressure); (2) consistency ratio (CR): combined overall.
Table 3. Measuring Scale for Modifying Relative Importance of AHP.
Table 3. Measuring Scale for Modifying Relative Importance of AHP.
Score PointScaleRemarks
77: 0.90 6: 0.75 5: 0.60 4: 0.50 3: 0.40 2: 0.30 1: 0.15CFIT
66: 0.90 5: 0.75 4: 0.60 3: 0.45 2: 0.30 1: 0.15SRM
55: 0.90 4: 0.70 3: 0.50 2: 0.30 1: 0.10-
44: 0.90 3: 0.70 2: 0.50 1: 0.30RM
33: 0.90 2: 0.60 1: 0.30ADM, AM, TM
22: 0.9 1: 0.45SA
Table 4. Relative Importance of SRM Category and Variables Using Fuzzy AHP.
Table 4. Relative Importance of SRM Category and Variables Using Fuzzy AHP.
CategoryRelative ImportanceVariablesRelative Importance
KoreaU.S.KoreaU.S.
ADM0.5710.638Perceive0.7620.768
Process0.5710.595
Perform0.5270.437
RM (PAVE)0.6750.662Pilot0.8320.853
Aircraft0.6510.646
Environment0.5290.561
External pressure0.3850.341
SA0.5480.557Inside the aircraft0.7340.694
Outside the aircraft0.6120.656
CFIT0.4760.453Weather0.5280.544
Unknown environment0.5030.490
Abnormal procedures0.4150.485
Loss or breakdown of communication0.5050.594
Loss of situational awareness0.5350.503
Absence of perception of hazards0.5280.508
Absence of risk management techniques0.5600.476
AM0.3680.249What to expect0.6320.671
How to monitor0.6910.564
How to promptly take action0.5770.564
TM0.5840.651Planning tasks0.7630.742
Prioritizing tasks0.6120.631
Sequencing tasks0.4250.427
Table 5. Composite Importance of SRM Category and Variables using Integral Fuzzy AHP.
Table 5. Composite Importance of SRM Category and Variables using Integral Fuzzy AHP.
CategoryλCVariablesRelative Importance
KoreaU.S.KoreaU.S.KoreaU.S.
ADM−0.931−0.9211.8611.676Perceive0.1570.245
Process0.0990.110
Perform0.1090.091
RM (PAVE)−0.980−0.9822.2122.082Pilot0.1560.174
Aircraft0.0950.091
Environment0.0610.055
External pressure0.0360.031
SA−0.770−0.7693.9684.026Inside the aircraft0.9890.517
Outside the aircraft0.5810.483
CFIT−0.993−0.9932.8062.920Weather0.0390.048
Unknown environment0.0380.039
Abnormal procedures0.0340.025
Loss or breakdown of communication0.0330.019
Loss of situational awareness0.0890.096
Absence of perception of hazards0.0570.049
Absence of risk management techniques0.0270.023
AM−0.937−0.9061.9181.789What to expect0.0300.035
How to monitor0.0260.026
How to promptly take action0.0310.025
TM−0.921−0.9191.5511.738Planning tasks0.0920.070
Prioritizing tasks0.0770.049
Sequencing tasks0.0360.024
Table 6. Combined (Korea and U.S.) Variables and Category Ranks using Integral Fuzzy AHP.
Table 6. Combined (Korea and U.S.) Variables and Category Ranks using Integral Fuzzy AHP.
(1)(2)(3)(4)
CategoryVariablesRankRank ScoreCategory
KoreaU.S.Diff. (1)KoreaU.S.Com. (2)RankScore (3)Rank
ADM   ( V 1 ) Perceive   ( V 11 )3302020403362
Process   ( V 12 )65+11718355
Perform   ( V 13 )58−31815336
RM   ( V 2 ) [PAVE] Pilot   ( V 21 )4401919384273
Aircraft   ( V 22 )7701616327
Environment   ( V 23 )1110+112132510
External   pressure   ( V 24 )16160771415
SA   ( V 3 ) Inside   the   aircraft   ( V 31 )1102222441431
Outside   the   aircraft   ( V 32 )2202121422
CFIT   ( V 4 ) Weather   ( V 41 )1313010102013165
Unknown   environment   ( V 42 )14140991814
Abnormal   procedures   ( V 43 )1719−2641017
Loss   or   breakdown   of   communication   ( V 44 )1822−451620
Loss   of   situational   awareness   ( V 45 )96+31417318
Absence   of   perception   of   hazards   ( V 46 )1212011112212
Absence   of   risk   management   techniques   ( V 47 )2121022421
AM   ( V 5 )What to expect ( V 51 )2015+538111696
How   to   monitor   ( V 52 )2217+516719
How   to   promptly   take   action   ( V 53 )1918+145918
TM   ( V 6 ) Planning   tasks   ( V 61 )89−11514299224
Prioritizing   tasks   ( V 62 )1011−113122510
Sequencing   tasks   ( V 63 )1520−5831116
(1) Diff. (difference): (rank of Korea–rank of the U.S.); (2) Com. (combined score) = rank score of Korea + rank score of U.S.; (3)  Σ k = 1 n   V j k / n   for ∀j (j = 1, …, m), where m is categories and n is variables.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Im, K.H.; Kim, W.; Hong, S.-J. A Study on Single Pilot Resource Management Using Integral Fuzzy Analytical Hierarchy Process. Safety 2021, 7, 84. https://0-doi-org.brum.beds.ac.uk/10.3390/safety7040084

AMA Style

Im KH, Kim W, Hong S-J. A Study on Single Pilot Resource Management Using Integral Fuzzy Analytical Hierarchy Process. Safety. 2021; 7(4):84. https://0-doi-org.brum.beds.ac.uk/10.3390/safety7040084

Chicago/Turabian Style

Im, Kwang Hyun, Woongyi Kim, and Seock-Jin Hong. 2021. "A Study on Single Pilot Resource Management Using Integral Fuzzy Analytical Hierarchy Process" Safety 7, no. 4: 84. https://0-doi-org.brum.beds.ac.uk/10.3390/safety7040084

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop