Next Article in Journal
A Novel Stochastic Two-Stage DEA Model for Evaluating Industrial Production and Waste Gas Treatment Systems
Previous Article in Journal
Countryside within the City: A Motivating Vision behind Civic Green Area Stewardship in Warsaw, Poland
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Selecting a Public Service Outsourcer Based on the Improved ELECTRE II Method with Unknown Weight Information under a Double Hierarchy Hesitant Linguistic Environment

School of Management Science and Engineering, Shandong University of Finance and Economics, Jinan 250014, China
*
Author to whom correspondence should be addressed.
Sustainability 2020, 12(6), 2315; https://0-doi-org.brum.beds.ac.uk/10.3390/su12062315
Submission received: 10 February 2020 / Revised: 9 March 2020 / Accepted: 10 March 2020 / Published: 16 March 2020
(This article belongs to the Section Economic and Business Aspects of Sustainability)

Abstract

:
In present-day society, government public service outsourcing has become an irreversible trend due to the gradually increasing public pursuit of service quality and efficiency. To better meet the needs of the public and effectively improve the quality of service, it has been a crucial issue for government departments to choose the most desirable one from a series of public service outsourcers (PSOs) with distinct characteristics. In this paper, to deal with such decision problems, we propose the improved elimination and choice translating reality (ELECTRE) II method with unknown weight information under the double hierarchy hesitant fuzzy linguistic (DHHFL) environment to accurately and effectively select the best PSO. Firstly, aiming at the shortcomings of the original comparison method for double hierarchy hesitant fuzzy linguistic elements (DHHFLEs), we define the hesitant deviation degree (HDD) for DHHFLEs and, based on this, further propose a new comparison method for comparing DHHFLEs more reasonably. Secondly, inspired by the classical power average (PA) operator proposed by Yager, a new method is introduced to determine the weights of experts with respect to each attribute, based on the support degree between attributes. Afterwards, an improved ELECTRE II method is proposed to address the problem of PSO selection. A numerical case about e-government outsourcer selection is given to demonstrate the enforceability of the method. Finally, comparisons between previous methods and our method are carried out to illustrate the effectiveness and strengths of the proposed method.

1. Introduction

Over the last two decades, to alleviate business pressure and focus on core competencies, firms are increasingly utilizing not only their own technologies, but also external resources and technologies [1,2,3,4], which is referred as open innovation (OI). Later, the OI phenomenon rapidly spread into many industries, and has received more and more attention [5,6,7,8]. As a form of OI, outsourcing has become a key component for business performance and has quickly expanded into the field of public services. Government public service outsourcing aims to enlist private organizations into the public service sector through a competitive market mechanism to compensate for government failures, reduce administrative costs, and improve service quality and efficiency. At the same time, considering that the contractors, who belong to the public sector and are the users of public services, can better understand the demands of the public, the government public service outsourcing can also build harmonious relationships among the government, the PSOs, and the public through the intermediary of the supplier. That is, by outsourcing public services to the service suppliers, the government can enhance both the economic effectiveness and the public satisfaction in line with the service target.
Driven by friendly policies, public service outsourcing has been rapidly promoted, and has gradually expanded from basic service areas, such as public infrastructure and solid waste management [9], to high-level public service areas, such as online IT service [10], energy supply [11], medical care [12], and social security [13]. As outsourced contractors, private organizations have the obligation to produce high-quality and efficient public services. The internal management level, scale, experience, and service capability of the contractor can directly determine the quality of public services, select the most efficient contractors, and standardize the contractors. When purchasing services and selecting the most appropriate service providers, the key to guaranteeing the quality of public services is to screen and inspect the service capabilities of contractors.
Regarding different service outsourcing providers as alternatives and their performances as criteria, respectively, the public service outsourcer (PSO) selection issue can then be identified as a typical multi-criteria decision-making (MCDM) problem [14]. The first and most basic step to solving the multi-attribute decision-making problem is to gather the assessment information given by the decision makers (DMs) about the alternatives with respect to the criteria. Due to the variability of environments and the complexity of people’s cognition, uncertainty has become one of the characteristics of the decision-making field. In addition, as the selection of PSOs involves qualitative criteria, such as user experience and reliability, it is difficult for DMs to express evaluation information with accurate real numbers. Therefore, reasonably describing the expression of uncertain information has caused extensive concern from researchers. In this case, the fuzzy set [15] arose at the historic moment and has been continuously extended to different forms, such as type-2 fuzzy sets [16], intuitionistic fuzzy sets [17], and hesitant fuzzy sets [18]. Compared with precise values, quantitative linguistic information can more accurately depict the complicacy and fuzziness in the evaluation process. For instance, when assessing the user experience of a service provider, qualitative descriptions like “good” and “perfect” are commonly used rather than crisp numbers. From this perspective, various different linguistic representation models have been proposed to express the evaluation information of DMs, such as hesitant fuzzy linguistic term sets (HFLTSs) [19], the 2-tuple linguistic mode [20], and probability linguistic term sets [21].
Although various linguistic representation models have been applied to outsourcer selection, the abovementioned linguistic models cannot exactly depict the evaluation information given by experts, such as “between a little bad and very bad” and “between entirely moderate and a little good”. Therefore, to better describe such linguistic evaluation information, based on the concept of HFLTSs, Gou et al. [22] further introduced the definition of double hierarchy hesitant linguistic term sets (DHHLTSs), which are made up of two hierarchy linguistic term sets (LTSs) in which the internal hierarchy LTS is used to make a further description or elaborate explanation for every LT contained in the external hierarchy LTS. DHHFLTSs are pretty useful tools in managing situations where DMs deliberate between several complex LTs when presenting their views on alternatives in the course of decision-making; this has become a project of widespread concern to researchers. Recently, Gou et al. [23] presented a number of distance and similarity measures of double hierarchy hesitant fuzzy linguistic (DHHFL) elements (DHHFLEs) and investigated a method for tackling the MCDM problems based on these measures. Taking the interactive features among criteria and the incomplete preference information into consideration, Liu et al. [24] developed a DHHFL mathematical programming means to handle the multi-attribute group decision-making problems. Gou et al. [25] proposed a consensus-reaching process for large-scale group decision making, in which the preference relations are described in the form of DHHFLEs. Krishankumar [26] constructed a novel decision framework in the context of DHHFLTS and proposed a new hybrid aggregation operator to aggregate the expert’s preference under the DHHFL environment.
The MCDM method plays an important role in MCDM and directly affects the accuracy and rationality of decision-making results. A great number of scholars have meticulously conducted in-depth research on outsourcer selection from this perspective; many classical decision-making methods and their extensions were applied to tackle the problem of outsourcer selection [27,28,29,30]. Among the methods applied to the problem of outsourcer selection, the elimination and choice translating reality (ELECTRE) method is a representative outranking method, originally proposed by Benayoun et al. [31], which has a distinct advantage in tackling the issue with non-compensatory criteria. After being meticulously probed and extended by a range of specialists, the method further evolved into the ELECTRE family, including ELECTRE I, ELECTRE II, ELECTRE III, and so on. Among them, the ELECTRE I method is suitable for constructing a partial prioritization and for choosing a set of promising alternatives [32], the ELECTRE III method aims to distribute each potential alternative into one of the categories in a previously defined family [33]. Compared with them, the ELECTRE II method [34] is a more pragmatic approach for handling the problem of ranking alternatives from the best to the worst [35,36], which is more suitable for selecting the outsourcer in practical applications. In recent years, the ELECTRE II method has attracted wide attention from academia and has been extended into various forms under different fuzzy environments [37,38,39,40]. For example, Wan et al. [41] proposed the interval 2-tuple linguistic ELECTRE II to handle situations with non-compensatory criteria. Liao et al. [42] introduced two distinct ELECTRE II methods to deal with MCDM problems in line with the hesitant fuzzy linguistic terms set. Additionally, Lin et al. [43] investigated a new ELECTRE II method under the probabilistic linguistic environment. Nevertheless, the ELECTRE II method has not been extended to the DHHFL environment.
Based on the above literature review and analysis, we found the gaps in and insufficiency of the existing research. This paper is devoted to revising the comparison rule of DHHFLEs, extending the ELECTRE II method to the DHHFL environment, and further proposing a new ELECTRE II method combined with a novel weight-determination method. We implement our research through the following three points:
  • Considering the hesitation and complexity of experts’ cognition in the problem of outsourcer selection, the DHHFLTS is introduced to express the evaluation information of experts for a given service provider. In addition, we found that the existing comparison method for DHHFLEs may provide erroneous results of comparisons in some cases. Hence, we proposed the concept of a hesitant deviation degree for DHHFLEs and developed a new comparison method for DHHFLEs based on this.
  • Inspired by the power average (PA) operator, we defined the support degree of the DHHFLEs and proposed a new weight determination method to determine the expert’s weight for each criterion based on this, which can not only weaken the influence of extreme values on the results, but also reflects the expert’s authority for each criterion.
  • The classical ELECTRE II method is extended to the DHHFL environment and then an improved ELECTRE II method is proposed, which has a distinct advantage in tackling issues with non-compensatory criteria, in order to select the most desirable PSOs. In this method, the proposed comparison method for DHHFLEs is used to identify the magnitude relationship between two alternatives under each criterion.
The rest of the article is organized as follows: Section 2 firstly reviews the corresponding concepts of the DHHFLTS and introduces the theoretical basis of the ELECTRE methods. Section 3 defines the concept of the hesitant deviation degree and further proposes a new comparison approach for DHHFLEs. Section 4 develops a new weight-determination method for experts with respect to each criterion and constructs a novel DHHFL–ELECTRE II method based on the new weight-determination method and the comparison method. Section 5 applies the novel ELECTRE II to pick out the e-government outsourcing provider. Section 6 carries out a comparative analysis to illustrate the effectiveness and strengths of our proposed method. Finally, Section 7 comes to a conclusion for this paper and indicates interesting directions for the following research work.

2. Preliminaries

To enhance the readability of this paper, the main symbols involved in the following formulas are summarized in Table 1.

2.1. DHHFLTS

DHHFLTS, initially presented by Gou et al. [22], consists of two nested hierarchies of LTSs. The LTS of the outer hierarchy is given to convey the rough evaluation in the form of an adjective, like “moderate”, “perfect”, and “terrible”. The inner-hierarchy LTS generally appeals in adverbs, such as “a little bit”, “much”, and so forth, which aim at describing the extent of the corresponding linguistic term (LT) in the outer hierarchy. In other words, the inner hierarchy can be regarded as a supplemental decoration to the outer. These two complementary hierarchies are expressed by two distinct LTSs with symmetric linguistic subscripts: S f = { ζ t | t = ε , , 1 , 0 , 1 , , ε } and ϕ s = { δ κ | κ = ι , , 1 , 0 , 1 , , ι } , in which ε and ι act as the scales of these two LTSs, respectively, and ε , ι N * .
In view of the aforementioned theory, S ϕ = { ζ t < δ k > | t = ε , , 1 , 0 , 1 , , ε ; κ = ι , , 1 , 0 , 1 , , ι } is defined as the double hierarchy linguistic term set (DHLTS), in which δ κ stands for the homologous LT in the inner hierarchy, while the outer-hierarchy LT is denoted by ζ t . Accordingly, the intuitive mathematical expression of DHHFLTS can be given as:
H S ϕ = { < χ i , h S ϕ ( χ i ) > | χ i X } ,
where h S ϕ ( χ i ) is composed of several possible elements in S ϕ , which can be expressed as h S ϕ ( χ i ) = { ζ t δ < δ k δ > | ζ t δ < δ k δ > S ϕ ,   δ = 1 , 2 , , Δ h S ϕ } with Δ h S ϕ being the amount of elements in h S ϕ ( χ i ) . For the sake of convenience, ζ t < δ k > is termed as the double hierarchy linguistic element (DHLE) and h S ϕ ( χ i ) is called the DHHFL element (DHHFLE). Considering that when the LT in the outer hierarchy is positive, the evaluation tends to be more positive as the degree of decorative adverbs deepens; when the LT in the outer hierarchy is negative, the evaluation tends to be more negative as the degree of decorative adverbs deepens. On the other hand, for LTs at both ends, only one-sided decorative adverbs are valid. Therefore, the inner-hierarchy LTS may be distinct under different LTs in the outer hierarchy: When t 0 , the degree of the elements contained in the outer-hierarchy LTS should be deepened with the increase of the subscript. On the contrary, when t 0 , as the subscript increases, the degree of the LTs contained in the outer-hierarchy LTS should be weakened. Hereinafter, suppose that both hierarchy LTSs are balanced, which means that semantic differences between any two adjacent LTs are equal. Considering the valence of linguistic terms, i.e., the emotional direction of linguistic terms, Figure 1 is given by Gou et al. [22] to elaborate the abovementioned four distinct shapes of the inner-hierarchy LTS in the case of ι = ε = 3 .
To simplify the calculation, DHLEs and real numbers can be converted into each other through the following function introduced by Gou et al. [22].
ρ : [ ε , ε ] × [ ι , ι ] [ 0 , 1 ] , ρ ( ζ t m < φ k m > ) = { 1 ε × κ m + ι 2 ι + ε + t m 1 2 ε = κ m + ( t m + ε ) ι 2 ε ι = γ m ,   i f   ε + 1 t m ε 1 . 1 2 ε × κ m + ι ι + ε + t m 1 2 ε = κ m + ( t m + ε ) ι 2 ε ι = γ m ,   i f   t m = ε . 1 2 ε × κ m ι = κ m 2 ε ι = γ m ,   i f   t m = ε .
ρ 1 : [ 0 , 1 ] [ ε , ε ] × [ ι , ι ] , ρ 1 ( γ m ) = { ζ < δ ι ( ) > ,      i f   1 < ε ; ζ 0 < δ ι ( ) > ,       i f   1 < 1 ; ζ 1 + < δ ι ( 1 ) > ,    i f   ε < 1 .
where = 2 ε γ m ε , is a round-down function that will returns the largest integer no more than the parameter. ζ t m < φ k m > and γ m represent the m-th elements in the DHHFLE and the hesitant fuzzy number, respectively. Obviously, since the last two formulas are special cases of the first one in Equation (2), it can be simplified to the following function:
ρ : [ ε , ε ] × [ ι , ι ] [ 0 , 1 ] , ρ ( ζ t m < φ k m > ) = 1 ε × κ m + ι 2 ι + ε + t m 1 2 ε = κ m + ( t m + ε ) ι 2 ε ι = γ m .
Gou et al. [22] extended the above conversion functions into a hesitant environment and presented the following conversion functions between the DHHFLEs and the hesitant fuzzy information, respectively.
I ( h S ϕ = { ζ t m < δ κ m > | ζ t m < δ κ m > S ϕ ; t = [ ε , ε ] ;   κ = [ ι , ι ] ; m = 1 ,   2 ,   ,   Δ h S ϕ } )      = { γ m | γ m = ρ ( t m , κ m ) } = h γ ,
I 1 ( h γ ) = I 1 ( { γ m | γ m [ 0 , 1 ] ; m = 1 , 2 , , Δ h γ } ) = { ζ t m < δ κ m > | t m < δ κ m > = ρ 1 ( γ m ) } = h S ϕ .
Given any two DHHFLEs h S ϕ 1 = { ζ 1 t m < δ κ m > | ζ 1 t m < δ κ m > S ϕ ; t = [ ε , ε ] ;   κ = [ ι , ι ] ; m = 1 , 2 , , Δ h S ϕ 1 } and h S ϕ 2 = { ζ 2 t q < δ κ q > | ζ 2 t q < δ κ q > S ϕ ; t = [ ε , ε ] ;   κ = [ ι , ι ] ; q = 1 , 2 , , Δ h S ϕ 2 } , the essential operations are given as:
a .   Addition :   h S ϕ 1 h S ϕ 2 = I 1 ( τ 1 I ( h S ϕ 1 ) , τ 2 I ( h S ϕ 2 ) { τ 1 + τ 2 τ 1 τ 2 } ) ,
b . Mutiplication :   h S ϕ 1 h S ϕ 2 = I 1 ( τ 1 I ( h S ϕ 1 ) , τ 2 I ( h S ϕ 2 ) { τ 1 τ 2 } ) ,
c .   N - mutiplication :   ψ h S ϕ 1 = I 1 ( τ I ( h S ϕ 1 ) { 1 ( 1 τ ) ψ } ) ,
d .   Power :   h S ϕ 1 ψ = I 1 ( τ I ( h S ϕ 1 ) { τ ψ } ) ,
e .   Inverse :   ( h S ϕ 1 ) c = I 1 ( τ I ( h S ϕ 1 ) { 1 τ } ) .
The distance measure involved in fuzzy evaluation information is a crucial concept in decision theory, and it can be exploited to reflect the inconsistency degree between two distinct information numbers. Given two DHHFLEs h S ϕ 1 and h S ϕ 2 , the Hamming distance between them, defined by Gou et al. [23], is found as below:
h d ( h S ϕ 1 , h S ϕ 2 ) = 1 Δ h     m = 1 u m = ρ ( ζ 1 t m < δ κ m > ) υ m = ρ ( ζ 2 t m < δ κ m > ) Δ h | u m υ m | ,
where Δ h is the number of elements in h S ϕ 1 and h S ϕ 2 (here suppose Δ h S ϕ 1 = Δ h S ϕ 2 = Δ h ), ζ 1 t m < δ κ m > and ζ 2 t m < δ κ m > indicate the m - th optimal values in h S ϕ 1 and h S ϕ 2 .
Remark 1.
Considering that the number of DHLEs is not always the same, Gou et al. [23] proposed a method to expand the shorter DHHFLE by adding a double hierarchy LTS to it until Δ h S ϕ 1 = Δ h S ϕ 2 : Given a DHHFLE h S ϕ = { ζ t m < δ κ m > | ζ t m < δ κ m > S ϕ ; t = [ ε , ε ] ;   κ = [ ι , ι ] ; m = 1 , 2 , , Δ h S ϕ } , with ζ t 1 < δ κ 1 > and ζ t Δ h S ϕ < δ κ Δ h S ϕ > being the minimum and maximum DHLE in it, respectively, then, we can expand h S ϕ with the following DHLE:
ζ t < ϑ κ > = ζ ( 1 ϒ ) t 1 + ϒ × t Δ h S ϕ < δ ( 1 ϒ ) κ 1 + ϒ × κ Δ h S ϕ > ,
where ϒ is an optimized parameter satisfying 0 ϒ 1 , which is used to reflect the risk preference of the DM. The larger the ϒ is, the higher the risk preference of the DM enjoys. In this paper, we assume that the DM is risk neutral, i.e., ϒ = 1 / 2 ; then, the DHLE that we can add to the DHHFLE is ζ t < ϑ κ > = ς t 1 + t Δ h S ϕ 2 < ϑ κ 1 + κ Δ h S ϕ 2 > .

2.2. Main Concepts in ELECTRE Methods

This subsection is devoted to showing two main theoretical supports of the ELECTRE method: The binary outranking relations and the definitions of concordance and discordance.
Definition 1.
[44]. The expression of preferences in the ELECTRE methods depends on a basic binary priority relation, S, which means “at least as good as”. Based on this fundamental relation, four mutually exclusive situations might arise when comparing two alternatives e and f as follows:
  • eSf and not fSe, which means “e is strictly preferred to f ”, i.e., ePf;
  • fSe and not eSf, which means “f is strictly preferred to e ”, i.e., fPe;
  • eSf and fSe, which means “e is indifferent to f ”, i.e., eIf;
  • Neither eSf nor fSe, which means “e and f are not comparable”, i.e., eRf.
Definition 2.
[44]. All of the outranking methods stand by the ideas of concordance and discordance, which indicate, respectively, the augments of supporting and opposing an outranking relation:
  • Concordance: For the given binary outranking relation eSf, concordance refers to the combined power of the criteria in favor of this outranking. To implement eSf, there must be as much of a majority as possible of criteria supporting this inference.
  • Discordance: Discordance reflects the combined power of the criteria against the outranking eSf. Generally, a convictive outranking should be opposed by as few criteria as possible.

3. The New Comparison Method for DHHFLEs

3.1. Existing Comparison Method

To measure the performance of DHHFLEs, Gou et al. [22] provided the definition of the expected value and variance for DHHFLEs as follows:
Given a DHHFLE h S ϕ = { ζ t m < δ κ m > | ζ t m < δ κ m > S ϕ ; t = [ ε , ε ] ;   κ = [ ι , ι ] ; m = 1 , 2 , , Δ h S ϕ } with Δ h S ϕ being the number of elements in h S ϕ , then the mathematical form of its expected value E v ( h S ϕ ) and variance V a ( h S ϕ ) can be given as:
E v ( h S ϕ ) = 1 Δ h S ϕ r = 1 Δ h S ϕ ρ ( ζ t r < δ κ r > ) ,
V a ( h S ϕ ) = 1 Δ h S ϕ r = 1 Δ h S ϕ ( ρ ( ζ t r < δ κ r > ) E v ( h S ϕ ) ) 2 ,
where ρ is the conversion function between the real number and the DHLE.
Based on the functions of the expected value and the variance, Gou et al. [22] proposed a comparison method for any two DHHFLEs, which pointed out that the DHHFLE with lower variance is superior to that with high variance when their expected values are equal. However, this is not always the truth. In the following, an example is given to explain the irrationality of this method.
Example 1.
Given two DHHFLEs h S ϕ 1 = { ζ 1 < δ 2 > , ζ 0 < δ 1 > , ζ 0 , ζ 0 < δ 1 > , ζ 1 < δ 2 > } and h S ϕ 2 = { ζ 1 < δ 2 > , ζ 0 , ζ 1 < δ 2 > } , based on Equations (14) and (15), we can obtain E v ( h S ϕ 1 ) = 0.5 , E v ( h S ϕ 2 ) = 0.5 , V a ( h S ϕ 1 ) = 0.179 and V a ( h S ϕ 2 ) = 0.226 , respectively. According to the comparison method proposed by Gou et al., h S ϕ 1 is superior to h S ϕ 2 on account of E v ( h S ϕ 1 ) = E v ( h S ϕ 2 ) and V a ( h S ϕ 1 ) < V a ( h S ϕ 2 ) . Nonetheless, from a cognitive point of view, under the condition that the expected values of the two DHHFLEs are equal and that the maximum and minimum values of the elements in them are likewise equal, the more elements there are in the DHHFLE, the more hesitant the DM is, and the poorer the performance of the DHHFLE will be. Therefore, on this occasion, the conclusion obtained by Gou et al.’s comparison method is unreasonable.
Obviously, Gou et al. only took expectation and variance into consideration, but ignored the impact of the number of elements in DHHFLE. Therefore, based on the variance, we take the hesitant degree into consideration and put forward the definition of the hesitant-deviation degree (HDD) of a DHHFLE.

3.2. The Improved Comparison Method

Definition 3.
Let h S ϕ = { ζ t m < δ κ m > | ζ t m < δ κ m > S ϕ ; t = [ ε , ε ] ;   κ = [ ι , ι ] ;   m = 1 , 2 , , Δ h S ϕ }  be a DHHFLE, then the HDD of h S ϕ can be expressed by
h σ ( h S ϕ ) = Δ h S ϕ 1 2 ε τ 1 Δ h S ϕ r = 1 Δ h S ϕ ( ρ ( ζ t r < δ κ r > ) E v ( h S ϕ ) ) 2 ,
where Δ h S ϕ is the number of elements in h S ϕ , and ( Δ h S ϕ 1 ) / 2 ε τ is used to reflect the hesitant degree of a DHHFLE. Obviously, the greater the number of elements in h S ϕ , the bigger the hesitant degree is, i.e., the greater the uncertainty is. 1 Δ h S ϕ r = 1 Δ h S ϕ ( ρ ( ζ t r < δ κ r > ) E v ( h S ϕ ) ) 2 denotes the variance function shown in Equation (15), which is used to reflect the deviation degree of a DHHFLE. Obviously, in Equation (16), the hesitant degree and deviation degree of the DHHFLE are simultaneously taken into account, which comprehensively reflects the uncertainty and discreteness of the elements in the DHHFLE. For a DHHFLE, a greater HDD indicates a weaker consistency and instability.
Next, a new comparison method for DHHFLEs is put forward based on Equations (14) and (16).
Definition 4.
Given any two DHHFLEs h S ϕ 1 and h S ϕ 2 , then:
(1)
Suppose E v ( h S ϕ 1 ) > E v ( h S ϕ 2 ) , then h S ϕ 1 is superior to h S ϕ 2 .
(2)
Suppose E v ( h S ϕ 1 ) = E v ( h S ϕ 2 ) , then
  • Suppose h σ ( h S ϕ 1 ) < h σ ( h S ϕ 2 ) , then h S ϕ 1 is superior to h S ϕ 2 ;
  • Suppose h σ ( h S ϕ 1 ) = h σ ( h S ϕ 2 ) , then h S ϕ 1 is indifferent to h S ϕ 2 .
Example 2.
For the two DHHFLEs h S ϕ 1 = { ζ 1 < δ 2 > , ζ 0 < δ 1 > , ζ 0 , ζ 0 < δ 1 > , ζ 1 < δ 2 > } and h S ϕ 2 = { ζ 1 < δ 2 > , ζ 0 , ζ 1 < δ 2 > } mentioned in Example 1, we can obtain that h σ ( h S ϕ 1 ) = 0.039 , h σ ( h S ϕ 2 ) = 0.019 by using Equation (16). For E v ( h S ϕ 1 ) = E v ( h S ϕ 2 ) and h σ ( h S ϕ 1 ) > h σ ( h S ϕ 2 ) , we can draw the accurate conclusion that h S ϕ 2 is superior to h S ϕ 1 on the basis of our proposed comparison method. Apparently, with the hesitant degree taken into consideration, the new comparison is more reasonable and effective than that introduced by Gou et al.

4. The Improved Expected-HDD-ELECTRE II Method

4.1. Problem Characterization

Consider an MCDM that involves m alternatives expressed by Z = { o p 1 , o p 2 , , o p m } , a group of experts denoted by E = { e x 1 , e x 2 , , e x g } , and n attributes expressed as C = { c r 1 , c r 2 , , c r n } . The weight vectors of experts and criteria are completely unknown, owing to the information asymmetry of the real problem. To accurately describe their opinions, the experts take the form of DHHFLE h S ϕ i j to express their evaluations of the i-th option with respect to the criterion j. Then, the decision matrix of the expert e x ϑ is given as follows:
R ( ϑ ) = [ h S ϕ i j ( ϑ ) ] m × n = [ h S ϕ 11 ( ϑ ) h S ϕ 12 ( ϑ ) h S ϕ 1 n ( ϑ ) h S ϕ 21 ( ϑ ) h S ϕ 22 ( ϑ ) h S ϕ 2 n ( ϑ )                h S ϕ m 1 ( ϑ ) h S ϕ m 2 ( ϑ ) h S ϕ m n ( ϑ ) ] , ϑ = 1 , 2 , , g .

4.2. Determining the Expert’s Weight with Respect to Each Attribute

Among the existing weight determination methods, one of the familiar reference values that they rely on is the distance or similarity between assessments and the mean values, which are vulnerable to extreme values and may lead to inaccurate results. In addition, the research fields of experts might be so various that there are some differences in the knowledge, skills, and experiences of each expert. An expert may be an expert in certain attributes, but not in other attributes. Considering these two points, we present a novel approach to determine the expert’s weight regarding each attribute based on the degrees of support to each other. Then the steps are as follows.
Step 1: To facilitate subsequent calculations, we combine all of the decision matrices R ( ϑ ) ( ϑ = 1 , 2 , , g ) provided by each expert and convert them into other matrices regarding each attribute, which can be denoted as shown below.
      e x 1    e x 2         e x g Q ( ξ ) = [ h S ϕ i ξ ( k ) ] m × g = o p 1 o p 2 o p m [ h S ϕ 1 ξ ( 1 ) h S ϕ 1 ξ ( 2 ) h S ϕ 1 ξ ( g ) h S ϕ 2 ξ ( 1 ) h S ϕ 2 ξ ( 2 ) h S ϕ 2 ξ ( g )               h S ϕ m ξ ( 1 ) h S ϕ m ξ ( 2 ) h S ϕ m ξ ( g ) ] , ξ = 1 , 2 , , n
in which the ϑ -column vector in Q ( ξ ) is exactly the duplicate of the ξ -column vector in R ( ϑ ) .
Step 2: Obtain the support degrees of h S ϕ i ξ ( p ) ( p = 1 , 2 , , g ) from h S ϕ i ξ ( q ) ( q = 1 , 2 , , g ; q p ) .
Inspired by the PA operator, the support degrees from h S ϕ i ξ ( q ) to h S ϕ i ξ ( p ) can be defined as follows:
sup ( h S ϕ i ξ ( p ) , h S ϕ i ξ ( q ) ) = 1 d ( h S ϕ i ξ ( p ) , h S ϕ i ξ ( q ) ) .
Obviously, the smaller the distance between h S ϕ i ξ ( q ) and h S ϕ i ξ ( p ) , the greater the support degree from h S ϕ i ξ ( q ) to h S ϕ i ξ ( p ) .
Step 3: Calculate the total support degree T ( h S ϕ i ξ ( p ) ) of h S ϕ i ξ ( p ) ( p = 1 , 2 , , g ) as
T ( h S ϕ i ξ ( p ) ) = q = 1 q p g sup ( h S ϕ i ξ ( p ) , h S ϕ i ξ ( q ) ) , i = 1 , 2 , , m ; ξ = 1 , 2 , , n .
Apparently, a greater T ( h S ϕ i ξ ( p ) ) indicates a better similarity to others. From the compromise point of view, the DM whose evaluation value is close to the evaluation values of other experts, i.e., who enjoys a great total support degree, would have a big weight.
Then, the total support degree matrix can be given as below:
       e x 1       e x 2           e x g T ( ξ ) = [ T ( h S ϕ i ξ ( k ) ) ] m × g = o p 1 o p 2 o p m [ T ( h S ϕ 1 ξ ( 1 ) ) T ( h S ϕ 1 ξ ( 2 ) ) T ( h S ϕ 1 ξ ( g ) ) T ( h S ϕ 2 ξ ( 1 ) ) T ( h S ϕ 2 ξ ( 2 ) ) T ( h S ϕ 2 ξ ( g ) )                         T ( h S ϕ m ξ ( 1 ) ) T ( h S ϕ m ξ ( 2 ) ) T ( h S ϕ m ξ ( g ) ) ] , ξ = 1 , 2 , , n .
Step 4: Taking the sum of elements in each column of the matrix T ( ξ ) , we can obtain the overall support degree of each expert regarding the criterion c r ξ by the following equation.
ƛ ξ ( k ) = i = 1 m T ( h S ϕ i ξ ( k ) ) , k = 1 , 2 , , g ; ξ = 1 , 2 , , n .
Step 5: Obtain each expert’s weight regarding the criterion c r ξ by the following equation.
w ξ ( k ) = ƛ ξ ( k ) t = 1 g ƛ ξ ( t ) , k = 1 , 2 , , g .
Apparently, 0 w ξ ( k ) 1 and k = 1 g w ξ ( k ) = 1 .
In conclusion, the novel weight-determination method for experts has two features or advantages: On one hand, this method, combined with the PA operator, leads to the definition of the total support degree to eliminate the influence of extreme values, which is more rational than other methods based on the average values or ideal solutions. On the other hand, the method aims to build a convergent position: For each expert, the weight may vary with different attributes, and the higher the total support degree from other experts, the greater the weight of this expert under this attribute. In this way, the unreasonable deviation caused by the expert’s knowledge, skills, experience, and other factors can be avoided, and the decision process would be more precise and reasonable.

4.3. Obtaining the Criterion’s Weight Based on the Optimization Model

After getting each DM’s weight with respect to each attribute, an overall matrix R can be given as follows by aggregating all of the decision matrices R ( ϑ ) ( ϑ = 1 , 2 , , g ) .
R = [ h S ϕ i j ] m × n = [ h S ϕ 11 h S ϕ 12 h S ϕ 1 n h S ϕ 21 h S ϕ 22 h S ϕ 2 n                  h S ϕ m 1 h S ϕ m 2 h S ϕ m n ] .
In the present world, considering that decision making is always accompanied by uncertain settings and inconsistent opinions, most decisions are made from the perspective of compromise. Based on this point, Ju [45] presented a weight-determination method for criteria whose weights are completely unknown based on the optimization model and ideal solutions. Then, we apply it to the DHHFL environment; the steps are given as follows:
Step 1: Obtain the DHHFL’s positive ideal solution (DHHFL-PIS) and the DHHFL’s negative ideal solution (DHHFL-NIS) by Equations (24) and (25), respectively.
h S ϕ + = ( h S ϕ 1 + , h S ϕ 2 + , , h S ϕ n + ) ,
h S ϕ = ( h S ϕ 1 , h S ϕ 2 , , h S ϕ n ) ,
where h S ϕ j + = max i = 1 m { h S ϕ i j + } , h S ϕ j = min i = 1 m { h S ϕ i j } , j = 1 , 2 , , n .
Step 2: Calculate the Hamming distance h d ( h S ϕ i j , h S ϕ j + ) ( i = 1 , 2 , , m ; j = 1 , 2 , , n )
Step 3: Calculate the Hamming distance h d ( h S ϕ i j , h S ϕ j ) ( i = 1 , 2 , , m ; j = 1 , 2 , , n ) .
Step 4: Establish a multiple objective optimization model and solve it to obtain the weight vector of the criteria.
h i + = j = 1 n h d ( h S ϕ i j , h S ϕ j + ) × ϖ j , i = 1 , 2 , , m ,
h i = j = 1 n h d ( h S ϕ i j , h S ϕ j ) × ϖ j , i = 1 , 2 , , m .
From the perspective of compromise, the greater the values of h i + and h i are, the higher priority the alternate option o p i will be. In other words, an appropriate weight vector W = ( ϖ 1 , ϖ 2 , , ϖ n ) should make the value of h i + and h i as large as possible. Hence, a multiple objective optimization model can be established as below:
( M 1 ) { max H = i = 1 m j = 1 n ( ( h d ( h S ϕ i j , h S ϕ j + ) + h d ( h S ϕ i j , h S ϕ j ) ) × ϖ j ) s . t .    j = 1 n ϖ j 2 = 1 ,    ϖ j N , j = 1 , 2 , , n .
To solve the optimization model and obtain the most desirable weight vector, a Lagrange function with a Lagrange multiplier ξ can be given as:
L ( W , ξ ) = i = 1 m j = 1 n ( ( h d ( h S ϕ i j , h S ϕ j + ) + h d ( h S ϕ i j , h S ϕ j ) ) × ϖ j ) + 1 2 ξ ( j = 1 n ϖ j 2 1 ) .
Taking the partial derivative of L ( W , ξ ) with respect to ϖ j and ξ and setting them equal to zero, respectively, we can obtain the following equation:
{ L ( W , ζ ) ϖ j = i = 1 m ( h d ( h S ϕ i j , h S ϕ j + ) + h d ( h S ϕ i j , h S ϕ j ) ) + ζ ϖ j = 0 , j = 1 , 2 , , n ; L ( W , ζ ) ζ = 1 2 ( j = 1 n ϖ j 2 1 ) = 0 .
Settling the simultaneous equations above, we can obtain the weight of each criterion as follows:
ϖ j = i = 1 m ( h d ( h S ϕ i j , h S ϕ j + ) + h d ( h S ϕ i j , h S ϕ j ) ) j = 1 n ( i = 1 m ( h d ( h S ϕ i j , h S ϕ j + ) + h d ( h S ϕ i j , h S ϕ j ) ) ) 2 , j = 1 , 2 , , n .
In real practical terms, the convention assumes that the criteria weights add up to 1. Therefore, we make a further normalization for the criteria weight obtained by Equation (33) as follows:
ϖ j = ϖ j j = 1 n ϖ j = i = 1 m ( h d ( h S ϕ i j , h S ϕ j + ) + h d ( h S ϕ i j , h S ϕ j ) ) j = 1 n i = 1 m ( h d ( h ˙ S ϕ i j , h S ϕ j + ) + h d ( h S ϕ i j , h S ϕ j ) ) , j = 1 , 2 , , n .
By using the calculated criterion’s weight to weight the matrix R , we can get the following final decision matrix:
R ¯ = [ h ¯ S ϕ i j ] m × n = [ h ¯ S ϕ 11 h ¯ S ϕ 12 h ¯ S ϕ 1 n h ¯ S ϕ 21 h ¯ S ϕ 22 h ¯ S ϕ 2 n               h ¯ S ϕ m 1 h ¯ S ϕ m 2 h ¯ S m n ] ,
where h ¯ S ϕ i j = ϖ j × h S ϕ i j .

4.4. The Expected-HDD-Based ELECTRE II Method

On the basis of the new comparison method for DHHFLEs and the weight-determination methods for experts and criteria, an improved ELECTRE II method is proposed to rank the given alternatives in the decision making with DHHFL information. In our method, on one hand, the improved comparison method for DHHFLEs is used to identify the magnitude relationship between two alternatives under each criterion, which can make the division of concordant, indifferent, and discordant sets more accurate. On the other hand, the novel weight-determination method for experts can eliminate the effects of both extremes and the experts’ experience, which can provide more accurate information for the following steps of the method and makes the decision result more convincing.

4.4.1. Concordant, Indifferent, and Discordant Sets

In the traditional ELECTRE II method, by means of the comparisons of each pair of options on the attributes, the attributes of distinct alternate options can be grouped into three mutually exclusive collections: The concordant set J + = { j | c r j ( o p s ) > c r j ( o p t ) } indicating those attributes under which o p s is superior to o p t , the indifference set J = = { j | c r j ( o p s ) = c r j ( o p t ) } indicating those attributes under which o p s is indiscriminate with o p t and the discordance set J = { j | c r j ( o p s ) < c r j ( o p t ) } denoting those attributes under which o p s is inferior to o p t , in which c r j ( o p s ) represents the performance of the option o p s as regard to the criterion c r j .
In the following, based the proposed comparison method for DHHFLEs, the expected value and HDD of the DHHFLEs are denoted together to distinguish the different alternatives under a certain criterion, which makes the division of attributes more sophisticated and reasonable. In view of the notions of the expected value and the HDD function for DHHFLEs, the DHHFL concordant set (DHHFLCS) and DHHFL discordant set (DHHFLDS) can be subdivided into the DHHFL strong, moderate, and weak concordant (discordant) sets, respectively.
For any pair of options o p s and o p t ( s , t = 1 , 2 , , m ; s t ) , the DHHFLCS of them is a collection of criteria under which o p s is superior to o p t . It can be subdivided into three types, as shown below:
(1)
The strong DHHFLCS J c s t s :
J c s t s = { j | E v ( h S ϕ s j ) > E v ( h S ϕ t j ) & h σ ( h S ϕ s j ) < h σ ( h S ϕ t j ) }
(2)
The moderate DHHFLCS J c s t m :
J c s t m = { j | E v ( h S ϕ s j ) > E v ( h S ϕ t j ) & h σ ( h S ϕ s j ) h σ ( h S ϕ t j ) }
(3)
The weak DHHFLCS J c s t w :
J c s t w = { j | E v ( h S ϕ s j ) = E v ( h S ϕ t j ) & h σ ( h S ϕ s j ) < h σ ( h S ϕ t j ) }
These three DHHFLCSs indicate three distinct and decreasing extents of the concordance for the assertion “ o p s is at least as good as o p t ”. Obviously, the distinction between J c s t s and J c s t m is caused by the HDD. A lower HDD denotes a high stability degree of the DHHFLE; therefore, compared with J c s t m , J c s t s represents a higher degree of concordance. According to Definition 4, a conclusion can easily be drawn that h S ϕ s j is superior to h S ϕ s j as long as E v ( h S ϕ s j ) > E v ( h S ϕ t j ) . In other words, the expected value plays a more important role than the HDD when comparing two DHHFLEs. Hence, J c s t m indicates a higher degree of concordance than J c s t w .
In the same manner, the DHHFLDS indicates a collection of criteria under which o p s is inferior to o p t . It can be subdivided into three types, as shown below:
(1)
The strong DHHFLDS J d s t s :
J d s t s = { j | E v ( h S ϕ s j ) < E v ( h S ϕ t j ) & h σ ( h S ϕ s j ) > h σ ( h S ϕ t j ) }
(2)
The moderate DHHFLDS J d s t m :
J d s t m = { j | E v ( h S ϕ s j ) < E v ( h S ϕ t j ) & h σ ( h S ϕ s j ) h σ ( h S ϕ t j ) }
(3)
The weak DHHFLDS J d s t w :
J d s t w = { j | E v ( h S ϕ s j ) = E v ( h S ϕ t j ) & h σ ( h S ϕ s j ) > h σ ( h S ϕ t j ) }
In addition to the abovementioned conditions, there still stands a case where E v ( h S ϕ s j ) = E v ( h S ϕ t j ) and h σ ( h S ϕ s j ) = h σ ( h S ϕ t j ) ; the set of corresponding subscripts of these criteria is called the indifferent set, and can be defined as follows:
J I s t = { j | E v ( h S ϕ s j ) = E v ( h S ϕ t j ) & h σ ( h S ϕ s j ) = h σ ( h S ϕ t j ) } .

4.4.2. The DHHFL Concordance and Discordance Index

In line with the abovementioned DHHFLCS and DHHFLDS, for the assertion “the o p s is at least as good as the o p t ”, the DHHFL concordance index (DHHFLCI) can be obtained by
C I s t = ω c s × σ J c s t s ϖ σ + ω c m × σ J c s t m ϖ σ + ω c w × σ J c s t w ϖ σ + ω = × σ J I s t ϖ σ σ = 1 n ϖ σ = ω c s × σ J c s t s ϖ σ + ω c m × σ J c s t m ϖ σ + ω c w × σ J c s t w ϖ σ + ω = × σ J I s t ϖ σ
where ϖ σ is the weight of the criterion c r σ . ω c s , ω c m , ω c w and ω =  are the given position weights for the strong DHHFLCS, moderate DHHFLCS, weak DHHFLCS, and DHHFL indifferent set, respectively. The DHHFLCI C I s t indicates the weighted superior degree of the alternative o p s over the alternative o p t , and C I s t [ 0 , 1 ] . Then, we can construct the DHHFL concordant matrix as follows:
C = [ C I s t ] m × m = [         C I 12 C I 1 m C I 21           C I 2 m                  C I m 1 C I m 2 ] .
Similarly, the DHHFL discordance index (DHHFLDI) of DHHFLDS can be given as
D I s t = max { ω d s × max σ J d s t s { ϖ σ h d ( h S ϕ s σ , h S ϕ t σ ) } , ω d m × max σ J d s t m { ϖ σ h d ( h S ϕ s σ , h S ϕ t σ ) } , ω d w × max σ J d s t w { ϖ σ h d ( h S ϕ s σ , h S ϕ t σ ) } } max j   h d ( h S ϕ s j , h S ϕ t j )
where ϖ σ is the weight of the criterion c r σ . ω d s , ω d m and ω d w are the given attitude weights for the strong DHHFLDS, moderate DHHFLDS, and weak DHHFLDS, respectively. h d ( h S ϕ s σ , h S ϕ t σ ) denotes the Hamming distance between h S ϕ s σ and h S ϕ t σ , which can be obtained by Equation (6). The DHHFLDI D I s t represents the weighted inferior degree of the alternative o p s  over the alternative o p t , and D I s t [ 0 , 1 ] .
Likewise, the DHHFL discordant matrix can be established as:
D = [ D I s t ] m × m = [      D I 12     D I 1 m D I 21           D I 2 m            D I m 1 D I m 2    ] .

4.4.3. Determine the Outranking Relations

When the DHHFL concordant matrix and the DHHFL discordant matrix are determined, we can define the critical value C ¯ by taking the mean value of all the elements in the DHHFL concordant matrix, which can be expressed by C ¯ = s = 1 m t = 1 m C I s t / m ( m 1 ) . Then, making the comparisons between the elements in the DHHFL concordant set and the critical value C ¯ , respectively, the DHHFL concordant Boolean matrix can be obtained as follows:
B C = [ b c s t ] m × m = [     b c 12       b c 1 m b c 21        b c 2 m                b c m 1   b c m 2        ] ,
where the element b c s t can only be 0 or 1, and when C I s t C ¯ , b c s t = 1 ; otherwise, b c s t = 0 . b c s t = 1 means that the alternative o p s outranks the alternative o p t from the perspective of concordance.
Similarly, a marginal value can be given by the average of all of the elements in the DHHFL discordant matrix, presented by D ¯ = s = 1 m t = 1 m D I s t / m ( m 1 ) . Then, the discordant Boolean matrix is defined as below:
B D = [ b d s t ] m × m = [    b d 12        b d 1 m b d 21          b d 2 m           b d m 1 b d m 2         ] ,
where the element b d s t can only be 0 or 1, and when D I s t < D ¯ , b d s t = 1 ; otherwise, b d s t = 0 . b d s t = 1 indicates that the alternative o p s is not inferior to the alternative o p t from the perspective of discordance.
Then, to show the overall outranking relations between the alternatives, a comprehensive Boolean matrix B can be defined through making a multiplication of the Boolean matrices B C and B D , which can be expressed as B = [ b c s t × b d s t ] m × m = [ b s t ] m × m . Obviously, only when b c s t and b d s t are both assigned of a value 1, b s t = 1 , which means that the option o p s is strictly outranking to the option o p t .

4.4.4. Draw the Outranking Graph

According to the comprehensive Boolean matrix B obtained in the last section, an outranking graph G = ( V , L ) can be depicted to concisely show the outranking relations between alternatives and to help the DM choose the most desirable alternative. In the graph, V is a set of vertices and each vertex represents an alternative, L indicates the set of directed edges connecting the vertices, and each arc shows the outranking relation between the two alternatives at either end of it. There are two situations of the directed arcs between two alternatives o p s and o p t : (1) The directed edge is from o p s to o p t , which indicates that o p s outperforms o p t ; (2) when the two alternatives o p s and o p t are incomparable, there is no arc between the two corresponding vertices.
In general, the symmetric positions in the matrix B should be complementary, as the relation of strictly outranking cannot be mutual. In other words, there should be and merely is one arc between any two vertices in the outranking graph. However, owing to the subjectivity of the threshold selection, the symmetric positions in the comprehensive Boolean matrix B are not always complementary, which makes it impossible to compare the two schemes. To handle this issue, Lin et al. [36] proposed the following method to revise the Boolean matrices.
Let B be a comprehensive matrix obtained by the multiplication of the Boolean matrices B C and B D in component form. When the elements B s t = B t s = 0 or B s t = B t s = 1 , which implies that the elements in the corresponding positions in B C and B D satisfy the condition: b c s t × b d s t = 0 and b c t s × b d t s = 0 , or b c s t × b d s t = 1 and b c t s × b d t s = 1 . Hence, there is no arc between the two alternatives in the outranking graph, which means that they are incomparable. In such cases, we set B s t ^ = 1 , B t s ^ = 0 , which indicates that o p s weakly outperforms o p t when b c t s ^ × b d t s ^ = 1 and b c t s ^ × b d t s ^ = 0 .

4.4.5. The Decision-Making Procedures

On the basis of the above description, the procedure of the presented expected-HDD-based ELECTRE II method can be given as follows:
Step 1: Obtain the decision matrices R ( ϑ ) = [ h S ϕ i j ( ϑ ) ] m × n ( ϑ = 1 , 2 , , g ) provided by the invited experts. Set the attitude (position) weights of the strong, moderate, and weak DHHFLCS, the DHHFL indifference set, and the strong, moderate, and weak DHHFLDS, represented as ω c s , ω c m , ω c w , ω = , ω d s , ω d m and ω d w , respectively.
Step 2: Calculate the DM’s weight w ξ ( ϑ ) ( ξ = 1 , 2 , , n ; ϑ = 1 , 2 , , g ) regarding each attribute by means of the method defined in Section 3.2.
Step 3: Calculate the criteria’s weight ϖ j ( j = 1 , 2 , , n ) based on the optimization model and obtain the overall decision matrix R ¯ = [ h ¯ S ϕ i j ] m × n .
Step 4: Compute the expected value and HDD of the DHHFLEs in the final matrix R ¯ as
E v ( h ¯ S ϕ i j ) = 1 Δ h ¯ S ϕ i j r = 1 Δ h ¯ S ϕ i j I ( ζ t r < δ κ r > ) ,
h σ ( h ¯ S ϕ i j ) = Δ h ¯ S ϕ i j 1 2 ε τ 1 Δ h ¯ S ϕ i j r = 1 Δ h ¯ S ϕ i j ( I ( ζ t r < δ κ r > ) E v ( h ¯ S ϕ i j ) ) 2 ,
where Δ h ¯ S ϕ i j is the count of elements in h ¯ S ϕ i j .
Step 5: Construct the strong, moderate, and weak DHHFLCS by Equations (35)–(37), the strong, moderate, and weak DHHFLDS by Equations (38)–(40), and the DHHFL indifferent set by Equation (41).
Step 6: Calculate the DHHFLCI of any pair of alternatives by Equation (42) to establish the DHHFL concordant matrix C = [ C I s t ] m × m .
Calculate the DHHFLDI of any pair of alternatives by Equation (43) to establish the DHHFL discordant matrix D = [ D I s t ] m × m .
Step 7: Calculate the critical value as C ¯ = s = 1 m t = 1 m C I s t / m ( m 1 ) and construct the DHHFL concordant Boolean matrix B C .
Calculate the marginal value as D ¯ = s = 1 m t = 1 m D I s t / m ( m 1 ) and construct the DHHFL discordant Boolean matrix B D .
Step 8: Establish the comprehensive Boolean matrix B and then depict the outranking graph based on the matrix.
If there is no arc between two vertices in the graph, locate the corresponding symmetrical positions in B where the elements may be not complementary. Then, revise the elements of the same positions in the matrices B C , B D , and B , and further redraw the outranking graph with the arcs of weak outranking.
To make the decision-making processes of the proposed expected-HDD-based ELECTRE II method clearer, a flowchart is summarized, as shown in Figure 2.
The processes of weight-determination in Figure 2 can be redefined as in Figure 3 and Figure 4, respectively.

5. Numerical Example: E-Government Outsourcer Selection

5.1. Application Background

E-government outsourcing (EGO), also known as IT Service Outsourcing in government, is not only a kind of government service outsourcing, but is also an IT outsourcing, which aims to relieve the pressure on government departments and provide more professional service for the public. In the process of government informatization, the government entrusts part or all of the e-government project construction, daily operation, and maintenance, as well as related services, to a professional IT outsourcing service provider to improve the quality of e-government. From the perspective of outsourcing details, the EGO can be divided into the following four categories:
  • Overall outsourcing of IT resources: The outsourcer should provide government departments with a full set of IT system planning, procurement, implementation, operation and maintenance, consulting, and training services.
  • Single IT technology outsourcing: The government will selectively outsource some processes of IT projects, such as network construction, hardware equipment maintenance, and single software development, to the IT service provider.
  • Maintenance outsourcing: The government outsources the maintenance service of the established business system to enjoy the service of professional technical strength.
  • Apart from the abovementioned outsourcing contents, EGO should also include project planning, program design, partner determination, training, and other content.
In short, outsourcing can cover the whole life cycle of e-government projects from planning to implementation, from supervision to the final operation and maintenance. To ensure the service quality and preferably save manpower and material resources, it is vital to effectively pick the outsourcer in the process of EGO, which is an MCDM problem involving multiple experts and criteria. Our proposed method can not only describe the preference of experts more accurately, but can also deal with the non-compensatory problem of criteria, which has significant advantages in solving the MCGDM problem. Thus, in the following, we apply this novel approach to a practical outsourcer selection problem in the process of EGO.

5.2. Problem Characteristics

Due to the aging system, a city government is willing to develop a new public opinion feedback system. To reduce the IT cost and improve service quality as much as possible, the government decided to resort to an IT outsourcing provider to purchase the IT service. After the first round of bidding, five alternate outsourcers stand out: o p 1 : Digital China Information Service Company Ltd; o p 2 : AsiaInfo; o p 3 : DOUPLES; o p 4 : Neusoft; o p 5 : ChinasoftInternational. After comprehensively discussing in a departmental meeting, the government picked four experts to evaluate the given alternatives under the five critical criteria shown in Table 2. The expert vectors are represented as E = { e x 1 , e x 2 , e x 3 , e x 4 } and criteria vectors as C = { c r 1 , c r 2 , c r 3 , c r 4 , c r 5 } , in which the weights of experts and criteria are completely unknown.
In the process of evaluation, the experts employ the DHHFLE to describe their opinion, where the first-hierarchy LTS is S = { ζ 1 , ζ 2 , ζ 3 , ζ 4 , ζ 5 , ζ 6 , ζ 7 } = { t e r r i b l e , p r e t t y   b a d , b a d , m o d e r a t e , w e l l , p r e t t y w e l l , p e r f e c t } , and the corresponding second-hierarchy LTSs are shown in Figure 1.

5.3. Decision-Making Procedure

Step 1: Firstly, we preset the position weights of the strong, moderate, and weak DHHFLCS, the DHHFL indifferent set, and the strong, moderate, and weak DHHFLDS as ω ˜ = ( ω c s , ω c m , ω c w , ω = , ω d s , ω d m , ω d w ) = ( 1 , 0.8 , 0.6 , 1 , 0.9 , 0.7 , 0.6 ) . The decision matrices of each expert are given respectively as follows:
R ( 1 ) = [ h S ϕ i j ( 1 ) ] 5 × 5 = [ { ζ 1 < δ 0 > , ζ 1 < δ 1 > }     { ζ 2 < δ 1 > , ζ 2 < δ 0 > , ζ 2 < δ 1 > } { ζ 1 < δ 0 > , ζ 1 < δ 1 > , ζ 1 < δ 2 > }       { ζ 1 < δ 2 > , ζ 1 < δ 3 > }     { ζ 2 < δ 2 > , ζ 2 < δ 2 > } { ζ 2 < δ 0 > , ζ 2 < δ 1 > }     { ζ 1 < δ 2 > , ζ 1 < δ 0 > , ζ 1 < δ 2 > }       { ζ 1 < δ 1 > , ζ 1 < δ 2 > }      { ζ 1 < δ 1 > , ζ 1 < δ 2 > }    { ζ 1 < δ 1 > , ζ 1 < δ 0 > , ζ 1 < δ 1 > } { ζ 2 < δ 1 > , ζ 2 < δ 2 > }      { ζ 1 < δ 1 > , ζ 1 < δ 0 > } { ζ 1 < δ 0 > , ζ 1 < δ 1 > , ζ 1 < δ 2 > } { ζ 1 < δ 0 > , ζ 1 < δ 1 > }      { ζ 0 < δ 1 > , ζ 0 , ζ 0 < δ 1 > } { ζ 0 < δ 2 > , ζ 0 < δ 1 > }         { ζ 2 < δ 1 > , ζ 2 < δ 0 > }        { ζ 2 < δ 0 > , ζ 2 < δ 1 > , ζ 2 < δ 2 > }      { ζ 2 < δ 0 > , ζ 2 < δ 1 > }             { ζ 2 < δ 0 > } { ζ 1 < δ 2 > , ζ 2 < δ 1 > }                  { ζ 2 < δ 0 > }               { ζ 1 < δ 2 > , ζ 1 < δ 3 > }     { ζ 1 < δ 2 > , ζ 1 < δ 3 > } { ζ 2 < δ 1 > , ζ 2 < δ 0 > , ζ 2 < δ 1 > } ] , R ( 2 ) = [ h S ϕ i j ( 2 ) ] 5 × 5 = [ { ζ 1 < δ 0 > , ζ 1 < δ 2 > }     { ζ 2 < δ 1 > , ζ 2 < δ 0 > , ζ 2 < δ 1 > } { ζ 1 < δ 1 > , ζ 1 < δ 2 > , ζ 1 < δ 3 > }      { ζ 1 < δ 2 > , ζ 1 < δ 3 > } { ζ 2 < δ 1 > , ζ 2 < δ 1 > } { ζ 2 < δ 0 > , ζ 2 < δ 1 > }        { ζ 1 < δ 0 > , ζ 1 < δ 2 > }           { ζ 1 < δ 1 > , ζ 1 < δ 2 > }          { ζ 1 < δ 1 > , ζ 1 < δ 2 > }    { ζ 1 < δ 1 > , ζ 1 < δ 2 > , ζ 1 < δ 3 > } { ζ 2 < δ 1 > , ζ 2 < δ 1 > } { ζ 0 < δ 2 > , ζ 1 < δ 0 > , ζ 1 < δ 1 > } { ζ 1 < δ 0 > , ζ 1 < δ 1 > , ζ 1 < δ 2 > } { ζ 1 < δ 0 > , ζ 1 < δ 1 > }          { ζ 0 , ζ 0 < δ 2 > } { ζ 0 < δ 3 > , ζ 0 < δ 2 > }       { ζ 3 < δ 2 > , ζ 3 < δ 1 > }       { ζ 2 < δ 0 > , ζ 2 < δ 1 > , ζ 2 < δ 2 > }    { ζ 2 < δ 0 > , ζ 2 < δ 1 > }           { ζ 2 < δ 0 > } { ζ 1 < δ 2 > , ζ 2 < δ 1 > }             { ζ 2 < δ 0 > }          { ζ 1 < δ 2 > , ζ 1 < δ 3 > }        { ζ 1 < δ 2 > , ζ 1 < δ 3 > }       { ζ 2 < δ 1 > , ζ 2 < δ 0 > , ζ 2 < δ 1 > } ] , R ( 3 ) = [ h S ϕ i j ( 3 ) ] 5 × 5 = [ { ζ 2 < δ 0 > , ζ 2 < δ 1 > }       { ζ 2 < δ 1 > , ζ 2 < δ 1 > }           { ζ 1 < δ 2 > , ζ 1 < δ 3 > }         { ζ 1 < δ 2 > , ζ 1 < δ 3 > }     { ζ 2 < δ 1 > , ζ 2 < δ 0 > , ζ 2 < δ 1 > } { ζ 2 < δ 1 > , ζ 2 < δ 2 > }   { ζ 1 < δ 2 > , ζ 1 < δ 0 > , ζ 1 < δ 2 > }       { ζ 1 < δ 1 > , ζ 1 < δ 2 > }      { ζ 1 < δ 1 > , ζ 1 < δ 1 > }     { ζ 1 < δ 1 > , ζ 1 < δ 0 > , ζ 1 < δ 1 > } { ζ 1 < δ 0 > , ζ 1 < δ 1 > }   { ζ 0 < δ 2 > , ζ 1 < δ 0 > , ζ 1 < δ 2 > } { ζ 1 < δ 0 > , ζ 1 < δ 1 > , ζ 1 < δ 2 > } { ζ 1 < δ 1 > , ζ 1 < δ 1 > }     { ζ 0 < δ 1 > , ζ 0 , ζ 0 < δ 1 > } { ζ 0 < δ 1 > , ζ 0 < δ 2 > }      { ζ 3 < δ 1 > , ζ 3 < δ 0 > }         { ζ 2 < δ 0 > , ζ 2 < δ 1 > , ζ 2 < δ 2 > }      { ζ 2 < δ 1 > , ζ 2 < δ 2 > }             { ζ 2 < δ 0 > } { ζ 1 < δ 0 > , ζ 1 < δ 1 > }             { ζ 2 < δ 1 > }      { ζ 1 < δ 0 > , ζ 1 < δ 1 > , ζ 1 < δ 2 > } { ζ 1 < δ 2 > , ζ 1 < δ 3 > }          { ζ 2 < δ 2 > , ζ 2 < δ 2 > } ] , R ( 4 ) = [ h S ϕ i j ( 4 ) ] 5 × 5 = [ { ζ 0 < δ 2 > , ζ 0 < δ 2 > }        { ζ 2 < δ 0 > , ζ 2 < δ 1 > }      { ζ 1 < δ 0 > , ζ 1 < δ 1 > , ζ 1 < δ 2 > }      { ζ 1 < δ 2 > , ζ 1 < δ 3 > } { ζ 2 < δ 1 > , ζ 2 < δ 0 > , ζ 2 < δ 1 > } { ζ 0 < δ 2 > , ζ 0 < δ 3 > }     { ζ 1 < δ 2 > , ζ 1 < δ 0 > , ζ 1 < δ 2 > }        { ζ 1 < δ 2 > , ζ 1 < δ 0 > }       { ζ 1 < δ 1 > , ζ 1 < δ 1 > }       { ζ 1 < δ 0 > , ζ 1 < δ 1 > } { ζ 3 < δ 1 > , ζ 3 < δ 0 > } { ζ 1 < δ 1 > , ζ 1 < δ 0 > , ζ 1 < δ 1 > } { ζ 1 < δ 0 > , ζ 1 < δ 1 > , ζ 1 < δ 2 > } { ζ 1 < δ 0 > , ζ 1 < δ 1 > }      { ζ 1 < δ 2 > , ζ 0 , ζ 0 < δ 1 > }       { ζ 1 < δ 1 > }           { ζ 2 < δ 1 > , ζ 2 < δ 3 > }          { ζ 2 < δ 1 > , ζ 2 < δ 2 > , ζ 2 < δ 3 > }    { ζ 2 < δ 0 > , ζ 2 < δ 1 > }           { ζ 2 < δ 1 > } { ζ 0 < δ 1 > , ζ 0 < δ 2 > }       { ζ 2 < δ 1 > , ζ 2 < δ 1 > }     { ζ 1 < δ 1 > , ζ 1 < δ 3 > }      { ζ 1 < δ 1 > , ζ 1 < δ 2 > } { ζ 2 < δ 1 > , ζ 2 < δ 1 > , ζ 2 < δ 2 > } ] .
Step 2: Calculate the DM’s weight w ξ ( ϑ ) ( ξ = 1 , 2 , 3 , 4 , 5 ; ϑ = 1 , 2 , 3 , 4 ) regarding each attribute using the method defined in Section 3.2.
Step 2.1: Transform the decision matrices R ( ϑ ) ( ϑ = 1 , 2 , 3 , 4 ) into Q ( ξ ) ( ξ = 1 , 2 , 3 , 4 , 5 ) as follows:
Q ( 1 ) = [ h S ϕ i 1 ( ϑ ) ] 5 × 4 = [    { ζ 1 < δ 0 > , ζ 1 < δ 1 > }     { ζ 1 < δ 0 > , ζ 1 < δ 2 > }    { ζ 2 < δ 0 > , ζ 2 < δ 1 > }    { ζ 0 < δ 1 > , ζ 0 < δ 2 > }   { ζ 2 < δ 0 > , ζ 2 < δ 1 > }    { ζ 2 < δ 0 > , ζ 2 < δ 1 > }    { ζ 2 < δ 1 > , ζ 2 < δ 2 > }    { ζ 0 < δ 2 > , ζ 0 < δ 3 > } { ζ 2 < δ 1 > , ζ 2 < δ 2 > } { ζ 2 < δ 1 > , ζ 2 < δ 1 > }    { ζ 1 < δ 0 > , ζ 1 < δ 1 > }    { ζ 3 < δ 1 > , ζ 3 < δ 0 > } { ζ 0 < δ 2 > , ζ 0 < δ 1 > } { ζ 0 < δ 3 > , ζ 0 < δ 2 > } { ζ 0 < δ 1 > , ζ 0 < δ 2 > }        { ζ 1 < δ 1 > }    { ζ 1 < δ 0 > , ζ 1 < δ 1 > }     { ζ 1 < δ 2 > , ζ 2 < δ 1 > }     { ζ 1 < δ 0 > , ζ 1 < δ 1 > }    { ζ 0 < δ 1 > , ζ 0 < δ 2 > } ] , Q ( 2 ) = [ h S ϕ i 2 ( ϑ ) ] 5 × 4 = [ { ζ 2 < δ 1 > , ζ 2 < δ 0 > , ζ 2 < δ 1 > } { ζ 2 < δ 1 > , ζ 2 < δ 0 > , ζ 2 < δ 1 > }      { ζ 2 < δ 1 > , ζ 2 < δ 1 > }        { ζ 2 < δ 0 > ζ 2 < δ 1 > } { ζ 1 < δ 2 > , ζ 1 < δ 0 > , ζ 1 < δ 2 > }     { ζ 1 < δ 0 > , ζ 1 < δ 2 > } { ζ 1 < δ 2 > , ζ 1 < δ 0 > , ζ 1 < δ 2 > } { ζ 1 < δ 2 > , ζ 1 < δ 0 > , ζ 1 < δ 2 > }     { ζ 1 < δ 1 > , ζ 1 < δ 0 > }     { ζ 0 < δ 2 > , ζ 1 < δ 0 > , ζ 1 < δ 1 > } { ζ 0 < δ 2 > , ζ 1 < δ 0 > , ζ 1 < δ 2 > } { ζ 1 < δ 1 > , ζ 1 < δ 0 > , ζ 1 < δ 1 > }      { ζ 2 < δ 1 > , ζ 2 < δ 0 > }       { ζ 3 < δ 2 > , ζ 3 < δ 1 > }    { ζ 3 < δ 1 > , ζ 3 < δ 0 > }            { ζ 2 < δ 1 > , ζ 2 < δ 3 > }       { ζ 2 < δ 0 > }               { ζ 2 < δ 0 > }             { ζ 2 < δ 1 > }                { ζ 2 < δ 1 > , ζ 2 < δ 1 > } ] , Q ( 3 ) = [ h S ϕ i 3 ( ϑ ) ] 5 × 4 = [ { ζ 2 < δ 1 > , ζ 2 < δ 0 > , ζ 2 < δ 1 > } { ζ 2 < δ 1 > , ζ 2 < δ 0 > , ζ 2 < δ 1 > }      { ζ 2 < δ 1 > , ζ 2 < δ 1 > }       { ζ 2 < δ 0 > ζ 2 < δ 1 > } { ζ 1 < δ 2 > , ζ 1 < δ 0 > , ζ 1 < δ 2 > }      { ζ 1 < δ 0 > , ζ 1 < δ 2 > }    { ζ 1 < δ 2 > , ζ 1 < δ 0 > , ζ 1 < δ 2 > } { ζ 1 < δ 2 > , ζ 1 < δ 0 > , ζ 1 < δ 2 > }      { ζ 1 < δ 1 > , ζ 1 < δ 0 > }        { ζ 0 < δ 2 > , ζ 1 < δ 0 > , ζ 1 < δ 1 > } { ζ 0 < δ 2 > , ζ 1 < δ 0 > , ζ 1 < δ 2 > } { ζ 1 < δ 1 > , ζ 1 < δ 0 > , ζ 1 < δ 1 > }        { ζ 2 < δ 1 > , ζ 2 < δ 0 > }             { ζ 3 < δ 2 > , ζ 3 < δ 1 > }    { ζ 3 < δ 1 > , ζ 3 < δ 0 > }                  { ζ 2 < δ 1 > , ζ 2 < δ 3 > }              { ζ 2 < δ 0 > }             { ζ 2 < δ 0 > }           { ζ 2 < δ 1 > }            { ζ 2 < δ 1 > , ζ 2 < δ 1 > } ] , Q ( 4 ) = [ h S ϕ i 4 ( ϑ ) ] 5 × 4 = [    { ζ 1 < δ 0 > , ζ 1 < δ 1 > }    { ζ 1 < δ 0 > , ζ 1 < δ 2 > }    { ζ 2 < δ 0 > , ζ 2 < δ 1 > }    { ζ 0 < δ 1 > , ζ 0 < δ 2 > }   { ζ 2 < δ 0 > , ζ 2 < δ 1 > }    { ζ 2 < δ 0 > , ζ 2 < δ 1 > }    { ζ 2 < δ 1 > , ζ 2 < δ 2 > }    { ζ 0 < δ 2 > , ζ 0 < δ 3 > } { ζ 2 < δ 1 > , ζ 2 < δ 2 > } { ζ 2 < δ 1 > , ζ 2 < δ 1 > }    { ζ 1 < δ 0 > , ζ 1 < δ 1 > }    { ζ 3 < δ 1 > , ζ 3 < δ 0 > } { ζ 0 < δ 2 > , ζ 0 < δ 1 > } { ζ 0 < δ 3 > , ζ 0 < δ 2 > } { ζ 0 < δ 1 > , ζ 0 < δ 2 > }        { ζ 1 < δ 1 > }    { ζ 1 < δ 0 > , ζ 1 < δ 1 > }     { ζ 1 < δ 2 > , ζ 2 < δ 1 > }     { ζ 1 < δ 0 > , ζ 1 < δ 1 > }    { ζ 0 < δ 1 > , ζ 0 < δ 2 > } ] , Q ( 5 ) = [ h S ϕ i 5 ( ϑ ) ] 5 × 4 = [ { ζ 2 < δ 1 > , ζ 2 < δ 0 > , ζ 2 < δ 1 > } { ζ 2 < δ 1 > , ζ 2 < δ 0 > , ζ 2 < δ 1 > }      { ζ 2 < δ 1 > , ζ 2 < δ 1 > }        { ζ 2 < δ 0 > ζ 2 < δ 1 > } { ζ 1 < δ 2 > , ζ 1 < δ 0 > , ζ 1 < δ 2 > }      { ζ 1 < δ 0 > , ζ 1 < δ 2 > }    { ζ 1 < δ 2 > , ζ 1 < δ 0 > , ζ 1 < δ 2 > } { ζ 1 < δ 2 > , ζ 1 < δ 0 > , ζ 1 < δ 2 > }      { ζ 1 < δ 1 > , ζ 1 < δ 0 > }      { ζ 0 < δ 2 > , ζ 1 < δ 0 > , ζ 1 < δ 1 > } { ζ 0 < δ 2 > , ζ 1 < δ 0 > , ζ 1 < δ 2 > } { ζ 1 < δ 1 > , ζ 1 < δ 0 > , ζ 1 < δ 1 > }         { ζ 2 < δ 1 > , ζ 2 < δ 0 > }          { ζ 3 < δ 2 > , ζ 3 < δ 1 > }    { ζ 3 < δ 1 > , ζ 3 < δ 0 > }             { ζ 2 < δ 1 > , ζ 2 < δ 3 > }      { ζ 2 < δ 0 > }              { ζ 2 < δ 0 > }             { ζ 2 < δ 1 > }                    { ζ 2 < δ 1 > , ζ 2 < δ 1 > } ] .
Step 2.2: Obtain the support degrees of h S ϕ i ξ ( p ) ( p = 1 , 2 , 3 , 4 ) from h S ϕ i ξ ( q ) ( q = 1 , 2 , 3 , 4 ; q p ) using the Equation (19). For example, the support degrees of h S ϕ i 1 ( 1 ) from h S ϕ i 1 ( q ) ( q = 2 , 3 , 4 ) under the criterion c r 1 are shown in Table 3.
Step 2.3: Calculate the total support degree T ( h S ϕ i ξ ( p ) ) of h S ϕ i ξ ( p ) ( p = 1 , 2 , 3 , 4 ) using the following function:
T ( h S ϕ i ξ ( p ) ) = q = 1 q p g sup ( h S ϕ i ξ ( p ) , h S ϕ i ξ ( q ) ) , i = 1 , 2 , , m ; ξ = 1 , 2 , , n .
The total support degree matrix can be given as below:
             e x 1             e x 2               e x 3             e x 4 T ( 1 ) = [ T ( h S ϕ i 1 ( k ) ) ] 5 × 4 = o p 1 o p 2 o p 3 o p 4 o p 5 [ 2.69444 2.69444 2.41667 2.47222 2.72222 2.72222 2.61111 2.27778 2.58333 2.58333 2.30556 2.36111 2.58333 2.47222 2.58333 2.52778 2.75 2.47222 2.75 2.52778 ]       e x 1              e x 2              e x 3             e x 4 T ( 2 ) = [ T ( h S ϕ i 2 ( k ) ) ] 5 × 4 = o p 1 o p 2 o p 3 o p 4 o p 5 [ 2.97222 2.97222 2.97222 2.91667 2.94444 2.83333 2.94444 2.94444 1.89815 2.62037 2.58333 2.62037 2.58333 2.80556 2.75 2.80556 2.90741 2.90741 2.83333 2.87037 ]       e x 1               e x 2               e x 3              e x 4 T ( 3 ) = [ T ( h S ϕ i 3 ( k ) ) ] 5 × 4 = o p 1 o p 2 o p 3 o p 4 o p 5 [ 2.86111 2.86111 2.80556 2.86111 2.91667 2.91667 2.91667 2.75 3 3 3 3 2.94444 2.94444 2.94444 2.83333 2.88889 2.88889 2.77778 2.88889 ]       e x 1             e x 2              e x 3              e x 4 T ( 4 ) = [ T ( h S ϕ i 4 ( k ) ) ] 5 × 4 = o p 1 o p 2 o p 3 o p 4 o p 5 [ 3 3 3 3 2.83333 2.83333 2.83333 2.83333 2.63889 2.63889 2.58333 1.97222 2.94444 2.94444 2.83333 2.94444 2.94444 2.94444 2.94444 2.83333 ]
Step 2.4: Take the sum of elements in each column of T ( ξ ) and obtain the overall support degree of each expert regarding the criterion c r ξ . The results are shown as follows:
ƛ 1 ( 1 ) = 13.3889 ; ƛ 1 ( 2 ) = 13 ; ƛ 1 ( 3 ) = 12.7222 ; ƛ 1 ( 4 ) = 12.3333 ; ƛ 2 ( 1 ) = 13.3056 ; ƛ 2 ( 2 ) = 14.1389 ; ƛ 2 ( 3 ) = 14.0833 ; ƛ 2 ( 4 ) = 14.1574 ; ƛ 3 ( 1 ) = 14.6111 ; ƛ 3 ( 2 ) = 14.6111 ; ƛ 3 ( 3 ) = 14.4444 ; ƛ 3 ( 4 ) = 14.3333 ; ƛ 4 ( 1 ) = 14.3611 ; ƛ 4 ( 2 ) = 14.3611 ; ƛ 4 ( 3 ) = 14.1944 ; ƛ 4 ( 4 ) = 13.5833 ; ƛ 5 ( 1 ) = 14.5648 ; ƛ 5 ( 2 ) = 14.4609 ; ƛ 5 ( 3 ) = 14.6019 ; ƛ 5 ( 4 ) = 14.4907 ;
Step 2.5: Obtain each DM’s weight regarding to the criterion c r ξ , and the consequences are presented below.
w 1 ( 1 ) = 0.26026 ; w 1 ( 2 ) = 0.2527 ; w 1 ( 3 ) = 0.2473 ; w 1 ( 4 ) = 0.23974 ; w 2 ( 1 ) = 0.23894 ; w 2 ( 2 ) = 0.25391 ; w 2 ( 3 ) = 0.25291 ; w 2 ( 4 ) = 0.25424 ; w 3 ( 1 ) = 0.25192 ; w 3 ( 2 ) = 0.25192 ; w 3 ( 3 ) = 0.24904 ; w 3 ( 4 ) = 0.24713 ; w 4 ( 1 ) = 0.25418 ; w 4 ( 2 ) = 0.25418 ; w 4 ( 3 ) = 0.25123 ; w 4 ( 4 ) = 0.24041 ; w 5 ( 1 ) = 0.25104 ; w 5 ( 2 ) = 0.24753 ; w 5 ( 3 ) = 0.25168 ; w 5 ( 4 ) = 0.24976 .
Step 3: Calculate the criterion’s weight ϖ j ( j = 1 , 2 , 3 , 4 , 5 ) based on the optimization model and obtain the overall decision matrix R = [ h S ϕ i j ] m × n .
After getting each expert’s weight regarding each attribute, we can obtain the overall weighted matrix R :
R = [ h S ϕ i j ] 5 × 5 = [ { ζ 1 < δ 1 > , ζ 1 < δ 2 > }    { ζ 2 < δ 1 > , ζ 2 < δ 0 > , ζ 2 < δ 1 > } { ζ 1 < δ 0 > , ζ 1 < δ 1 > , ζ 1 < δ 2 > }       { ζ 1 < δ 2 > , ζ 1 < δ 3 > } { ζ 2 < δ 2 > , ζ 2 < δ 2 > } { ζ 2 < δ 0 > , ζ 2 < δ 1 > }    { ζ 1 < δ 2 > , ζ 1 < δ 0 > , ζ 1 < δ 2 > }       { ζ 1 < δ 1 > , ζ 1 < δ 2 > }        { ζ 1 < δ 1 > , ζ 1 < δ 2 > } { ζ 1 < δ 1 > , ζ 1 < δ 0 > , ζ 1 < δ 1 > } { ζ 2 < δ 1 > , ζ 2 < δ 1 > }     { ζ 0 < δ 2 > , ζ 1 < δ 0 > } { ζ 1 < δ 0 > , ζ 1 < δ 1 > , ζ 1 < δ 2 > } { ζ 1 < δ 0 > , ζ 1 < δ 1 > }     { ζ 0 < δ 1 > , ζ 0 , ζ 0 < δ 1 > } { ζ 0 < δ 1 > , ζ 0 < δ 1 > }       { ζ 3 < δ 1 > , ζ 3 < δ 0 > }       { ζ 2 < δ 0 > , ζ 2 < δ 1 > , ζ 2 < δ 2 > }      { ζ 2 < δ 0 > , ζ 2 < δ 1 > }        { ζ 2 < δ 0 > } { ζ 1 < δ 0 > , ζ 1 < δ 1 > }           { ζ 2 < δ 0 > }        { ζ 1 < δ 2 > , ζ 1 < δ 3 > }       { ζ 1 < δ 2 > , ζ 1 < δ 3 > }    { ζ 2 < δ 1 > , ζ 2 < δ 0 > , ζ 2 < δ 1 > } ] .
Step 3.1: Obtain the DHHFL positive ideal solution (DHHFL-PIS) and the DHHFL negative ideal solution (DHHFL-NIS) by Equations (25) and (26), respectively.
h S ϕ + = ( { ζ 2 < δ 0.35 > , ζ 3 < δ 0 > } , { ζ 2 < δ 1 > , ζ 2 < δ 1.7 > , ζ 3 < δ 0 > } , { ζ 2 < δ 0.3 > , ζ 2 < δ 1.3 > , ζ 3 < δ 0 > } , { ζ 2 < δ 0.2 > , ζ 2 < δ 1.3 > } , { ζ 2 < δ 0.3 > } ) ; h S ϕ = ( { ζ 0 < δ 0.3 > , ζ 0 < δ 0.4 > } , { ζ 0 < δ 0.89 > , ζ 0 < δ 1.85 > , ζ 1 < δ 0.17 > } , { ζ 0 < δ 3 > , ζ 0 < δ 2 > , ζ 0 < δ 1 > } , { ζ 0 < δ 1.4 > , ζ 0 < δ 0.1 > } , { ζ 0 < δ 0.7 > , ζ 0 < δ 0.26 > , ζ 0 < δ 1.3 > } ) .
Step 3.2: Calculate the Hamming distance h d ( h S ϕ i j , h S ϕ j + ) ( i = 1 , 2 , , m ; j = 1 , 2 , , n ) . What follows are the results of the calculation (Table 4).
Step 3.3: Calculate the Hamming distance h d ( h S ϕ i j , h S ϕ j ) ( i = 1 , 2 , , m ; j = 1 , 2 , , n ) . The results are shown in Table 5.
Step 3.4: Establish the optimization model and obtain the weight vector of the criteria.
( M ) { max   H = i = 1 m j = 1 n ( ( h d ( h S ϕ i j , h S ϕ j + ) + h d ( h S ϕ i j , h S ϕ j ) ) × ϖ j ) s . t .   j = 1 n ϖ j 2 = 1 ,    ϖ j N , j = 1 , 2 , , n .
Solving the model M, we can obtain the weight of each criterion as follows:
ϖ 1 = 0.4327 ;   ϖ 2 = 0.3104 ;   ϖ 3 = 0.5595 ;   ϖ 4 = 0.4789 ;   ϖ 5 = 0.4171 .
Using Equation (21) to standardize them, we can obtain:
ϖ 1 = 0.1968 ;   ϖ 2 = 0.1412 ;   ϖ 3 = 0.2545 ;   ϖ 4 = 0.2178 ;   ϖ 5 = 0.1897 .
Then, we can get the following final decision matrix:
R ¯ = [ { ζ 1 < δ 0.58 > , ζ 1 < δ 1.9 > }    { ζ 1 < δ 2.28 > , ζ 2 < δ 0.14 > , ζ 2 < δ 1 > } { ζ 1 < δ 0.82 > , ζ 1 < δ 1.67 > , ζ 1 < δ 2.54 > }     { ζ 1 < δ 2 > , ζ 2 < δ 0 > } { ζ 1 < δ 1.77 > , ζ 2 < δ 0 > , ζ 2 < δ 1.3 > } { ζ 1 < δ 2.67 > , ζ 2 < δ 0.8 > }     { ζ 0 < δ 1.56 > , ζ 1 < δ 0.27 > , ζ 1 < δ 2 > } { ζ 0 < δ 1.77 > , ζ 1 < δ 0.16 > , ζ 1 < δ 1.58 > } { ζ 1 < δ 10.1 > , ζ 1 < δ 1.54 > }    { ζ 0 < δ 2.8 > , ζ 1 < δ 0.69 > , ζ 1 < δ 1.59 > } { ζ 2 < δ 0.35 > , ζ 3 < δ 0 > } { ζ 0 < δ 0.88 > , ζ 0 < δ 1.85 > , ζ 1 < δ 0.17 > }      { ζ 0 < δ - 3 > , ζ 0 < δ - 2 > , ζ 0 < δ - 1 > }    { ζ 0 < δ - 1.36 > , ζ 0 < δ - 0.1 > } { ζ 0 < δ - 0.74 > , ζ 0 < δ 0.26 > , ζ 0 < δ 1.26 > } { ζ 0 < δ - 0.32 > , ζ 0 < δ 0.39 > }    { ζ 2 < δ 1 > , ζ 2 < δ 1.7 > , ζ 3 < δ 0 > }      { ζ 2 < δ 0.28 > , ζ 2 < δ 1.31 > , ζ 3 < δ 0 > } { ζ 2 < δ 0.29 > , ζ 2 < δ 1.32 > } { ζ 2 < δ 0.29 > , ζ 2 < δ 0.29 > , ζ 2 < δ 0.29 > } { ζ 1 < δ 0.2 > , ζ 1 < δ 1.7 > } { ζ 2 < δ 0.08 > , ζ 2 < δ 0.29 > , ζ 2 < δ 0.56 > } { ζ 1 < δ 1.32 > , ζ 1 < δ 2.05 > , ζ 1 < δ 2.78 > } { ζ 1 < δ 1.78 > , ζ 1 < δ 2.79 > }    { ζ 1 < δ 1.77 > , ζ 2 < δ 0.29 > , ζ 2 < δ 1.59 > } ] .
Step 4: Compute the expected value and HDD of the DHHFLEs in the final matrix R ¯ , which are shown in Table 6 and Table 7, respectively.
Step 5: Construct the matrices of strong, moderate, and weak DHHFLCS, which are represented as J c s , J c m , and J c w , and shown as
J c s = [ J c p q s ] 5 × 5 = [    \ { 2 , 3 , 4 } { 1 }      \ \ { 5 } { 5 } { 5 } \ { 2 , 3 } { 2 , 3 , 4 } { 2 } \ ] , J c m = [ J c p q m ] 5 × 5 = [      \     { 5 } { 2 , 3 , 4 , 5 } { 1 }    { 4 }    { 1 }      \ { 2 , 3 , 4 , 5 } { 1 }    { 1 }    { 1 } { 1 }    \ { 1 }    { 1 } { 2 , 3 , 4 } { 2 , 3 , 4 }    { 2 , 3 , 4 }    \ { 2 , 3 , 4 }    { 5 }     { 5 }    { 3 , 4 , 5 } { 1 , 5 }     \ ] , J c w = [ J c p q w ] 5 × 5 = [ \ \ \ \ \ ] .
Establish the matrices of strong, moderate, and weak DHHFLDS, denoted as J d s , J d m , and J d w , respectively.
J d s = [ J d p q s ] 5 × 5 = [     \ { 5 } { 2 , 3 } { 2 , 3 , 4 } \ { 5 } { 2 , 3 , 4 }     \ { 5 }    { 2 }     \         { 1 }     \ ] , J d m = [ J d p q m ] 5 × 5 = [       \      { 1 } { 1 } { 2 , 3 , 4 }    { 5 } { 2 , 3 , 4 }       \     { 5 } { 2 , 3 , 4 } { 2 , 3 , 4 , 5 } { 2 , 3 , 4 , 5 } \ { 2 , 3 , 4 } { 3 , 4 , 5 }       { 1 }      { 1 } { 1 }      \    { 1 , 5 }       { 4 }      { 1 } { 1 } { 2 , 3 , 4 }      \ ] , J d w = [ J d p q w ] 5 × 5 = [ \ \ \ \ \ ] .
Similarly, the DHHFL indifferent set is shown as
J = = [ J p q = ] 5 × 5 = [ \ \ \ \ \ ] .
Step 6: Calculate the DHHFLCI of any pair of alternatives and establish the DHHFL concordant matrix C = [ C I s t ] m × m as follows:
C = [ C I s t ] m × m = [       0.7652 0.6426 0.1575 0.3711 0.1575    0.6426 0.1575 0.1575 0.1575 0.1575    0.1575 0.1575 0.6805 0.6805 0.6805    0.4908 0.5474 0.7652 0.6708 0.3092     ]
Calculate the DHHFLDI of any pair of alternatives to establish the DHHFL discordant matrix D = [ D I s t ] m × m below.
D = [ D I s t ] m × m = [      0.1228 0.1378 0.1781 0.1961 0.1392      0.1378 0.1710 0.1587 0.0787 0.0689      0.1662 0.0834 0.0467 0.0673 0.1378 0.0446 0.0446 0.0901 0.1215 0.1378 0.1772      ]
Step 7: Compute the critical value, we can obtain
C ¯ = s = 1 5 t = 1 5 C I s t / m ( m 1 ) = 0.4253 .
Then, further construct the DHHFL concordant Boolean matrix B C as:
B C = [ b c s t ] 5 × 5 = [ 1 1 0 0 0 1 0 0 0 0 0 0 1 1 1 1 1 1 1 0 ] ,
Calculate the marginal value as
D ¯ = s = 1 m t = 1 m D I s t / m ( m 1 ) = 0.1253 .
Further construct the DHHFL discordant Boolean matrix B D as:
B D = [ b d s t ] 5 × 5 = [ 1 0 0 0 0 0 0 0 1 1 0 1 1 1 0 1 1 1 0 0 ] .
Step 8: Establish the comprehensive Boolean matrix B as:
B = [ b c s t × b d s t ] 5 × 5 = [ 1 0 0 0 0 0 0 0 0 0 0 0 1 1 0 1 1 1 0 0 ] ,
Based on the matrix, the outranking graph can be depicted as below:
As shown in Figure 5, there have no arcs between o p 3 and other options, which means that the corresponding elements in symmetrical positions of B are not complementary. Thus, in the following, we are going to locate the positions and sign them with “ ^ ”; then, we can have
B = [ b c s t × b d s t ] 5 × 5 = [ 1 0 ^ 0 0 0 0 ^ 0 0 0 ^ 0 ^ 0 ^ 0 ^ 1 1 0 ^ 1 1 1 0 ^ 0 ] .
Then, the corresponding positions in matrices B C and B D are rebuilt as:
B C = [ b c s t ] 5 × 5 = [ 1 1 0 0 0 1 0 0 0 0 0 0 1 1 1 1 1 1 1 0 ] , B D = [ b d s t ] 5 × 5 = [ 1 1 ^ 0 0 0 1 ^ 0 0 1 1 0 1 1 1 1 ^ 1 1 1 1 ^ 0 ]
Accordingly, the updated B can be given as:
B = [ b c s t × b d s t ] 5 × 5 = [ 1 1 0 0 0 1 0 0 0 0 0 0 1 1 1 1 1 1 1 0 ] .
Then, the outranking graph is redrawn and shown in Figure 6.
Step 8: Rank the alternatives according to the final outranking graph:
o p 4 > o p 5 > o p 1 > o p 2 > o p 3 .

6. Comparative Analysis

6.1. Effectiveness Analysis

Considering that our weight-determination method for experts is motivated by the PA operator, thus, in the following, we extend the method based on the weighted PA operator [46] into the DHHFL environment to deal with the problem of IT outsourcer selection provided in the Section 4.2. The double hierarchy hesitant fuzzy linguistic power average (DHHFLPA) operator is firstly defined as follows:
Definition 5.
Given a collection of DHHFLEs h S ϕ c ( c = 1 , 2 , , n ) , the definition of the DHHFLPA operator is given as follows:
D H H F L P A ( h S ϕ 1 , h S ϕ 2 , , h S ϕ n ) = α = 1 n 1 + T ( h S ϕ α ) = 1 n 1 + T ( h S ϕ ) h S ϕ α ,
where T ( h S ϕ c ) = z = 1 , z c n S u p ( h S ϕ c , h S ϕ z ) , with S u p ( h S ϕ c , h S ϕ z ) being the support level of h S ϕ c from h S ϕ z , which satisfies three characteristics:
  • S u p ( h S ϕ c , h S ϕ z ) [ 0 , 1 ] ;
  • S u p ( h S ϕ c , h S ϕ z ) = S u p ( h S ϕ z , h S ϕ c ) ;
  • S u p ( h S ϕ c , h S ϕ z ) S u p ( h ¯ S ϕ c , h ¯ S ϕ z ) , if d ( h S ϕ c , h S ϕ z ) d ( h ¯ S ϕ c , h ¯ S ϕ z ) , where d ( h S ϕ c , h S ϕ z ) is the distance between h S ϕ c and h S ϕ z .
Similarly, the double hierarchy hesitant fuzzy linguistic weighted power average (DHHFLWPA) operator can be defined as:
Definition 6.
Given a collection of DHHFLEs h S ϕ c ( c = 1 , 2 , , n ) , the definition of the DHHFLWPA operator is given as follows:
D H H F L W P A ( h S ϕ 1 , h S ϕ 2 , , h S ϕ n ) = α = 1 n ϖ α ( 1 + T ( h S ϕ α ) = 1 n ϖ ( 1 + T ( h S ϕ ) h S ϕ α ,
where T ( h S ϕ c ) = z = 1 , z c n S u p ( h S ϕ c , h S ϕ z ) , with S u p ( h S ϕ c , h S ϕ z ) being the support level of h S ϕ c from h S ϕ z . In this paper, we use Equation (19) to calculate the support degrees of DHHFLEs.
For convenience, we still use the weight-determination method given in this paper to determine the weights of experts and criteria. Then, referring to the method proposed by Wei et al., the rest of the steps are shown as follows.
Using the DHHFLWPA operator to aggregate the elements in the matrix R , we derive the overall evaluation value of each alternative as:
h ¯ S ϕ 1 = { ζ 1 < δ 1.467 > , ζ 1 < δ 2.2995 > , ζ 2 < δ 0.2048 > } ; h ¯ S ϕ 2 = { ζ 1 < δ 0.1621 > , ζ 1 < δ 1.151 > , ζ 1 < δ 2.1642 > } ; h ¯ S ϕ 3 = { ζ 0 < δ 0.764 > , ζ 0 < δ 2.181 > , ζ 3 < δ 0 > } ; h ¯ S ϕ 4 = { ζ 1 < δ 2.85 > , ζ 2 < δ 0.542 > , ζ 3 < δ 0 > } ; h ¯ S ϕ 5 = { ζ 1 < δ 1.625 > , ζ 1 < δ 2.391 > , ζ 2 < δ 0.198 > } .
We calculate the expected value and the HDD of the overall evaluation h ¯ S ϕ i ( i = 1 , 2 , 3 , 4 , 5 ) , and rank the alternatives based on the proposed comparison. The result is shown in Table 8.
From Table 8, we can find that the ranking result obtained by the DHHFLWPA operator is the same as that obtained by the expected-HDD-ELECTRE II method. Therefore, the improved ELECTRE II method is proven to be effective and reasonable.

6.2. Superiority Analysis

In this section, under the DHHFL environment, two pairs of comparisons are provided to elucidate the advancement of the proposed expected-HDD-based ELECTRE II method, which are among the traditional ELECTRE II method [34], the positive and negative ideal-based ELECTRE II method presented by Liao et al. [42], and our newly presented method, respectively.

6.2.1. Comparison with the Traditional ELECTRE II Method

In the following, the traditional ELECTRE II method is applied to address the PSO selection issue provided in Section 4.2. Here, based on DHHFLCI and DHHFLDI, the strong outranking relation and weak ranking relation are defined as O S and O W , respectively.
Let c , c ° and c + represent three concordance degrees with 0 c < c ° < c + 1 , and d and d + denote the discordance degrees satisfying 0 d < d + 1 . Then, the strong outranking relations o p x O S o p y and o p x O W o p y can be respectively given as follows:
(1)
o p x O S o p y can be given as long as one of the following conditions is satisfied:
o p x O S o p y { C I x y > C I y x C I x y c + D I x y d + o r    { C I x y > C I y x C I x y c 0 D I x y d ;
(2)
o p x O W o p y can be established when the following conditions are satisfied:
o p x O W o p y { C I x y > C I y x C I x y c D I x y d + .
Here, we set the concordance degrees ( c , c ° , c + ) = ( 0.7 , 0.6 , 0.5 ) and the discordance degrees ( d , d + ) = ( 0.15 , 0.3 ) . Then, the outranking relation can be established in Table 9.
In accord with the decision processes of the classical ELECTRE II, the strong and weak outranking graphs can be drawn as in Figure 7 and Figure 8, respectively.
According to the ranking algorithm, the calculated positive ranking r ( o p ) and reverse ranking r ( o p ) are shown in Table 10.
Averaging the values of r ( o p ) and r ( o p ) , we can obtain the final ranking result:
o p 4 o p 5 > o p 1 > o p 2 > o p 3 .
Focusing on the ranking result, we can find that o p 4 is indifferent to o p 5 , while o p 4 is superior to o p 5 in the results of our proposed method, which indicates that the orthodox ELECTRE II method cannot accurately identify the subtle differences between the two schemes. Two reasons can account for this difference: (1) Influenced by the levels of concordance and discordance, the classical ELECTRE II method occupies a considerable subjectivity and is not insensitive to the subtle nuances between evaluations; (2) the newly proposed method takes the average of the overall CI as a critical value to define the concordant and discordant Boolean matrices, which is more objective and accurate. Hence, the presented expected-HDD-based ELECTRE II method is more sophisticated and reasonable compared to the classical ELECTRE II method.

6.2.2. Comparison with the Ideal-Based ELECTRE II Method

The ideal-based ELECTRE II method was initially introduced by Liao et al. [42], in which the division of concordant and discordant sets is based on the positive and negative ideal solutions. In the following, we are going to apply this method to rank the given IT service outsourcers. For the sake of conciseness, only the pivotal and particular step results are shown below.
Let h ¯ S ϕ * and h ¯ S ϕ be the DHHFL-PIS and DHHFL-NIS of the final decision matrix R ¯ , respectively. According to the definition of the ideal solution introduced in Ref. [33], we can obtain
h ¯ S ϕ * = ( { ζ 1 < δ 0.3 > , ζ 3 < δ 0 > } , { ζ 1 < δ 1.2 > , ζ 1 < δ 0.3 > , ζ 3 < δ 0 > } ,        { ζ 0 < δ 2.1 > , ζ 0 < δ 0.8 > , ζ 3 < δ 0 > } , { ζ 0 < δ 2.9 > , ζ 0 < δ 1.8 > } , { ζ 1 < δ 0.5 > , ζ 1 < δ 0.5 > , ζ 0 < δ 2 > } )
h ¯ S ϕ = ( { ζ 2 < δ 0.8 > , ζ 2 < δ 0.5 > } , { ζ 2 < δ 1 > , ζ 2 < δ 0.8 > , ζ 2 < δ 0.3 > } ,        { ζ 2 < δ 1.2 > , ζ 2 < δ 0.8 > , ζ 2 < δ 0.5 > } , { ζ 2 < δ 0.9 > , ζ 2 < δ 0.5 > } , { ζ 2 < δ 1 > , ζ 2 < δ 0.7 > , ζ 2 < δ 0.3 > } )
Next, we calculate the distance between the DHHFLEs in with those in h ¯ S ϕ * and h ¯ S ϕ ; the results are shown in Table 11 and Table 12, respectively.
Then, the relative distance d ¯ , defined in [33], can be obtained by the following equation:
d ¯ = d ( h ¯ S ϕ s j , h ¯ S ϕ ) ( d ( h ¯ S ϕ s j , h ¯ S ϕ * ) + d ( h ¯ S ϕ s j , h ¯ S ϕ ) ) .
The corresponding calculated results are presented in Table 13.
On the basis of the partition rules of the concordant and discordant sets, we can obtain the corresponding strong, moderate, and weak concordant sets, the strong, moderate, and weak discordant sets, and the indifferent sets, respectively.
Similarly to our proposed approach, the next step is to reckon on the DHHFLCI and DHHFLDI and to compare them to the critical values C ¯ and D ¯ . Then, we can get the concordant and discordant Boolean matrices as
B C = [ b c s t ] 5 × 5 = [ 1 1 0 0 0 1 0 0 1 0 1 1 1 1 1 1 1 1 1 0 ] , B D = [ b d s t ] 5 × 5 = [ 0 0 0 0 0 0 0 0 1 1 0 1 1 1 0 1 1 0 0 0 ] .
Then, the overall matrix can be given as B = [ b c s t × b d s t ] 5 × 5 = [ 0 0 0 0 0 0 0 0 1 0 0 1 1 1 0 1 1 0 0 0 ] .
Finally, the outranking graph is drawn as in Figure 9.
As seen in Table 14, the ranking results obtained by the ideal-based ELECTRE II method are distinct from those derived by the expected-HDD-based ELECTRE II approach. In particular, the relation between o p 2 , o p 3 and o p 3 , o p 4 is indeterminate in Figure 9, which can be explicitly determined by our proposed method. Next, two main reasons are given for this inconsistency:
(1) The ideas or the core points of these two methods are somewhat distinct. The ideal-based ELECTRE II method introduced by Liao et al., as the name implies, is an improved ELECTRE II method based on the ideal solution. The method believes that the smaller the difference with PIS and, simultaneously, the greater the difference with NIS, the more positive the evaluation value is, which is reasonable to some extent. However, without taking the variance into account, the determination of the ideal solution is apt to be influenced by the extreme value, which can be illustrated by the following example.
Example 3.
Suppose that h S ϕ s j = { ζ 2 < δ 3 > , ζ 1 < δ 1 > } and h S ϕ t j = { ζ 1 < δ 1 > , ζ 1 < δ 1 > } are the evaluation values of the options o p s and o p t under the criterion c r j . According to the definition of the ideal solution introduced by Liao, Yang, and Xu in 2018, we can obtain h S ϕ j + = { ζ 1 < δ 1 > , ζ 2 < δ 3 > } , h S ϕ j = { ζ 2 < δ 3 > , ζ 2 < δ 3 > } , d ( h S ϕ s j , h S ϕ j + ) = d ( h S ϕ t j , h S ϕ j + ) = 0.139 and d ( h S ϕ s j , h S ϕ j ) = d ( h S ϕ t j , h S ϕ j ) = 0.139 . On the basis of the idea of the ideal-based ELECTRE II method, it can be concluded that o p s is indifferent with o p t under the attribute c r j . Nonetheless, in line with the comparison rule of DHHFLEs, o p s is actually superior to o p t owing to its smaller (hesitant) deviation degree.
Obviously, the ranking result obtained by the ideal-based method may be inaccurate under situations similar to the abovementioned. Instead, our proposed method is based on the improved comparison rule of DHHFLEs, which is well considered and proven to be accurate.
(2) Compared to the ELECTRE II method introduced by Liao et al., our proposed method can address such issues where there are pairs of alternatives that are incomparable or the differences between them are not conspicuous. This is because our proposed method can locate the unreasonable position in the Boolean matrix and modify it; then, the weak outranking relation between the corresponding alternatives can be established. However, the ideal-based ELECTRE II method ignores the weak priority relation between two seemingly incomparable solutions. From a problem-solving perspective, our primary task is to determine the priority relationship between the two options, not the degree of priority between them. Hence, our presented method is more practical and effective than the ideal-based ELECTRE II method.
In a word, by virtue of the expected values and the HDDs of the evaluations, our presented method can take both the hesitant degree and the deviation degree into consideration and can eliminate the effect of the unreasonable value. In addition, it can identify the weak outranking relation between actions that are seemingly incomparable or where the differences between them are not conspicuous. Therefore, the proposed method is more reasonable and applicable to practice than some existing ELECTRE II methods.

7. Conclusions

With the deepening of the fourth industrial revolution, operations/production, supply-chain, management, and governance, as well as products and services, will be increasingly transformed and reshaped [47,48,49]. In this process, outsourcing public services has become an effective means for the government to improve service quality and reduce operating costs. In the process of outsourcing, choosing the most appropriate service provider is a pivotal issue for governments. By extending the ELECTRE II method to the DHHFL environment, we proposed a novel expected-HDD-based ELECTRE II method to tackle the PSO selection problem. The core content of this paper is shown as follows:
  • A new comparison method for DHHFLEs is proposed based on the definition of the expected value and the HDD of a DHHFLE, through which the magnitude relationship between any two alternatives under a specific criterion can be clearly determined.
  • Motivated by the PA operator, we present the support degree of a DHHFLE and put forward a novel weight-determination method for experts with respect to each criterion. In addition, based on the multi-objective optimization, a weight-determination method for criteria is introduced to handle the case where the criterion’s weights are completely unknown.
  • Combining the new comparison method and the weight-determination methods for experts and criteria, an improved DHHFL-ELECTRE II is constructed to deal with the problem of PSO selection. In addition, from the perspective of information form and decision-making processes, our method has universality in dealing with MCDM problems, and provides a simple, efficient, and convenient way to address the individual preferences of DMs.
  • Comparisons between the proposed method and existing methods, such as the method based on the PA operator, the classical ELECTRE II method, and the ideal-based ELECTRE II method, are given to illustrate that our method can identify more reasonable outcomes than the existing methods.
For the direction of our future research, our ideas are as follows: Firstly, for the DHHFLTS, the semantic difference between two adjacent linguistic terms is equal, which cannot reflect the preferences of DMs. Hence, we are going to conduct an in-depth study of unbalanced DHLTS [50]. Secondly, taking the psychology of people into account, we will consider a combination of regret theory [51] for multi-attribute decision making and using the regret–rejoicing function, which aims at reducing the regret value of experts, to measure the performance of alternatives.

Author Contributions

Conceptualization, Z.L. and P.L.; Formal analysis, D.W.; Funding acquisition, P.L.; Methodology, X.Z., X.W. and D.W.; Software, L.L.; Supervision, L.L. and X.W.; Writing—original draft, X.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Humanities and Social Sciences Research Project of Ministry of Education of China (No. 17YJA630065), the Shandong Provincial Natural Science Foundation of China (No. ZR2017MG007), the Project of Shandong Province Higher Educational Science and Technology Program (No. J16LN25), the Special Funds of Taishan Scholars Project of Shandong Province (No. ts201511045), and the National Science Foundation of China (No.71771140).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Yager, R.R. The power average operator. IEEE Trans Syst. Man Cybern. Part A Syst. Hum. 2001, 31, 724–731. [Google Scholar] [CrossRef]
  2. Yun, J.J.; Park, K.B.; Hahm, S.D. Basic income with high open innovation dynamics: The way to the entrepreneurial state. J. Open Innov. Technol. Mark. Complex. 2019, 5, 41. [Google Scholar] [CrossRef] [Green Version]
  3. Yun, J.H.J.; Won, D.K.; Park, K. Dynamics from open innovation to evolutionary change. J. Open Innov. Technol. Mark. Complex. 2016, 2, 7. [Google Scholar] [CrossRef] [Green Version]
  4. Yun, J.H.J.; Won, D.K.; Park, K.B. Entrepreneurial cyclical dynamics of open innovation. J. Evol. Econ. 2018, 28, 1151–1174. [Google Scholar] [CrossRef]
  5. Kim, Y.; Lee, M. Typology and Unified Model of the Sharing Economy in Open Innovation Dynamics. J. Open Innov. Technol. Mark. Complex. 2019, 5, 102. [Google Scholar] [CrossRef] [Green Version]
  6. Oganisjana, K.; Kozlovskis, K. The Identification of Opportunities for Innovations through Collecting Problems from Citizens. J. Open Innov. Technol. Mark. Complex. 2019, 5, 76. [Google Scholar] [CrossRef] [Green Version]
  7. Lee, I.; Kim, E. Factors Affecting the Outbound Open Innovation Strategies in Pharmaceutical Industry: Focus on Out-Licensing Deal. J. Open Innov. Technol. Mark. Complex. 2019, 5, 73. [Google Scholar] [CrossRef] [Green Version]
  8. Yun, J.H.J. How do we conquer the growth limits of capitalism? Schumpeterian Dynamics of Open Innovation. J. Open Innov. Technol. Mark. Complex. 2015, 1, 17. [Google Scholar] [CrossRef] [Green Version]
  9. Golooba-Mutebi, F. Devolution and outsourcing of municipal services in Kampala city, Uganda: An early assessment. Public Adm. Dev. Int. J. Manag. Res. Pract. 2003, 23, 405–418. [Google Scholar] [CrossRef]
  10. Moon, J.; Choe, Y.C.; Chung, M.; Jung, G.H.; Swar, B. IT outsourcing success in the public sector: Lessons from e-government practices in Korea. Infdev 2016, 32, 142–160. [Google Scholar] [CrossRef]
  11. Samsudin, N.M.; Hashim, R.; Fuzi, S.F.S.M. Electronic government outsourcing issues in Malaysia. J. Outsourc. Organ. Inf. Manag. 2013, 2013, 1. [Google Scholar] [CrossRef]
  12. Aman, A.C., Jr. An administrative law perspective on government social service contracts: Outsourcing prison health care in New York City. Indiana J. Glob. Leg. Stud. 2007, 14, 301–328. [Google Scholar] [CrossRef] [Green Version]
  13. Heinecken, L. Outsourcing public security: The unforeseen consequences for the military profession. Armed Forces Soc. 2014, 40, 625–646. [Google Scholar] [CrossRef]
  14. Peng, H.G.; Shen, K.W.; He, S.S.; Zhang, H.Y.; Wang, J.Q. Investment risk evaluation for new energy resources: An integrated decision support model based on regret theory and ELECTRE III. Energy Convers. Manag. 2019, 183, 332–348. [Google Scholar] [CrossRef]
  15. Zadeh, L.A. Fuzzy sets. Infect. Control. 1965, 8, 338–353. [Google Scholar] [CrossRef] [Green Version]
  16. Mizumoto, M.; Tanaka, K. Some properties of fuzzy sets of type 2. Infect. Control. 1976, 31, 312–340. [Google Scholar] [CrossRef] [Green Version]
  17. Atanassov, K.T. More on intuitionistic fuzzy sets. Fuzzy Sets Syst. 1989, 33, 37–45. [Google Scholar] [CrossRef]
  18. Torra, V. Hesitant fuzzy sets. Int. J. Intell. Syst. 2010, 25, 529–539. [Google Scholar] [CrossRef]
  19. Rodriguez, R.M.; Martinez, L.; Herrera, F. Hesitant fuzzy linguistic term sets for decision making. IEEE Trans. Fuzzy Syst. 2011, 20, 109–119. [Google Scholar] [CrossRef]
  20. Martı, L.; Herrera, F. An overview on the 2-tuple linguistic model for computing with words in decision making: Extensions, applications and challenges. Inf. Sci. 2012, 207, 1–18. [Google Scholar]
  21. Pang, Q.; Wang, H.; Xu, Z. Probabilistic linguistic term sets in multi-attribute group decision making. Inf. Sci. 2016, 369, 128–143. [Google Scholar] [CrossRef]
  22. Gou, X.; Liao, H.; Xu, Z.; Herrera, F. Double hierarchy hesitant fuzzy linguistic term set and MULTIMOORA method: A case of study to evaluate the implementation status of haze controlling measures. Inf. Fusion 2017, 38, 22–34. [Google Scholar] [CrossRef]
  23. Gou, X.; Xu, Z.; Liao, H.; Herrera, F. Multiple criteria decision making based on distance and similarity measures under double hierarchy hesitant fuzzy linguistic environment. Comput. Ind. Eng. 2018, 126, 516–530. [Google Scholar] [CrossRef]
  24. Liu, X.; Wang, X.; Qu, Q.; Zhang, L. Double hierarchy hesitant fuzzy linguistic mathematical programming method for MAGDM based on Shapley values and incomplete preference information. IEEE Access 2018, 6, 74162–74179. [Google Scholar] [CrossRef]
  25. Gou, X.; Xu, Z.; Herrera, F. Consensus reaching process for large-scale group decision making with double hierarchy hesitant fuzzy linguistic preference relations. Knowl. Based Syst. 2018, 157, 20–33. [Google Scholar] [CrossRef]
  26. Krishankumar, R.; Subrajaa, L.S.; Ravichandran, K.S.; Kar, S.; Saeid, A.B. A Framework for Multi-Attribute Group Decision-Making Using Double Hierarchy Hesitant Fuzzy Linguistic Term Set. Int. J. Fuzzy Syst. 2019, 21, 1130–1143. [Google Scholar] [CrossRef]
  27. Wei, C.C.; Cheng, Y.L.; Lee, K.L. How to select suitable manufacturing information system outsourcing projects by using TOPSIS method. Int. J. Prod. Res. 2019, 57, 4333–4350. [Google Scholar] [CrossRef]
  28. Yadav, G.; Mangla, S.K.; Luthra, S.; Jakhar, S. Hybrid BWM-ELECTRE-based decision framework for effective offshore outsourcing adoption: A case study. Int. J. Prod. Res. 2018, 56, 6259–6278. [Google Scholar] [CrossRef] [Green Version]
  29. Liu, Z.; Liu, P.; Liang, X. Multiple attribute decision-making method for dealing with heterogeneous relationship among attributes and unknown attribute weight information under q-rung orthopair fuzzy environment. Int. J. Intell. Syst. 2018, 09, 1900–1928. [Google Scholar] [CrossRef]
  30. Ji, P.; Zhang, H.Y.; Wang, J.Q. Selecting an outsourcing provider based on the combined MABAC–ELECTRE method using single-valued neutrosophic linguistic sets. Comput. Ind. Eng. 2018, 120, 429–441. [Google Scholar] [CrossRef] [Green Version]
  31. Benayoun, R.; Roy, B.; Sussman, B. ELECTRE: Une méthode pour guider le choix en présence de points de vue multiples. In Note de Travail 49, SEMA-METRA International, Direction Scientifique; KAP: Berlin, Germany, 1966. [Google Scholar]
  32. Hashemi, H.; Mousavi, S.M.; Zavadskas, E.K.; Chalekaee, A.; Turskis, Z. A New Group Decision Model Based on Grey-Intuitionistic Fuzzy-ELECTRE and VIKOR for Contractor Assessment Problem. Sustainability 2018, 10, 1635. [Google Scholar] [CrossRef] [Green Version]
  33. Micale, R.; Giallanza, A.; Russo, G.; La Scalia, G. Selection of a Sustainable Functional Pasta Enriched with Opuntia Using ELECTRE III Methodology. Sustainability 2017, 9, 885. [Google Scholar] [CrossRef] [Green Version]
  34. Hokkanen, J.; Salminen, P.; Rossi, E.; Ettala, M. The choice of a solid waste management system using the ELECTRE II decision-aid method. Waste Manag. Res. 1995, 13, 175–193. [Google Scholar] [CrossRef]
  35. Devadoss, A.V.; Rekha, M. A New Intuitionistic Fuzzy ELECTRE II approach to study the Inequality of women in the society. Glob. J. Pure Appl. Math. 2017, 13, 6583–6594. [Google Scholar]
  36. Wen, Z.; Yu, Y.; Yan, J. Best available techniques assessment for coal gasification to promote cleaner production based on the ELECTRE-II method. J. Clean. Prod. 2016, 129, 12–22. [Google Scholar] [CrossRef]
  37. Chen, N.; Xu, Z. Hesitant fuzzy ELECTRE II approach: A new way to handle multi-criteria decision making problems. Inf. Sci. 2015, 292, 175–197. [Google Scholar] [CrossRef]
  38. Pan, L.; Ren, P.; Xu, Z. Therapeutic schedule evaluation for brain-metastasized non-small cell lung cancer with a probabilistic linguistic ELECTRE II method. Int. J. Environ. Res. 2018, 15, 1799. [Google Scholar] [CrossRef] [Green Version]
  39. Vinodh, S.; Girubha, R.J. Sustainable concept selection using ELECTRE. Clean Technol. Environ. Policy 2012, 14, 651–656. [Google Scholar] [CrossRef]
  40. Liu, Z.; Wang, S.; Liu, P. Multiple attribute group decision making based on q-rung orthopair fuzzy Heronian mean operators. Int. J. Intell. Syst. 2018, 12, 2341–2363. [Google Scholar] [CrossRef]
  41. Wan, S.P.; Xu, G.L.; Dong, J.Y. Supplier selection using ANP and ELECTRE II in interval 2-tuple linguistic environment. Inf. Sci. 2017, 385, 19–38. [Google Scholar] [CrossRef]
  42. Liao, H.C.; Yang, L.Y.; Xu, Z.S. Two new approaches based on ELECTRE II to solve the multiple criteria decision making problems with hesitant fuzzy linguistic term sets. Appl. Soft Comput. 2018, 63, 223–234. [Google Scholar] [CrossRef]
  43. Lin, M.; Chen, Z.; Liao, H.; Xu, Z. ELECTRE II method to deal with probabilistic linguistic term sets and its application to edge computing. Nonlinear Dyn. 2019, 96, 2125–2143. [Google Scholar] [CrossRef]
  44. Figueira, J.R.; Greco, S.; Roy, B.; Słowiński, R. ELECTRE Methods: Main Features and Recent Developments. In Handbook of Multicriteria Analysis; Springer: Berlin/Heidelberg, Germany, 2010; pp. 51–89. [Google Scholar]
  45. Ju, Y. A new method for multiple criteria group decision making with incomplete weight information under linguistic environment. Appl. Math. Model. 2014, 38, 5256–5268. [Google Scholar] [CrossRef]
  46. Wei, G.; Lu, M. Pythagorean fuzzy power aggregation operators in multiple attribute decision making. Int. J. Intell. Syst. 2018, 33, 169–186. [Google Scholar] [CrossRef]
  47. Pyka, A.; Bogner, K.; Urmetzer, S. Productivity Slowdown, Exhausted Opportunities and the Power of Human Ingenuity—Schumpeter Meets Georgescu-Roegen. J. Open Innov. Technol. Mark. Complex. 2019, 5, 39. [Google Scholar] [CrossRef] [Green Version]
  48. Cooke, P. World turned upside down: Entrepreneurial decline, its reluctant myths and troubling realities. J. Open Innov. Technol. Mark. Complex. 2019, 5, 22. [Google Scholar] [CrossRef] [Green Version]
  49. Lee, M.H.; Yun, J.H.J.; Pyka, A. How to respond to the fourth industrial revolution, or the second information technology revolution? Dynamic new combinations between technology, market, and society through open innovation. J. Open Innov. Technol. Mark. Complex. 2018, 4, 21. [Google Scholar] [CrossRef] [Green Version]
  50. Fu, Z.; Liao, H. Unbalanced double hierarchy linguistic term set: The TOPSIS method for multi-expert qualitative decision making involving green mine selection. Inf. Fusion 2019, 51, 271–286. [Google Scholar] [CrossRef]
  51. Connolly, T.; Zeelenberg, M. Regret in decision making. Curr. Dir. Psychol. Sci. 2002, 11, 212–216. [Google Scholar] [CrossRef]
Figure 1. Four distinct shapes of the inner-hierarchy LTS.
Figure 1. Four distinct shapes of the inner-hierarchy LTS.
Sustainability 12 02315 g001
Figure 2. The decision-making process.
Figure 2. The decision-making process.
Sustainability 12 02315 g002
Figure 3. Determine the decision maker’s (DM’s) weight.
Figure 3. Determine the decision maker’s (DM’s) weight.
Sustainability 12 02315 g003
Figure 4. Determine the criteria’s weight.
Figure 4. Determine the criteria’s weight.
Sustainability 12 02315 g004
Figure 5. The strongly outranking graph.
Figure 5. The strongly outranking graph.
Sustainability 12 02315 g005
Figure 6. The final outranking graph.
Figure 6. The final outranking graph.
Sustainability 12 02315 g006
Figure 7. The strong outranking graph.
Figure 7. The strong outranking graph.
Sustainability 12 02315 g007
Figure 8. The weak outranking graph.
Figure 8. The weak outranking graph.
Sustainability 12 02315 g008
Figure 9. The outranking graph.
Figure 9. The outranking graph.
Sustainability 12 02315 g009
Table 1. Related symbols involved in formulas and their descriptions.
Table 1. Related symbols involved in formulas and their descriptions.
SymbolsDescriptionSymbolsDescription
t The subscript of the LT in outer LTS κ The subscript of the LT in inner LTS
ε The maximum subscript of the outer LTS w ξ ( k ) The weight of the k-th expert under the criterion c r ξ
ι The maximum subscript of the inner LTS ϖ ξ The weight of criterion c r ξ
N * The set of positive integers ω c The attitude weight of concordance
Δ The number of elements in DHHFLE ω = The attitude weight of indifference
ϒ The optimized parameter ω d The attitude weight of discordance
ρ and ρ 1 Transformation functions between the real numbers and the elements in DHHFLEs ξ Lagrange multiplier
Table 2. Description of critical evaluation index.
Table 2. Description of critical evaluation index.
Critical AttributeDescription
Economics ( c r 1 )This index refers to the developing cost of the outsourcer.
Operability ( c r 2 ) This criterion is based on the available degree of the system.
Stability ( c r 3 )This criterion depends on the compressive ability and flexibility.
Market share ( c r 4 )This index can reflect the visibility and reliability of the company.
User experience ( c r 5 )This refers to the feedback from the previous users.
Table 3. The support degrees of h S ϕ i 1 ( 1 ) from h S ϕ i 1 ( q ) ( q = 2 , 3 , 4 ) .
Table 3. The support degrees of h S ϕ i 1 ( 1 ) from h S ϕ i 1 ( q ) ( q = 2 , 3 , 4 ) .
sup ( h S ϕ i 1 ( 1 ) , h S ϕ i 1 ( q ) ) q = 2 q = 3 q = 4
i = 1 0.97220.83330.8889
i = 2 10.94440.7778
i = 3 0.91670.77780.9444
i = 4 0.94440.83330.8056
i = 5 0.861110.8889
Table 4. The distance between the evaluation and the double hierarchy hesitant fuzzy linguistic positive ideal solution (DHHFL-PIS).
Table 4. The distance between the evaluation and the double hierarchy hesitant fuzzy linguistic positive ideal solution (DHHFL-PIS).
h d ( h S ϕ i j , h S ϕ j + ) j = 1 j = 2 j = 3 j = 4 j = 5
i = 1 0.19030.0990.15870.07250.0526
i = 2 0.07970.2580.24250.1660.1441
i = 3 00.33070.52960.41880.3350
i = 4 0.42470000
i = 5 0.20710.08940.1380.08460.0522
Table 5. The distance between the evaluation and the DHHFL negative ideal solution (DHHFL-NIS).
Table 5. The distance between the evaluation and the DHHFL negative ideal solution (DHHFL-NIS).
h d ( h S ϕ i j , h S ϕ j ) j = 1 j = 2 j = 3 j = 4 j = 5
i = 1 0.23430.23170.37110.34620.3206
i = 2 0.3450.07270.28710.25280.1909
i = 3 0.42470000
i = 4 00.33070.52960.41880.3350
i = 5 0.21760.24130.39160.33420.3309
Table 6. The expected value E v ( h ¯ S ϕ i j ) .
Table 6. The expected value E v ( h ¯ S ϕ i j ) .
E v ( h ¯ S ϕ i j ) j = 1 j = 2 j = 3 j = 4 j = 5
i = 1 0.23180.23160.30620.30130.2969
i = 2 0.31100.15260.25220.23880.2081
i = 3 0.65710.12530.11820.12570.1286
i = 4 0.12820.52700.61160.37070.3017
i = 5 0.22270.23570.32160.29190.3083
Table 7. The hesitant deviation degree h σ ( h ¯ S ϕ i j ) .
Table 7. The hesitant deviation degree h σ ( h ¯ S ϕ i j ) .
h σ ( h ¯ S ϕ i j ) j = 1 j = 2 j = 3 j = 4 j = 5
i = 1 0.00190.00310.00320.00120.0056
i = 2 0.00160.00340.00420.00130.0023
i = 3 0.01910.00190.00190.00070.0017
i = 4 0.00040.03720.03070.00180
i = 5 0.00130.00090.00290.00120.0065
Table 8. The ranking result obtained by the double hierarchy hesitant fuzzy linguistic weighted power average (DHHFLWPA) operator.
Table 8. The ranking result obtained by the double hierarchy hesitant fuzzy linguistic weighted power average (DHHFLWPA) operator.
Method h σ ( h ¯ S ϕ i ) ,   E v ( h ¯ S ϕ i ) Ranking
DHHFLGPA operator h σ ( h ¯ S ϕ 1 ) = 0.7958 ;   E v ( h ¯ S ϕ 1 ) = 0.0043
h σ ( h ¯ S ϕ 2 ) = 0.7311 ;   E v ( h ¯ S ϕ 2 ) = 0.005
h σ ( h ¯ S ϕ 3 ) = 0.7212 ;   E v ( h ¯ S ϕ 3 ) = 0.0221
h σ ( h ¯ S ϕ 4 ) = 0.8962 ;   E v ( h ¯ S ϕ 4 ) = 0.0083
h σ ( h ¯ S ϕ 5 ) = 0.8003 ;   E v ( h ¯ S ϕ 5 ) = 0.004
o p 4 > o p 5 > o p 1 > o p 2 > o p 3
Table 9. The outranking relation between the alternate options.
Table 9. The outranking relation between the alternate options.
Alternatives o p 1 o p 2 o p 3 o p 4 o p 5
o p 1 - O S O W --
o p 2 -- O W --
o p 3 -----
o p 4 O S O S O W --
o p 5 O W O S O W --
Table 10. The values of r ( o p ) and r ( o p ) .
Table 10. The values of r ( o p ) and r ( o p ) .
Options o p 1 o p 2 o p 3 o p 4 o p 5
r ( o p ) 23411
r ( o p ) 32144
Table 11. The distance between the DHHFL elements (DHHFLEs) in R ¯ and h ¯ S ϕ * .
Table 11. The distance between the DHHFL elements (DHHFLEs) in R ¯ and h ¯ S ϕ * .
d ( h ¯ S ϕ s j , h ¯ S ϕ * ) j = 1 j = 2 j = 3 j = 4 j = 5
s = 1 0.4253 0.2954 0.3054 0.0695 0.0319
s = 2 0.3461 0.3744 0.3594 0.1319 0.1207
s = 3 0 0.4018 0.4933 0.2450 0.2001
s = 4 0.5289 00 0 0.0271
s = 5 0.4345 0.2913 0.2900 0.0788 0.0205
Table 12. The distance between the DHHFLEs in R ¯ and h ¯ S ϕ .
Table 12. The distance between the DHHFLEs in R ¯ and h ¯ S ϕ .
d ( h ¯ S ϕ s j , h ¯ S ϕ ) j = 1 j = 2 j = 3 j = 4 j = 5
s = 1 0.1036 0.1064 0.1879 0.1756 0.1682
s = 2 0.1828 0.0274 0.1339 0.1132 0.0794
s = 3 0.5289 0000
s = 4 00.4018 0.4933 0.2450 0.1731
s = 5 0.0944 0.1104 0.2034 0.1662 0.1796
Table 13. The relative distance between the DHHFLEs in R ¯ and the ideal solution.
Table 13. The relative distance between the DHHFLEs in R ¯ and the ideal solution.
d ¯ j = 1 j = 2 j = 3 j = 4 j = 5
s = 1 0.1959 1.1253 0.7849 1.1257 0.7953
s = 2 0.6282 1.7919 1.1182 1.1257 1.1286
s = 3 1.9932 1.9932 2.1182 2.1257 2.1286
s = 4 2.1282 1.6938 1.0256 0.1257 1.1286
s = 5 1.1282 1.1253 0.7849 1.1257 0.7953
Table 14. The ranking results.
Table 14. The ranking results.
MethodRanking
Proposed method o p 4 > o p 5 > o p 1 > o p 2 > o p 3
The ideal-based ELECTRE II method o p 4 > o p 5 > o p 1 ;
o p 3 , o p 4 and o p 3 , o p 2 are incomparable.

Share and Cite

MDPI and ACS Style

Liu, Z.; Zhao, X.; Li, L.; Wang, X.; Wang, D.; Liu, P. Selecting a Public Service Outsourcer Based on the Improved ELECTRE II Method with Unknown Weight Information under a Double Hierarchy Hesitant Linguistic Environment. Sustainability 2020, 12, 2315. https://0-doi-org.brum.beds.ac.uk/10.3390/su12062315

AMA Style

Liu Z, Zhao X, Li L, Wang X, Wang D, Liu P. Selecting a Public Service Outsourcer Based on the Improved ELECTRE II Method with Unknown Weight Information under a Double Hierarchy Hesitant Linguistic Environment. Sustainability. 2020; 12(6):2315. https://0-doi-org.brum.beds.ac.uk/10.3390/su12062315

Chicago/Turabian Style

Liu, Zhengmin, Xiaolan Zhao, Lin Li, Xinya Wang, Di Wang, and Peide Liu. 2020. "Selecting a Public Service Outsourcer Based on the Improved ELECTRE II Method with Unknown Weight Information under a Double Hierarchy Hesitant Linguistic Environment" Sustainability 12, no. 6: 2315. https://0-doi-org.brum.beds.ac.uk/10.3390/su12062315

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop