Next Article in Journal
A Theoretical Analysis for Mixed Convection Flow of Maxwell Fluid between Two Infinite Isothermal Stretching Disks with Heat Source/Sink
Next Article in Special Issue
Unified Fuzzy Divergence Measures with Multi-Criteria Decision Making Problems for Sustainable Planning of an E-Waste Recycling Job Selection
Previous Article in Journal
Tool Orientation Optimization for Disk Milling Process Based on Torque Balance Method
Previous Article in Special Issue
Simulation-Based Positioning of Circular Economy Manager’s Skills in Construction Projects
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Foresight Based on MADM-Based Scenarios’ Approach: A Case about Comprehensive Sustainable Health Financing Models

by
Sarfaraz Hashemkhani Zolfani
1,*,
Reza Dehnavieh
2,
Atousa Poursheikhali
3,
Olegas Prentkovskis
4 and
Payam Khazaelpour
5
1
School of Engineering, Catholic University of the North, Larrondo, Coquimbo 1281, Chile
2
Institute for Futures Studies in Health, Health Foresight and Innovation Research Center, Kerman University of Medical Sciences, Kerman 7616913555, Iran
3
Institute for Futures Studies in Health, Modeling in Health Research Center, Kerman University of Medical Sciences, Kerman 7616913555, Iran
4
Department of Mobile Machinery and Railway Transport, Vilnius Gediminas Technical University, Plytinės g. 27, LT-10105 Vilnius, Lithuania
5
Department of Mathematic and Statistics, Curtin University, GPO Box U1987, Perth, WA 6845, Australia
*
Author to whom correspondence should be addressed.
Submission received: 26 October 2019 / Revised: 9 December 2019 / Accepted: 16 December 2019 / Published: 27 December 2019

Abstract

:
As indicated by a worldwide common perspective about health and sustainable health systems, the health structure as a part of public health is a key theme of many societies. The future is shaped by probable future scenarios, for which dealing practically has many complications. This study is focused on the future scenarios for a comprehensive sustainable health financing model to support a superior structure for a decision and policy-making pilot for the society. This aim is followed based on multiple attribute decision making (MADM)-based scenarios using two MADM methods, step-wise weight assessment ratio analysis (SWARA) and weighted aggregated sum product assessment (WASPAS), as a hybrid model which is the first real case study of the approach. Four main probable future scenarios are identified and selected based on experts’ viewpoints about sustainable health financing models. These scenarios include membership in the World Trade Organization (WTO), dynamic basic insurance, international cooperation, and effective resources management. The process of evaluating based on the approach works as a wider picture, including all criteria and alternatives together. Sustainable medical services, empowering the private sector in both production and technology, and employing international managers took place as the top priority for considering the most applicable alternatives in the future. This structure is designed and developed in Iran’s context, and the Institute for Futures Studies in Health is the pilot of the research.

1. Introduction

The health system is supposed to function properly in four determined aspects to accomplish three fundamental objectives of health promotion, having reasonable financial contribution and responsiveness. In addition, concerning the growing challenges of health systems such as resources limitation and increased demand, neglecting variable circumstance and requirements would have detrimental consequences and lead to damaging failures (Coiera and Hovenga, 2007) [1]. These functions are stewardship, resource generation, financing, and services provision (WHO report, 2000) [2]. Financing is considered one of the most essential functions of health systems.
Health system financing is the procedure by which revenues are collected from primary and secondary sources, which are accumulated in fund pools and allocated to specific activities of providers (1). Consumers, the government, social insurance, and private health insurance payments constitute four main sources of out-of-pocket payments in health system financing (Markel, 2014) [3]. In this respect, the objectives of the financing function of the health system are adequate funding, equitable financial access to quality health services, protection from financial costs, and efficiency in resource mobilization allocation and usage. To obtain these objectives, three main functions are identified, including purchasing services, pooling funds, and collecting funds (WHO report, 2000) [2]. The health-financing system is a highly contextual subject that needs to be addressed exclusively in each country (Moon, 2014; Wang et al., 2016) [4,5].
Considering other areas of science in which the MADM-based scenario approach has been demonstrated, the MADM-based scenario approach was implemented to select bicycle chain materials for strategic success in an Indian manufacturing scenario (Singh & Kumar, 2012) [6]. An MADM-based scenario was applied to select the material alternatives in bicycle manufacturing. Another example of using MADM-based scenario notion takes advantage of implementing the high average of subscribers’ service quality, namely the Quality of Service (QoS), where different radio access technologies are implemented using different handover criteria to link the continuity of the service (Zineb, Ayadi, & Tabbane, 2017) [7]. Consequently, the MADM-based scenario approach is worked out in different fields and found to be reliable for prioritizing alternatives.
Increasing demand for health services and the increasing costs of health services supplies comprised two main sources for expenditure growth in the health sector that affect drivers and dynamics. The growing burden of disease has been asserted as one of the causes of increasing the demand for health services that stems from the aging population and unhealthy lifestyles. Advanced technologies and innovative strategy have led to rising unit cost of care. Additionally, vested interests and incentive systems have led to a suboptimal allocation of resources (2). Unit cost increment and substandard resource allocation are both sources of expanding the expenditure growth for supplying health services. These specified drivers could potentially be the unsustainability factors in health system financing (Industry agenda, 2012; Ooms et al., 2014) [8,9].
There are vital indicators in health financing monitoring and analyzing listed in Table 1 whose future status can be determined in different scenarios of health financing (WHO report, 2004) [10]:
The World Business Council for Sustainable Development (WBCSD) acknowledged that the method of managing health systems is unsustainable i.e., the costs that need to be afforded are higher, and on the other side, less deliveries are achieved than expected (NHS report, 2009) [11]. Sustainable systems are those that perpetuate despite their surrounding changes and the function for their main objectives (Coiera and Hovenga, 2007) [1]. Health is a vital issue in many nations and is directly related to a sustainable community.
Scenarios can alter the capabilities of a system such as a health system to perceive the nature and effect of the future. Therefore, scenarios can help sense the future and its prerequisites that need to be dealt with (Gnatzy and Moser, 2012; Gille and Houy, 2014; Rhisiart et al., 2015) [12,13,14]. In the general structure of countries, the health structure is remarkably diverse, despite having some relatively comparative aspects. Considerably, Iran is not an exception, setting important strategic plans for upgrading the general health structure of the country.
Speaking of strategic plans, there are two general approaches of using public taxation, called the Boursig approach and Bimsark approach, i.e., social health insurance in which the latter is followed in Iranian policy making. Public budget, social health insurances, the family’s pocket pays, and private insurance are the financial structures for revenue gathering in Iran (Keshavarzian, 2014) [15].
Concerning the contexts of Iran, strategic planning, futures studies, decision making, and policy making are required to create a holistic picture for managing the future in superior ways. Each of the specialized plans need time to be developed and progressed alongside thoroughly considering the health structure.
In the current situation, the general position of the country is so dynamic and seems to have experienced some improvements compared to the previous decade. It implies an appropriate situation for the country to be developed in different aspects, especially in public health with a sustainable structure. Future scenarios as a framework can be conducive in this procedure and generally can be considered as the backbone to support this idea in the best way. In general, scenarios are qualitative, and there are different ways to evaluate them. It is believed that quantitative evaluations are more accurate in comparison with qualitative structures if quantitative evaluation is possible.
“Multiple attribute decision making (MADM)-based scenarios” is the latest perspective to consider scenarios in a complete quantitative way (Hashemkhani Zolfani et al., 2016a) [16]. In comparison with other methods and perspectives, this structure is independent and takes future scenarios into account in its structure and methodology, meaning that it enjoys the expert-based structure, which is similar to other decision-making methods. Facing the related future of the policies and strategic decisions is too complicated. So, this approach has an advantage to lead policy makers toward having a better sight on the critical points and topics. In addition, creating a wider picture is something that is not common among approaches and methods, especially toward future scenarios and events. For this reason, the health system of countries appears as a critical and serious topic on which governments are spending time all around the world. Comparably, Iran’s health structure is an evolutionary path through which the development of foresights models importantly seems to be necessary for the country. Finally, coming to the expert-based structure of this methodology, an institution (Institute for Futures Studies in Health) was selected as the pilot for this study.
In this study, probable related future scenarios of health financing will be directed in an “MADM-based scenarios” structure for analyzing the general environment of the future of the health structure of the country in a sustainable way. Two MADM methods, SWARA and WASPAS, will be applied as a suitable hybrid MADM model and a detailed discussion will be presented finally.

2. Literature Review

In this section, the sustainable health structure and current state of the health system in Iran are discussed as two influential issues.

2.1. Sustainable Health

Sustainable development has been defined as “meeting the needs of people here and at the present time, without prejudicing the needs of others elsewhere and in the future” (Pencheon, 2015) [17].
The primary aspects of sustainable development are economic, social, and environmental. However, sustainable development has been expanded into other dimensions according to the contexts of the studied situation. In the related context of the present study, the governance dimension was introduced as the new dimension. The fundamental issue is the continuous and harmonious interactions of all these dimensions to create the desired balance and construct sustainable systems. Health is critical to achieving these four pillars (Sustainable Development Solutions Network, 2014) [18].
As claimed by Liaropoulos and Goranitis [19], economic crises have brought unprecedented attention to the healthcare establishment based on sustainability. For this reason, sustainable healthcare becomes fundamentally pertinent to sustainable financing. Wages decrease due to economic crises and unemployment matters, and accordingly healthcare insurance cover rises with medical costs. To tackle the problem of increasing costs, an MADM-based scenario is applied to prioritize sustainable healthcare criteria and their future impacts to shed lights on future sustainable healthcare financing under sanction circumstances.
To achieve sustainability in a health system, all the functions of the health system should collaborate in a balanced and sustainable form in fulfilling their tasks consistent with sustainability requirements (Smith et al., 2008) [20]. A sustainable health model can be achieved by provisioning high quality and improved health services, and it can guarantee the perceived safety, improve life quality, enhance well-being, and promote public health. A sustainable health system not only deals with diseases but also with dimensions and determinants of health (Timmers, 2014) [21].
Health systems are central to the new agenda in which the 13 health targets are proposed to cover most national health concerns. Universally, health coverage achieving access to quality health care is stated in declaration states. Universal health coverage provides several opportunities such as inclusion, equity, financial protection, livelihood generation, a common global vision, and a unified global rallying point. UHC includes health protection, promotion, prevention, treatment, rehabilitation, and palliation. Health is positioned as the major contributor to the other sustainable development goals (SDGs); by overlooking health, many of the other goals would remain inconclusive (Agenda for sustainable development 2015) [22].
As one of the widespread problems of the millennium in goal development, in the new agenda after the segmentation of countries, health systems are required to provide integrated and fair services considering the costs and resources.
The sustainable development goals are intertwined and indivisible so that progress in one area relies on progress in many other areas as the synergies occur among health, education, nutrition, social protection, and conflict.
Most importantly, the sustainability of a health system is highly dependent on its sustainable financing, as it can ensure a method for financial contributions of prepayment for health care. It aims to reduce the risk share among the population, avoid catastrophic health-care expenditure, and improve the individual’s health status (WHA, 2005) [23].

2.2. Current State of Health System Financing in Iran

Health is currently generally perceived as a fundamental right, and the urgency of some global health issues has pushed global health policy to the top of the international agenda (Gottret and Schieber, 2000) [24]. Health financing is a standout amongst the most imperative components in health systems to promote health. Health financing refers to the “function of a health system concerned with the mobilization, accumulation and allocation of money to cover the health needs of the people, individually and collectively, in the health system the purpose of health financing is to make funding available, as well as to set the right financial incentives to providers, to ensure that all individuals have access to effective public health and personal health care” (The World Health Report, 2000) [25].
Health financing is principal to the capacity of health systems to maintain and improve human welfare. At the extreme, without the necessary funds, no health workers would be employed, no medicines would be accessible, and no health promotion or prevention would occur.
The Iranian health structure system has an egalitarian perspective, although there are so many challenges in between. After the revolution, around 40 years ago, health insurance started covering people, and the government still has been trying to support people in terms of health insurance (Rashidian et al., 2018) [26]. The Iranian insurance system is a combination of all sectors, both public and private, etc.; however, it is mostly public. Primary care payments mostly are based on subsidy and capitation, while hospital payments are considered according to the general costs and services of physicians (Almaspoor Khangah et al., 2017) [27]. In Iran, primary health care is financed and delivered predominantly by the government. Secondary and tertiary cares are delivered both publicly and privately (Kavosi et al., 2012) [28].
Since May 2014, after President Rouhani’s government starting day, his new policies in the government about Ministry of Health and Medical Education (MoHME) followed new strategies and plans in the health structure of the country as a “Health System Transformation Plan” (HSTP) in terms of increasing the equity in different regions of Iran where people are equally treated while categorized in differently economic levels (Olyaeemanesh et al., 2018) [29].
The main public health insurers are as follows.
  • The Social Security Organization is one of the largest health insurers in Iran. All the people employed in the formal divisions, except for the government authorities and administration individuals, contribute to the fund and take advantage of this organization.
  • The Medical Service Insurance Organization provides health insurance for government employees, students, and provincial inhabitants. The rural population, who were not covered by any insurance, became qualified to receive benefits voluntarily in 2000.
  • The Military Personnel Insurance Organization provides health insurance for military personnel.
  • The Emdade-Emam Committee provides health insurance for the uninsured poor. Although a small rate of Iranian individuals is not secured by any of the insurance coverage associations, some of them have enlisted in two diverse medical coverage arranges, which are empowered by a small premium (Mehrdad, 2009) [30].

3. Methodology

To date, various methods have been developed and introduced in MADM; however, the general concept of this research is based on the new future-oriented MADM and MADM-based scenarios, which is presented to make future scenarios quantitative and multi-attribute based, simultaneously (Hashemkhani Zolfani et al., 2016a) [16]. Each scenario can be considered separately, and each MADM-based scenario is utilized for making decisions about forthcoming situations. This new methodology has been presented to empower new future-based trends in the MADM field such as prospective MADM (Hashemkhani Zolfani et al., 2016b; Hashemkhani Zolfani et al., 2018b; Hashemkhani Zolfani and Masaeli, 2019) [31,32,33]. “MADM-based scenarios” are in contrast with scenarios-based MADM. The concept of MADM-based scenarios is not intended to assess the scenarios as, the MADM is the core concept, while in another previous perspective, scenarios are considered to be the core area under study. In this concept, scenarios support presenting a superior model with MADM methods in practice and eventually, a final evaluation can be performed and an ultimate decision can be made.
A foresight comprehensive plan can be completely different in future scenarios. In a foresight strategic policy, pre-planning is considered in all possible scenarios. It can be inferred that future scenarios are similar in most components, although some differences exist among the criteria, alternatives, and relative importance. A final analysis is structured respecting all scenarios and MADM models based on the scenarios. It can be deduced that MADM-based scenarios form a multi-disciplinary perspective comprised of two multi-disciplinary fields, which are futures studies and multiple criteria decision making (MCDM) as a sub-field of Decision Science. The process of the MADM-based scenarios’ concept is illustrated in Figure 1.
The classic part of “MADM-based scenarios” is structured with classic MADM methods. SWARA-WASPAS as a hybrid model is selected for this study.
In the present study, a policy-based structure is applied in decision making related to selecting criteria, as it is more pertinent to the SWARA method comparing other MADM methods for criteria weighting and evaluating. SWARA-WASPAS is a new fast-growing hybrid model that has been presented in recent years as a powerful hybrid model for solving multi-criteria decision problems (Hashemkhani Zolfani et al., 2013) [34]. WASPAS itself has both of the advantages of its two classic methods. Considering the importance of this new hybrid MADM model, a review article has been published recently that shows dimensions of the framework from different points of view (Mardani et al., 2017) [35]. Published studies were identified using SWARA-WASPAS research strategy as listed below:
  • Vafaeipour et al. [36] in an assessment of regional priority for the implementation of solar projects.
  • Bitarafan et al. [37] in an evaluation of real-time intelligent sensors for the structural health monitoring of bridges.
  • Aghdaie et al. [38] in sales branches performance evaluation.
  • Ghorshi Nezhad et al. [39] in planning the priority of high-tech industries.
  • Khodadadi et al. [40] in evaluating the process of chemical wastewater purification.
  • Karabašević et al. [41] for personnel selection.
  • Yazdani et al. [42] in material selection.
  • Mardani et al. [35] as a systematic review and meta-analysis of SWARA and WASPAS methods.
  • Ren et al. (2019) [43] in electric vehicle charging station site selection.

3.1. Step-Wise Weight Assessment Ratio Analysis (SWARA)

SWARA is one of the MADM methods that applies policy-based perspective for criteria weighting and evaluating (Hashemkhani Zolfani and Saparauskas, 2013) [44]. SWARA is comparable with other MADM methods such as AHP (Saaty 1980) [45], ANP (Saaty and Vargas 2001) [46], FARE (Ginevicius, 2011) [47], BWM (Rezaei, 2015) [48] (Haghnazar Kouchaksaraei et al., 2015 [49]; Hashemkhani Zolfani et al., 2015) [50], rough strength relational DEMATEL (Roy et al., 2018) [51], and extended SWARA (Hashemkhani Zolfani et al., 2018a) [52]. The first step in the SWARA method is ranking criteria regarding their priority, which is the policy-based section of this method that can be advantageous for decision making on the top level of policy making [53]. SWARA is characterized as a friendly structure method that works in a straightforward manner. The procedure of SWARA is based on the below-mentioned steps (Stanujkic et al., 2015) [54]:
Step 1
At the first step, all criteria should be ranked according to experts’ viewpoints.
Step 2
From the second criterion, a comparative importance of the average value s j should be done as follows: the relative importance of criterion j in relation to the previous ( j 1 ) criterion.
Step 3
Determine the coefficient k j
k j = { 1 j = 1 s j + 1 j > 1
Step 4
Determine the recalculated weight q j
q j = { 1 j = 1 k j 1 k j j > 1
Step 5
Final step in calculating criteria’ weights
w j = q j k = 1 n q j
where w j denotes the relative weight of criterion j .

3.2. Weighted Aggregated Sum Product Assessment (WASPAS)

WASPAS has been introduced as the one of the state-of-the-art developed MADM methods for evaluating alternatives based on a combination of weighted sum model (WSM) and weighted product model (WPM) (Zavadskas et al., 2012) [55]. The procedure of WASPAS is presented below (Stojic et al., 2018) [56]:
Step 1.
Establish a normalized decision-making matrix:
x i j ¯ = x i j o p i t x i j ,   where   i = 1 , m ¯ ; j = 1 , n ¯
If the opt value is max
x i j ¯ = o p i t x i j x i j , where   i = 1 , m ¯ ;   j = 1 , n ¯
If the opt value is min
Step 2.
Calculate the WASPAS weighted and normalized decision-making matrix for the summarizing part:
x i j ¯ ¯ , s u m = x i j ¯ q j ,   where   i = 1 , m ¯ ;   j = 1 , n ¯
Step 3.
Calculate the WASPAS weighted and normalized decision-making matrix for the multiplication part:
x i j ¯ ¯ , m u l t = x ¯ i j q j   where   i = 1 , m ¯ ;   j = 1 , n ¯
Step 4.
Final calculating for evaluating and prioritizing alternatives:
W P S i = 0.5 j = 1 n X ¯ ¯ i j , s u m + 0.5 j = 1 n X ¯ ¯ i j , m u l t ,   where   i = 1 , m ¯ ;   j = 1 , n ¯

4. Case Study

The Institute of Futures Studies in Health is in affiliation with Kerman Medical University consisting of five research centers of Modeling in Health, Social Determinants of Health, Health Services Management, Medical Informatics, and the Regional Knowledge Hub, WHO Collaboration Center for HIV Surveillance. The institute delivers consulting services reflecting contemporary topics and issues for future-oriented projects, documents and plans for assistance, research, training, and development deputy of the Health and Medical Education Ministry, and it also cooperates with the Academy of Medical Sciences.
The expertise areas of the institute are Medical informatics, Health services management, Social determinants of health, Modeling in health, HIV surveillance, Data capacity, Data mining, Systematic review, Meta-analysis and meta-synthesis, System dynamics, Futures studies methods, Statistics, and Epidemiology and health philosophy.

5. Future Scenarios

Four possible and probable scenarios are established regarding the experts’ standpoints to demonstrate the future in practice. The general concept has been structured with a foresight perspective as a national plan for the country. Each scenario can be a possible future for the country that can directly affect the health structure.
At the general conference meeting, each scenario was discussed along with its criteria, and final criteria were selected. It is noteworthy that criteria were developed and selected based on each scenario in the future i.e., for each probable future, diverse criteria would be suitable for evaluating the intended situation.
In the procedure of establishing scenarios, finding key criteria and probable important alternatives (strategies), experts cooperated with the director of the research. As mentioned earlier, “The Institute for Futures Studies in Health” is responsible for futures studies regarding the healthcare system of the country. An expert team was selected for this study, and their information is presented in Table 2.
The final future scenarios based on the experts’ opinions are presented below:
  • Membership in World Trade Organization (WTO)
  • Dynamically basic insurance
  • International joint cooperation
  • Effective resources management

Futures Scenarios: Definitions, Criteria, and Alternatives

1. Membership in World Trade Organization (WTO)
WTO had more than 162 members by the end of 2015. WTO is involved with Millennium Development Goals and Sustainable Development Goals. Its international economic structure depends on regulations and the structure of the WTO all over the world. Relations, frameworks, and countries’ overseas issues can be partly influenced by the WTO. One of the probable scenarios, which Iran can be confronted with, will be the economic structure after joining the WTO. The economical aspect in each section can evolve differently. The health structure of the country has this opportunity to make a strategic plan for developing a health framework along diverse paths.
Iran is the biggest country among the observer countries, and turning Iran’s situation from observer to permanent membership is not far from reality. It would be easier to access medicine in all aspects such as technologies, and medicine would be cheaper with higher quality as well. International cooperation in the treatment of patients in hospitals and other various aspects can be developed into multi-nationals and completely international. New opportunities would exist in research and technological innovations for the treatment of diseases and exploring new medicines for the country. In the process of setting up a futures exercise, the probable situations and scenarios would turn into realistic ones through strategic plans. Final criteria of this scenario are presented in Table 3.
In this section, the analysis of alternatives and the selection of the most important ones by experts in a conference meeting are presented. Key alternatives related to the “Membership in World Trade Organization (WTO)” scenario are shown in Table 4.
2. Dynamic Basic Insurance
In this scenario, insurance companies have the role of a smart shopper by appropriate organizational structure. There is a proper relationship between insurance companies and other organizations involved in the health sector. In dynamic insurance, premiums are collected and calculated sustainably, and both resources and revenue pooling are proper. The structure of health insurance acts properly in terms of quality and quantity. Basic insurance has a good coverage and determines and provides their service package by defined, logical, and smart standards. The level of out-of-pocket payment and catastrophic healthcare expenditure is decreased. Insurance systems monitor the quality of provider’s services and beside the defined and logical mechanisms of their contracts with providers, they also monitor the efficient implementation of the contracts. The position of insurance in the health system is accepted by all its functions. Insurance companies pay providers properly, while the insurance’s choices are limited and the competition among insurances is restricted. Final criteria of the scenario are presented in Table 5.
For the next scenario, experts made a decision on probable key alternatives for the “Dynamic basic insurance” scenario. The process of this evaluation is structured to just select those alternatives with 100% effectiveness. All alternatives linked to the “Dynamic basic insurance” scenario are shown in Table 6.
3. International Joint Cooperation
This scenario consists of joint contracts that include the medical education area, educational and research contracts, health technologies, cooperation with international organizations such as the World Health Organization, the design and implementation of the joint projects for health sector reforms, joint graduate students, defining and holding joint training workshops to meet the needs of the same training, increasing foreign investment on technological infrastructure such as hospitals established by an Iranian and foreigner joint force with no border restrictions, defining the benefits of health services free zones such as health settlements or a health island without any visa and passport limitations, health tourism, increasing the quality and diversity of health services, Memorandum of Understanding (MoU) and strategies definition for crisis management, countering and controlling the epidemics and prevalent diseases defined for MOU members, providing opportunities for drawing on the expertise of Iranians living abroad by inviting them to participate in MOU’s implementation, and finally defining the joint projects through which the know-how and know-why knowledge are transferred. As a result, the foreign aid of health system increases. Final criteria of International Joint Cooperation are shown in Table 7.
Another four alternatives are selected based on experts’ ideas for the “International joint cooperation” scenario, in practice. Alternatives are illustrated in Table 8.
4. Effective Resources Management
In this scenario, a significant portion of gross domestic product (GDP) is spent on health care. The input resources of the health sector are relatively sustainable. The amount of out-of-pocket payment share to the total health spending is not substantial. Financial data and statistical information on the health system are accessible and integrated. Moreover, the evidence-based philosophy is used by the policy makers. Resource consumption in different parts of the health system is done the most possible ideal way. Controlling the resource consumption is accomplished appropriately. Various groups of stakeholders benefit from the cost effectiveness of the health sector’s advanced technologies, as the most suitable technologies are chosen to be used in health sectors. The relationship between insurance companies, the Ministry of Health, and other health stakeholders is properly established. As a consequence, the community choices of various services increase, which also affects providers’ choices for selecting and delivering the service. It should be kept in mind that during financial crisis in the country, if the state is in charge of financing the health sector, the health sector will confront complications. Final criteria of this scenario are shown in Table 9.
According to the methodology of MADM-based scenarios, there is no limitation for the numbers of alternatives, criteria, and probable differences. Based on experts’ viewpoints, five key probable alternatives were generated for the “Effective resources management” scenario. “Effective resources management” scenario’s alternatives also are shown in Table 10.

6. Results

In view of all that has been mentioned so far in the methodology and previous sections, four scenarios are created to show the probable futures. For each scenario, calculations were carried out separately based on a hybrid MADM model (SWARA-WASPAS). The full explanation of the obtained results in each section is explained in Section 6.1 and Section 6.2.

6.1. SWARA Results

According to the four scenarios, calculations were performed separately, and each scenario along with its criteria was evaluated based on the SWARA method to prioritize and weigh the criteria. As noted earlier, SWARA is mostly appropriate for the cases that are policy-based rather than for general decision-making structures. Concerning the foresight perspective of the study, a policy and SWARA-based framework was applied for this research. Based on the SWARA methodology and policy-based perspective method, the criteria of each scenario were prioritized based on the experts’ judgments and their importance for the country. The results for each scenario are shown in Table 11, Table 12, Table 13 and Table 14.
Health services’ quality was selected as the most influential and effective criterion in the first scenario. This criterion also exists in all other scenarios, and it is one of the most effective criteria, undoubtedly.
Justice in health, Level of accountability, and Quality of financial resources management were three new criteria for this scenario, which were not identified as important criteria for the previous scenario. As it can be seen, justice in health was indicated as a vital criterion in this scenario, despite the significance of the quality of health services being considered undeniable since different scenarios have distinct ends.
Quality of human resource management, Cost management (medical equipment), Reinforced social aspects, and Flexibility in management and accountability were justified criteria for the third scenario. Similarly to the previous scenario, the quality of human resource management, which was the key criterion in this scenario, had top priority.
The cost of “Cooperation” and “Level of accessibility (Geographical position)” were other new criteria that were revealed as important criteria only in the fourth scenario. It can be inferred that new criteria in different scenarios are the key criteria of that specific scenario since they are defined respective to their critical situation in the given scenario to increase the accuracy of decision making.

6.2. WASPAS Results

Similarly to the SWARA part, each scenario was evaluated separately. The related alternatives of each scenario were analyzed in this section, and their priorities are shown in Table 14, Table 15, Table 16, Table 17, Table 18, Table 19, Table 20, Table 21, Table 22, Table 23, Table 24, Table 25, Table 26, Table 27, Table 28 and Table 29. All these evaluations were executed based on WASPAS methodology. The tables of the final ranking are illustrated in the main body of the article, but the calculation parts are presented in Appendix A (Table A1).

6.2.1. “Membership in World Trade Organization (WTO)” Scenario

According to the Table 3, four probable alternatives were selected by experts involved in this research. In this research, future strategies in a special situation were considered as a scenario for the future and as the probable alternatives. Strategies/alternatives of this scenario are: (1) Pharmaceutical Security, (2) Focus of government on research and development (R&D), (3) Empowerment of private sector in both production and technology, and (4) Applying both FDI and equipped new technologies in one structure. The process is shown in Table 15, Table 16, Table 17 and Table 18.

6.2.2. “Dynamic Basic Insurance” Scenario

As illustrated in Table 5, four different probable alternatives were selected by the experts of this study. These strategies that are also considered as alternatives in this research are as follows: (1) Hiring international managers, (2) Benchmarking, (3) Supportive governmental policies, and (4) Good governance. The calculations are depicted in Table 19, Table 20, Table 21 and Table 22.

6.2.3. “International Joint Cooperation” Scenario

In this section, similar to previous scenarios, the selected strategies were evaluated based on WASPAS methodology. The strategies for the dynamic basic insurance scenario include the following subjects: (1) Pharmaceutical security; (2) Supportive governmental policies; (3) Sustainable medical services; and (4) Sustainable human resource management. The results can be seen in Table 23, Table 24, Table 25 and Table 26.

6.2.4. “Effective Resources Management” Scenario

In this scenario, five strategies were selected as alternatives referring to experts’ opinions. The strategies for the effective resources management scenario are: (1) Benchmarking, (2) Supportive governmental policies, (3) Good governance, (4) Sustainable human resource management, and (5) Re-engineering the process. The final priorities are illustrated in Table 27, Table 28, Table 29 and Table 30.

7. Discussion

This discussion is prepared in three sections. In the first section, the most effective criterion is addressed, and in the second section, the discovery of the most applicable strategy as an alternative is discussed. The third and last section concentrates on the explanation of the macro monitoring system for the health structure as a comprehensive sustainable health system.

7.1. First Round Analysis: Finding the Most Effective Criterion

According to the methodology, the first round in the discussion is pertinent to the analysis of effective criteria, especially the most effective ones. As it is shown in Table 31, all 15 criteria and their relative importance (weights) in the different scenarios are presented. Creating Table 31 prepares a general perspective about criteria and their situations in scenarios.
Considering the critical criteria, the impact of scenarios, their average weights, and their averages based on their priorities are addressed in the second round. As it can be seen, in Table 32, the mentioned items provide the final analysis of the criteria. A final ranking based on the criteria’s weights and their effectiveness is presented in Table 32, and the most effective criterion (C1: Health services’ quality) was identified regarding the expectations.

7.2. First Round Analysis: Finding the Most Applicable Alternative

Similar to the previous section, 11 strategies as alternatives and their priorities in these scenarios are presented in Table 33, and based on this table, a final evaluation was carried out.
Analyzing and evaluating alternatives is done using different items. Other evaluation methods were utilized for examination, which was beyond this research original methodology. Average in state of max criteria (ASMAC) and Average state of “min” criteria (ASMIC) were added to be checked and examined in this process. A final evaluation of the alternatives is presented in Table 34. It is noteworthy that these two methods are completely different methods, and no relation exists between them. The final discussion of these two methods is addressed in Section 8.
The original part of the MADM-based scenarios is the priority based on applicability. Analyzing the priority based on ASMAC and ASMIC was tested for this framework for the first time. The second part was identified as ineffective for two reasons. Firstly, it was not related directly to the original part, and secondly, it was identified as ineffective because of the maximum and minimum criteria. To elaborate more, it was conceived that those alternatives with no minimum criterion can be ranked higher than other alternatives, which are more influential in general.

7.3. Macro Monitoring System

The Institute for Futures Studies in Health of Kerman Medical University has been collaborating as a partner in this research. This institute plays a key role in monitoring weak signals and also preparing scenarios for managing probable crisis in the future. The preparation of Wildcard scenarios has been undertaken by this institute as a concurrent part of the system for directing the general health structure of the country according to macro needs.

7.4. Final Analysis

According to the results, the quality of medical services was identified as the most effective criterion, and sustainable services delivery was recognized as the most applicable alternative. The obtained findings imply that despite the uncertainty of the probable futures, financial sustainability in the health system can be achieved by presenting sustainable and high-quality services delivery.
Sustainable services delivery is affected by three other functions of the health system i.e., stewardship, resource creation, and financing. Thus, to realize the sustainability goals in sustainable service delivery, all these functions need to operate in a sustained manner.
Sustainable medical services delivery was the most applicable alternative for achieving sustainable health financing. It can be deduced that separating a part (a function) of a health system and attempting to make it sustainable does not seem to be pragmatic.
It can be speculated that the economic environment of the health system in three financing layers of international, regional/national, and sectoral (health sector) is interwoven; however, the amount of the effect that can be transformed from the international and regional/national layer to the health financing layer depends on the robustness of the financing mechanisms of the health financing function. For instance, it should be determined how the revenue collection task of the financial system can be performed despite the environmental changes.
Health expenditures are provided from two main channels consisting of the general and private sectors. General expenditures incorporate governmental budget and social security insurance, and private expenditures incorporate out-of-pocket, private insurances and other resources such as donations.
In comparison with other middle and upper-income countries, the governmental share in providing health expenditure is lower in Iran. Two main channels of providing health expenditure are out-of-pocket and governmental payment, which are both affected by other layers of the economic environment. If the health system becomes capable of developing a mechanism of wealth creation such as entrepreneurship based on a national innovation system, moving toward the third generation medical universities, health tourism, etc., this fulfillment will bring about two main results. One of them is the risk reduction as a consequence of the concentration on limited sources and decreasing the dependence on different financing mechanisms. The other result is the lessening of of environmental impacts, which boost the sustainability of the system.
Improving the quality of health services in Iran requires attention to several key factors such as organizing, regulation, financing, payment, and behavioral systems.
Some important factors in organizing are listed as follows: a proper structure for implementing health care programs, determining appropriate structures of quality assessment, providing appropriate definitions of different levels involved in quality promotion, considering the suitable structures for quality-related knowledge share among stakeholders, and defining related appropriate educational and research roles to improve the quality of care.
Defining an appropriate regulatory structure related to quality improvement, the revision of the rules and guidelines associated with different service levels according to the new needs of society (such as chronic diseases), the development of appropriate laws and regulations in the country to produce various types of evidence-based guidelines, and creating a proper understanding about the quality of health legislation are all factors related to the country law and regulation quality.
In regard to the financing factors, the following issues should be considered: defining the health care quality monitoring system of the country and the development of appropriate indicators, considering infrastructural resources of service quality in allocating them in the health sector, creating informational infrastructure related to service quality, providing evidence-based guidelines at different levels of service with the participation of all stakeholders, medical education involvement in training about service qualities concepts and quantitative and qualitative training, a smart selection of models to improve the quality of concepts of stakeholders, motivating and empowering healthcare personnel to provide high-quality services, and ultimately monitoring the quality of inputs such as medicines and medical equipment.
The payment system factors such as creating mechanisms of using quality-based payment methods—and more effectively, the role of insurance in promotion of service quality by strategic purchasing—would enhance the quality of healthcare services.
For the behavioral function, the critical factors that need to be considered are giving feedback related to services quality to providers and society, defining national and local events to appreciate the efforts related to quality improvement, promoting self-assessment processes in organizations providing health services, and institutionalizing moral, social, and cultural values in services delivery to meet the needs of the non-clinical health care community.

8. Methodological Discussion and Contributions

To date, there has been few studies using MADM-based scenarios; hence, this research attempted to add substantially to our understanding of this methodology, in order to demonstrate how this methodology can be applied, and to draw attention to the constructive attributes of this methodology in practice. Additionally, this methodology provides a bright vision for decision makers and policy makers to make more accurate and comprehensive decisions. In this study, two extra evaluation parts were added to this applied methodology. The first one is “Average based on priorities (Min)”, which is influential in evaluating momentous criteria, and the second one is “Estate of alternatives based on ASMAC and ASMIC” which is utilized in the evaluation process of applicable alternatives.
Both extra evaluation parts were presented to be examined in reality and case studies. The results revealed reliable evidence to confirm the validation of “Average based on priorities (Min)”, while no evidence has been attained to support the effective usage of the “Estate of alternatives based on ASMAC and ASMIC” in this specific study. It is surmised that the Average in state of max criteria (ASMAC) and Average state of “min” criteria (ASMIC) were not conducive for finding applicable alternatives due to some limitations and reasons. In the current research, the ranking of alternatives became practically impossible, since alternative 9 did not have a minimum estate. Taken together, these findings suggest that “Average based on priorities (Min)” can be considered as the salient methodology identified as indispensable for finding effective criteria.

9. Conclusions

The current findings add to a growing body of literature on sustainable health financing. In this study, health services’ quality was recognized as the most effective criterion in assessing the different future alternatives. In fact, the promotion of health services’ quality affects different aspects of health system functioning and its enhancement. From the viewpoint of patients, the delivery of quality services is the most paramount aspect of what they receive in a health system. Through the lens of providers, delivering high-quality health services assures their thorough functioning in a health system. From the policy makers’ perspective, delivering health services in a satisfactory quality level implies that the health services are delivered in compliance with standards and regulations; furthermore, it also ensures that the limited health sources are utilized productively. From the health insurance agencies’ outlook, high-quality service delivery can be translated into strategic purchasing for all of the health insurance covered population. At first glance, it may seem that delivering high-quality services will heighten the expenditures. However, after deep contemplation, it can be discerned that delivering high-quality services not only reduces many expenditures incurred by the further reference of patients and the side effects of low-quality health services delivery, it also makes the system well-known as a high quality health care system that is highly committed to its social responsibility besides its other administrative responsibilities, which meets the social pillar of sustainability approach. Therefore, high-quality services delivery can be the joint criterion incorporating the distinctive functions of the health system such as financing, service delivery, and so on.
In the other part of the study, sustainable medical service was determined as the most pertinent and applicable alternative in various health financing scenarios, which signifies that economic, social, and environmental aspects of sustainability are fostered in superior services delivery to individuals. Indeed, sustainable medical services can assure the quality of the services, which was determined as the most effective criterion of health financing for future. In regard to sustainability standards and principles, financing the health system should be possible in every economic, social, and environmental fluctuation influencing the health system such as changes to the oil prices, other probable sanctions of Iran, population aging, and so forth.
Sustainable medical services can guarantee the quality of medical services to establish a sustainable financing in a health system regardless of different probable future scenarios of the health system in Iran. Future research directions in sustainable health and medical services based on the MADM scenario will lead researches to the proper delivery and quality monitoring of medical products under sanction circumstances. For this reason, sustainable development that brings about new rules, regulations, and changes of medical delivery/products with a high quality of service is necessarily needed under sanction. For instance, the wide accessibility of alternative medical products is of interest under sanctioned circumstances based on medical priorities. Moreover, the proper delivery of medical products is guaranteed when alternative medical products are used, and of course, they become economically controlled when sanctions are applied. Future analysis and insight need to be investigated on how potential environmentally friendly medical sources of the sanctioned countries can alter outsourced counterparts to maintain sustainability in a myriad of aspects.

Author Contributions

Main idea, conceptualization, methodology, identifying criteria, calculations, discussion and editing and writing–original draft by S.H.Z.; Main idea, interviews, identifying criteria, appendix by R.D. & A.P.; Editing, conceptualization by O.P.; Editing, revision and discussion by P.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Explanations of the all criteria.
Table A1. Explanations of the all criteria.
CriteriaDefinitions
C1Health services’ qualityA level of value provided by health service providers determined using some measurement
C2Premiums paid by peopleThe share of the expenses that patients pay directly to health care providers
C3Variety and quality of clinical servicesVariety of clinical services means that the clinical service’s users (providers and patients) should have the right to choose the kind of services they need based on different indicators such as quality, cost, convenience and etc. Quality of clinical services refers to the value level of the delivered services determined using some measurements.
C4The impact of availability of the medial servicesThe impact of the alternative on the extent of access to medical services respecting several aspects such as geographical, financial and organizational access.
C5Governmental dependencyLevel of dependency of different scenarios and alternatives to the role of government
C7Insurance coverageThe number of population with health insurance. Insurance is a means of protection from financial loss.
C6Health equityThe absence of discrimination among diverse groups regarding their social, economic, demographical or geographical differences.
C8ResponsivenessThe ability of the health system to meet the population’s legitimate expectations for improvements in health or wealth.
C9Quality of financial resources managementAppropriate management of different aspects of financing in health care consisting of revenue collection, pooling and purchasing health services. It is also related to appropriate utilization of these resources in different structures of health system.
C10Quality of human resource managementHuman resource management is a function in organizations designed to maximize staff performance productivity. HRM in health is primarily concerned with the management of human resources within health care organizations and HR policies and systems.
C11Cost managementThe process of planning and controlling the budget of health system
C12Reinforced social aspectsThe extent of practical support from social aspect of sustainability in different items
C13Management flexibilityThe management team’s ability to adapt their decisions, including timing and scaling, to the existing health system conditions.
C14Cooperation’s costReflects different aspects of cost that the country should burden such as financial, time, and manpower costs.
C15Level of accessibilityThe geographical access to different types of services in different levels of health care for health services users

References

  1. Coiera, E.; Hovenga, E.J.S. Building a Sustainable Health System; Yearbook of Medical Informatics: Stuttgart, Germany, 2007; pp. 8–11. [Google Scholar]
  2. World Health Organization (WHO). Resource Generation Function Report; World Health Report; WHO: Geneva, Switzerland, 2000. [Google Scholar]
  3. Markel, H. Worldly approaches to global health: 1851 to the present. Public Health 2014, 128, 124–128. [Google Scholar] [CrossRef]
  4. Moon, S. WHO’s role in the global health system: What can be learned from global R&D debates? Public Health 2014, 128, 167–172. [Google Scholar]
  5. Wang, Y.; Kung, L.; Byrd, T.A. Big data analytics: Understanding its capabilities and potential benefits for healthcare organizations. Technol. Forecast. Soc. Chang. 2018, 126, 3–13. [Google Scholar] [CrossRef]
  6. Singh, H.; Kumar, R. Selection of material for bicycle chain in Indian scenario using MADM approach. In Proceedings of the World Congress on Engineering 2012, London, UK, 4–6 July 2012. [Google Scholar]
  7. Zineb, A.B.; Ayadi, M.; Tabbane, S. An enhanced vertical handover based on fuzzy inference MADM approach for heterogeneous networks. Arab. J. Sci. Eng. 2017, 42, 3263–3274. [Google Scholar] [CrossRef]
  8. Industry Agenda. The Financial Sustainability of Health Systems a Case for Change; World Economic Forum and McKinsey & Company: Geneva, Switzerland, 2012. [Google Scholar]
  9. Ooms, G.; Marten, R.; Waris, A.; Hammonds, R.; Mulumba, M.; Friedman, E.A. Great expectations for the World Health Organization: A Framework Convention on Global Health to achieve universal health coverage. Public Health 2014, 128, 173–178. [Google Scholar] [CrossRef]
  10. World Health Organization (WHO). Social Health Insurance Report; World Health Report; WHO: Geneva, Switzerland, 2004. [Google Scholar]
  11. National Health Service (NHS). Route Map for Sustainable Health; NHS: Cambridge, UK, 2009. [Google Scholar]
  12. Gnatzy, T.; Moser, R. Scenario development for an evolving health insurance industry in rural India: INPUT for business model innovation. Technol. Forecast. Soc. Chang. 2012, 79, 688–699. [Google Scholar] [CrossRef]
  13. Gille, L.; Houy, T. The future of health care demand in developed countries: From the “right to treatment” to the “duty to stay healthy”. Futures 2014, 61, 23–32. [Google Scholar] [CrossRef]
  14. Rhisiart, M.; Miller, R.; Brooks, S. Learning to use the future: Developing foresight capabilities through scenario processes. Technol. Forecast. Soc. Chang. 2015, 101, 124–133. [Google Scholar] [CrossRef]
  15. Keshavarzian, M.; Mofidian, S. An Overview on Iran Health Care Financing System: Challenges and Solutions. J. Health Policy Sustain. Health 2014, 1, 131–136. [Google Scholar]
  16. Hashemkhani Zolfani, S.; Maknoon, R.; Zavadskas, E.K. An introduction to Prospective Multiple Attributes Decision Making (PMADM). Technol. Econ. Dev. Econ. 2016, 22, 309–326. [Google Scholar] [CrossRef]
  17. Pencheon, D. Making health care more sustainable: The case of the English NHS. Public Health 2015, 129, 1335–1343. [Google Scholar] [CrossRef] [PubMed]
  18. Sustainable Development Solutions Network (A Global Initiative for the United Nations). Health in the Framework of the Sustainable Development; Technical Report for the Post-2015 Development Agenda; Sustainable Development Solutions Network: New York, NY, USA, 2014. [Google Scholar]
  19. Liaropoulos, L.; Goranitis, I. Health care financing and the sustainability of health systems. Int. J. Equity Health 2015, 14, 80. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  20. Smith, P.C.; Mossialos, E.; Papanicolas, I. Performance Measurement for Health System Improvement: Experiences, Challenges and Prospects; World Health Organization, Regional Office for Europe: Copenhagen, Denmark, 2008. [Google Scholar]
  21. Timmers, P. Towards More Sustainable Healthcare System in Europe; The European Files: Brussels, Belgium, 2014; p. 30. [Google Scholar]
  22. World Health Organization (WHO). Agenda for sustainable development. In Health in the 2030; WHO: Geneva, Switzerland, 2015. [Google Scholar]
  23. World Health Organization (WHO). Sustainable Health Financing, Universal Coverage and Social Health Insurance; Fifty-Seventh World Health Assembly Report; WHO: Geneva, Switzerland, 2005. [Google Scholar]
  24. Gottret, P.; Schieber, G. Health Financing Revisited: A Practitioners Guide; The World Bank: Washington, DC, USA, 2007. [Google Scholar]
  25. World Health Organization (WHO). Health Systems: Improving Performance; The World Health Report; WHO: Geneva, Switzerland, 2000. [Google Scholar]
  26. Rashidian, A.; Arab, M.; Vaez Mahdavi, M.; Ashtarian, K.; Mostafavi, H. Which Social Values Are Considered in Iranian Health System? Arch. Iran. Med. 2018, 21, 199–207. [Google Scholar] [PubMed]
  27. Almaspoor Khangah, H.; Jannati, A.; Imani, A.; Salimlar, S.; Derakhshani, N.; Raef, B. Comparing the Health Care System of Iran with Various Countries. Health Scope 2017, 6, e34459. [Google Scholar] [CrossRef]
  28. Kavosi, Z.; Rashidian, A.; Pourreza, A.; Majdzadeh, R.; Pourmalek, F.; Hosseinpoor, A.R.; Mohammad, K.; Arab, M. Inequality in household catastrophic health care expenditure in a low-income society of Iran. Health Policy Plan. 2012, 27, 613–623. [Google Scholar] [CrossRef] [Green Version]
  29. Olyaeemanesh, A.; Behzadifar, M.; Mousavinejhad, N.; Behzadifar, M.; Heydarvand, S.; Azari, S.; Martini, M.; Bakhtiari, A.; Bragazzi, N.L. Iran’s Health System Transformation Plan: A SWOT analysis. Med. J. Islam. Repub. Iran 2018, 32, 39. [Google Scholar] [CrossRef]
  30. Mehrdad, R. Health System in Iran. Jpn. Med. Assoc. J. 2009, 52, 69–73. [Google Scholar]
  31. Hashemkhani Zolfani, S.; Maknoon, R.; Zavadskas, E.K. Multiple Attribute Decision Making (MADM) based Scenarios. Int. J. Strateg. Prop. Manag. 2016, 20, 101–111. [Google Scholar] [CrossRef]
  32. Hashemkhani Zolfani, S.; Zavadskas, E.K.; Khazaelpour, P.; Cavallaro, F. The Multi-Aspect Criterion in the PMADM Outline and Its Possible Application to Sustainability Assessment. Sustainability 2018, 10, 4451. [Google Scholar] [CrossRef] [Green Version]
  33. Hashemkhani Zolfani, S.; Masaeli, R. From Past to Present and into the Sustainable Future; PMADM Approach in Shaping Regulatory Policies of the Medical Device Industry in the New Sanction Period. In Sustainability Modeling in Engineering: A Multi-Criteria Perspective; Chatterjee, P., Yazdani, M., Chakraborty, S., Eds.; Word Scientific: Singapore, 2019. [Google Scholar]
  34. Hashemkhani Zolfani, S.; Aghdaie, M.H.; Derakhti, A.; Zavadskas, E.K.; Morshed Varzandeh, M.H. Decision making on business issues with foresight perspective: An application of new hybrid MCDM model in shopping mall locating. Expert Syst. Appl. 2013, 40, 7111–7121. [Google Scholar] [CrossRef]
  35. Mardani, A.; Nilashi, M.; Zakuan, N.; Loganathan, N.; Soheilirad, S.; Mat Saman, M.Z.; Ibrahim, O. A systematic review and meta-Analysis of SWARA and WASPAS methods: Theory and applications with recent fuzzy developments. Appl. Soft Comput. 2017, 57, 265–292. [Google Scholar] [CrossRef] [Green Version]
  36. Vafaeipour, M.; Hashemkhani Zolfani, S.; Morshed Varzandeh, M.H.; Derakhti, A.; Keshavarz Eshkalag, M. Assessment of regions priority for implementation of solar plants in Iran: New application of a hybrid multi-criteria decision making approach. Energy Convers. Manag. 2014, 86, 653–663. [Google Scholar] [CrossRef]
  37. Bitarafan, M.; Hashemkhani Zolfani, S.; Lale Arefi, S.; Zavadskas, E.K.; Mahmoudzadeh, A. Evaluation of real-time intelligent sensors for structural health monitoring of bridges based on SWARA-WASPAS; A Case in Iran. Balt. J. Road Bridge Eng. 2014, 9, 333–340. [Google Scholar] [CrossRef]
  38. Aghdaie, M.H.; Hashemkhani Zolfani, S.; Zavadskas, E.K. Sales branches performance evaluation: A Multiple Attribute Decision Making approach. In Proceedings of the 8th International Scientific Conference “Business and Management 2014”, Vilnius, Lithuania, 15–16 May 2014; pp. 1–7. [Google Scholar]
  39. Ghorshi Nezhad, M.R.; Hashemkhani Zolfani, S.; Moztarzadeh, F.; Zavadskas, E.K.; Bahrami, M. Planning the priority of high tech industries based on SWARA-WASPAS methodology: The case of the nanotechnology industry in Iran. Econ. Res. Ekon. Istraž. 2015, 28, 1111–1137. [Google Scholar] [CrossRef]
  40. Khodadadi, M.R.; Hashemkhani Zolfani, S.; Yazdani, M.; Zavadskas, E.K. A hybrid MADM analysis in evaluating process of chemical wastewater purification regarding to advance oxidation processes. J. Environ. Eng. Landsc. Manag. 2016, 25, 277–288. [Google Scholar] [CrossRef]
  41. Karabašević, D.; Stanujkić, D.; Urošević, S.; Maksimović, M. An approach to personnel selection based on SWARA and WASPAS methods. J. Econ. Manag. Inform. 2016, 7, 1–11. [Google Scholar]
  42. Yazdani, M.; Zavadskas, E.K.; Ignatius, J.; Doval Abad, M. Sensitivity Analysis in MADM Methods: Application of Material Selection. Inz. Ekon. Eng. Econ. 2016, 27, 382–391. [Google Scholar] [CrossRef] [Green Version]
  43. Ren, R.; Liao, H.; Al-Barakati, A.; Cavallaro, F. Electric vehicle charging station site selection by an integrated hesitant fuzzy SWARA-WASPAS method. Transform. Bus. Manag. 2019, 18, 103–123. [Google Scholar]
  44. Hashemkhani Zolfani, S.; Saparauskas, J. New application of SWARA method in prioritizing sustainability assessment indicators of energy system. Inz. Ekon. Eng. Econ. 2013, 24, 408–414. [Google Scholar]
  45. Saaty, L.T. The Analytic Hierarchy Process; McGraw Hill Company: New York, NY, USA, 1980. [Google Scholar]
  46. Saaty, L.T.; Vargas, L.G. Models, Methods, Concepts & Applications of the Analytical Hierarchy Process; Kluwer Academic Publishers: Boston, MA, USA, 2001. [Google Scholar] [CrossRef]
  47. Ginevicius, R. A new determining method for the criteria weights in multi-criteria evaluation. Int. J. Inf. Technol. Decis. Mak. 2011, 10, 1067–1095. [Google Scholar] [CrossRef]
  48. Rezaei, J. Best-worst multi-criteria decision-making method. Omega 2015, 53, 49–57. [Google Scholar] [CrossRef]
  49. Haghnazar Kouchaksaraei, R.; Hashemkhani Zolfani, S.; Golabchi, M. Glasshouse locating based on SWARA-COPRAS approach. Int. J. Strateg. Prop. Manag. 2015, 19, 111–122. [Google Scholar] [CrossRef]
  50. Hashemkhani Zolfani, S.; Maknoon, R.; Zavadskas, E.K. Multiple nash equilibriums and evaluation of strategies. New application of MCDM methods. J. Bus. Econ. Manag. 2015, 16, 290–306. [Google Scholar] [CrossRef] [Green Version]
  51. Roy, J.; Adhikary, K.; Kar, S.; Pamucar, D. A rough strength relational DEMATEL model for analysing the key success factors of hospital service quality. Decis. Mak. Appl. Manag. Eng. 2018, 1, 121–142. [Google Scholar] [CrossRef]
  52. Hashemkhani Zolfani, S.; Yazdani, M.; Zavadskas, E.K. An extended stepwise weight assessment ratio analysis (SWARA) method for improving criteria prioritization process. Soft Comput. 2018, 1–7. [Google Scholar] [CrossRef]
  53. Keršulienė, V.; Zavadskas, E.K.; Turskis, Z. Selection of rational dispute resolution method by applying new step-wise weight assessment ratio analysis (SWARA). J. Bus. Econ. Manag. 2010, 11, 243–258. [Google Scholar] [CrossRef]
  54. Stanujkic, D.; Karabasevic, D.; Zavadskas, E.K. A framework for the Selection of a packaging design based on the SWARA method. Inz. Ekon. Eng. Econ. 2015, 26, 181–187. [Google Scholar] [CrossRef] [Green Version]
  55. Zavadskas, E.K.; Turskis, Z.; Antucheviciene, J.; Zakarevicius, A. Optimization of weighted aggregated sum product assessment. Electron. Electr. Eng. 2012, 122, 3–6. [Google Scholar] [CrossRef]
  56. Stojic, G.; Stevic, Z.; Antucheviciene, J.; Pamucar, D.; Vasiljevic, M. A Novel Rough WASPAS Approach for Supplier Selection in a Company Manufacturing PVC Carpentry Products. Information 2018, 9, 121. [Google Scholar] [CrossRef] [Green Version]
Figure 1. The general process of multiple attribute decision making (MADM)-based scenarios (Hashemkhani Zolfani et al., 2016a) [16].
Figure 1. The general process of multiple attribute decision making (MADM)-based scenarios (Hashemkhani Zolfani et al., 2016a) [16].
Symmetry 12 00061 g001
Table 1. Important indicators in health financing monitoring. GDP: gross domestic product.
Table 1. Important indicators in health financing monitoring. GDP: gross domestic product.
Health Financing INDICATOR
-
Total health expenditure as a percentage of GDP
-
The annual growth percentage of per capita health expenditure
-
Per capita health expenditures annual growth
-
Government expenditures payment as a percentage of GDP
-
Government expenditures payment as a percentage of total health expenditure
-
Government expenditures payment as a percentage of total government expenditures
-
Out-of-pocket payment for health expenditures as a percentage of total health expenditures
-
Out-of-pocket payment for health expenditures as a percentage of total private health expenditures
-
Private prepayment plans as a percentage of the total private sector expenditures in the health system
-
Percentage of population coverage
-
The prepayments in health insurance plans
-
Per capita utilization of health services by low-income and high-income individuals
-
Catastrophic health expenditure
-
Percentage of the population who are poor due to illness
-
The percentage of poor and vulnerable population covered by Social Security
-
Foreign aid for health system
-
Achieving sustainable development goals
Table 2. Information of expert team involved in the research.
Table 2. Information of expert team involved in the research.
CategoryClassificationNo.
Working backgroundHealthcare4
Futures studies3
Management2
Economic and social science1
Educational LevelBachelor-
Master3
PhD7
GenderMale4
Female6
Table 3. Final criteria of “Membership in World Trade Organization (WTO)” scenario.
Table 3. Final criteria of “Membership in World Trade Organization (WTO)” scenario.
Membership in World Trade Organization (WTO)Max/MinCriterion
1Health services’ qualityMaxC1
2Premiums paid by peopleMinC2
3Variety and quality of medical servicesMaxC3
4The impact of availability of the medial servicesMaxC4
5Governmental dependencyMinC5
6Insurance coverageMaxC6
Table 4. Final alternatives related to “Membership in World Trade Organization (WTO)” scenario. R&D: research and development.
Table 4. Final alternatives related to “Membership in World Trade Organization (WTO)” scenario. R&D: research and development.
Strategies/AlternativesExtra Information
A1Pharmaceutical securityDeveloping a situation in the country in which there are no shortages in access to different kinds of medicines, technologies, and related services.
A2Government’s focus on R&DCreating good opportunities for developing this industry, mainly from an economical perspective.
A3Empowering private sector in both production and technologySimilar to A2 but with a developing focus in private sectors.
A4Applying both Foreign Direct Investment (FDI) and equipped new technologies in one structureAttracting foreign investment in different sections of health structures with particular concentration on equipping hospitals and transferring technology
Table 5. Final criteria of “Dynamic basic insurance” scenario.
Table 5. Final criteria of “Dynamic basic insurance” scenario.
Dynamic Basic InsuranceMax/MinCriterion
1Health services’ qualityMaxC1
2Premiums paid by peopleMinC2
3The impact of availability of the medial servicesMaxC4
4Health equityMaxC6
5The general level of insurance coverageMaxC7
6Level of accountabilityMaxC8
7Quality of financial resources managementMaxC9
Table 6. Final alternatives related to the “Dynamic basic insurance” scenario.
Table 6. Final alternatives related to the “Dynamic basic insurance” scenario.
Strategies/AlternativesExtra Information
A5Employing international managersExperiences transfer
A6BenchmarkingFollowing up successful experiences for developing a comprehensive plan
A7Supportive governmental policiesRole of government in designing the structure
A8Good governanceProper monitoring by government
Table 7. Final criteria of “International joint cooperation” scenario.
Table 7. Final criteria of “International joint cooperation” scenario.
International Joint CooperationMax/MinCriterion
1Health services’ qualityMaxC1
2Quality of financial resources managementMaxC9
3Quality of human resource managementMaxC10
4Cost management (medical equipment)MaxC11
5Reinforced social aspectsMaxC12
6Accountability and flexibility in management MaxC13
Table 8. Final alternatives related to “Dynamic basic insurance” scenario.
Table 8. Final alternatives related to “Dynamic basic insurance” scenario.
Strategies/AlternativesExtra Information
A1Pharmaceutical securityDeveloping a situation in the country in which there are no shortages in access to different kinds of medicines, technologies, and related services.
A7Supportive governmental policiesRole of government in designing the structure.
A9Sustainable medical services Providing perfect services for people regarding economic, social, and environmental aspects.
A10Sustainable human resource managementEnabling organizational goal achievement while simultaneously reproducing the HR base and controlling side effects on the HR systems and on the organization itself
Table 9. Final criteria of “Effective resources management” scenario.
Table 9. Final criteria of “Effective resources management” scenario.
Effective Resources ManagementMax/MinCriterion
1Health services’ qualityMaxC1
2Premiums paid by peopleMinC2
3Variety and quality of medical servicesMaxC3
4The impact of availability of the medial servicesMaxC4
5Cooperation’s costMinC14
6Level of accessibility (Geographical position)MaxC15
Table 10. Final alternatives related to “Effective resources management” scenario.
Table 10. Final alternatives related to “Effective resources management” scenario.
Strategies/AlternativesExtra Information
A6BenchmarkingFollowing up successful experiences for developing a comprehensive plan
A7Supportive governmental policiesRole of government in designing the structure
A8Good governanceProper monitoring by government
A10Sustainable human resource managementEnabling organizational goal achievement while simultaneously reproducing the HR base and controlling side effects on the HR systems and on the organization itself
A11Re-engineering the process Re-organizing and re-structuring all healthcare system to be more effective and efficient
Table 11. Criteria’s evaluation of “Membership in World Trade Organization (WTO)” scenario.
Table 11. Criteria’s evaluation of “Membership in World Trade Organization (WTO)” scenario.
CriterionComparative Importance of Average Value sjCoefficient
kj = sj + 1
Recalculated Weight
w j = x j 1 k j
Weight
q j = w j w j
C1 11.00000.2163
C60.161.160.86210.1865
C30.151.150.74960.1622
C5 -10.74960.1622
C20.151.150.65180.1410
C40.071.070.60920.1318
Table 12. Criteria’s evaluation of “Dynamic basic insurance” scenario.
Table 12. Criteria’s evaluation of “Dynamic basic insurance” scenario.
CriterionComparative Importance of Average Value sjCoefficient
kj = sj + 1
Recalculated Weight
w j = x j 1 k j
Weight
q j = w j w j
C7 11.00000.2008
C10.161.160.86210.1731
C80.11.10.78370.1574
C60.071.070.73240.1471
C90.21.20.61040.1226
C40.171.170.52170.1047
C20.111.110.47000.0944
Table 13. Criteria’s evaluation of “International joint cooperation” scenario.
Table 13. Criteria’s evaluation of “International joint cooperation” scenario.
CriterionComparative Importance of Average Value sjCoefficient
kj = sj + 1
Recalculated Weight
w j = x j 1 k j
Weight
q j = w j w j
C10 11.00000.2237
C10.111.110.90090.2016
C90.241.240.72650.1626
C110.081.080.67270.1505
C130.081.080.62290.1394
C120.141.140.54640.1223
Table 14. Criteria’s evaluation of “Effective resources management” scenario.
Table 14. Criteria’s evaluation of “Effective resources management” scenario.
CriterionComparative Importance of Average Value sjCoefficient
kj = sj +1
Recalculated Weight
w j = x j 1 k j
Weight
q j = w j w j
C1 110.2215
C150.161.160.86210.1909
C140.171.170.73680.1632
C4-10.73680.1632
C30.151.150.64070.1419
C20.191.190.53840.1193
Table 15. Decision-making matrix.
Table 15. Decision-making matrix.
C1C2C3C4C5C6
Max/MinMaxMinMaxMaxMinMax
Weights0.21630.14100.16220.13180.16220.1865
A1456584
A2428882
A3327754
A4548553
Table 16. Normalized weighted decision-making matrix for the summarizing part.
Table 16. Normalized weighted decision-making matrix for the summarizing part.
C1C2C3C4C5C6
A10.1730.0560.1220.0820.1010.187
A20.1730.1410.1620.1320.1010.093
A30.1300.1410.1420.1150.1620.187
A40.2160.0710.1620.0820.1620.140
Table 17. Normalized weighted decision-making matrix for the summarizing part and multiplication part.
Table 17. Normalized weighted decision-making matrix for the summarizing part and multiplication part.
C1C2C3C4C5C6
A10.9530.8790.9540.9400.9271.000
A20.9531.0001.0001.0000.9270.879
A30.8951.0000.9790.9831.0001.000
A41.0000.9071.0000.9401.0000.948
Table 18. The results of weighted aggregated sum product assessment (WASPAS).
Table 18. The results of weighted aggregated sum product assessment (WASPAS).
0.5 j = 1 n X ¯ ¯ i j , s u m 0.5 j = 1 n X ¯ ¯ i j , m u l t WSPiRanking
A10.3610.3480.7094
A20.4010.3880.7893
A30.4380.4300.8681
A40.4170.4040.8212
Table 19. Decision-making matrix.
Table 19. Decision-making matrix.
C1C2C4C6C7C8C9
Max/MinMaxMinMaxMaxMaxMaxMax
Weights0.17310.09440.10470.14710.20080.15740.1226
A55222224
A66666668
A77777675
A88888888
Table 20. Normalized weighted decision-making matrix for the summarizing part.
Table 20. Normalized weighted decision-making matrix for the summarizing part.
C1C2C4C6C7C8C9
Max/MinMaxMinMaxMaxMaxMaxMax
A50.1080.0940.0260.0370.0500.0390.061
A60.1300.0310.0790.1100.1510.1180.123
A70.1510.0270.0920.1290.1510.1380.077
A80.1730.0240.1050.1470.2010.1570.123
Table 21. Normalized weighted decision-making matrix for the summarizing part and the multiplication part.
Table 21. Normalized weighted decision-making matrix for the summarizing part and the multiplication part.
C1C2C4C6C7C8C9
Max/MinMaxMinMaxMaxMaxMaxMax
A50.9221.0000.8650.8160.7570.8040.919
A60.9510.9010.9700.9590.9440.9561.000
A70.9770.8880.9860.9810.9440.9790.944
A81.0000.8771.0001.0001.0001.0001.000
Table 22. The results of WASPAS.
Table 22. The results of WASPAS.
0.5 j = 1 n X ¯ ¯ i j , s u m 0.5 j = 1 n X ¯ ¯ i j , m u l t WSPiRanking
A50.2080.1820.3904
A60.3710.3600.7313
A70.3820.3660.7482
A80.4650.4390.9041
Table 23. Decision-making matrix.
Table 23. Decision-making matrix.
C1C9C10C11C12C13
Max/MinMaxMaxMaxMaxMaxMax
Weights0.20160.16260.22370.15050.12230.1394
A1443866
A7777677
A9466677
A10758466
Table 24. Normalized weighted decision-making matrix for the summarizing part.
Table 24. Normalized weighted decision-making matrix for the summarizing part.
C1C9C10C11C12C13
Max/MinMaxMaxMaxMaxMaxMax
A10.1150.0930.0840.1510.1050.119
A70.2020.1630.1960.1130.1220.139
A90.1150.1390.1680.1130.1220.139
A100.2020.1160.2240.0750.1050.119
Table 25. Normalized weighted decision-making matrix for the summarizing part and multiplication part.
Table 25. Normalized weighted decision-making matrix for the summarizing part and multiplication part.
C1C9C10C11C12C13
Max/MinMaxMaxMaxMaxMaxMax
A10.8930.9130.8031.0000.9810.979
A71.0001.0000.9710.9581.0001.000
A90.8930.9750.9380.9581.0001.000
A101.0000.9471.0000.9010.9810.979
Table 26. The results of WASPAS.
Table 26. The results of WASPAS.
0.5 j = 1 n X ¯ ¯ i j , s u m 0.5 j = 1 n X ¯ ¯ i j , m u l t WSPiRanking
A10.3330.3150.6484
A70.4670.4650.9321
A90.3980.3910.7893
A100.4210.4100.8312
Table 27. Decision-making matrix.
Table 27. Decision-making matrix.
C1C2C3C4C14C15
Max/MinMaxMinMaxMaxMinMax
Weights0.22150.11930.14190.16320.16320.1909
A1777677
A7888878
A8998778
A10766556
A11565556
Table 28. Normalized weighted decision-making matrix for the summarizing part.
Table 28. Normalized weighted decision-making matrix for the summarizing part.
C1C2C3C4C14C15
Max/MinMaxMinMaxMaxMinMax
A10.1720.1020.1240.1220.1170.167
A70.1970.0890.1420.1630.1170.191
A80.2220.0800.1420.1430.1170.191
A100.1720.1190.1060.1020.1630.143
A110.1230.1190.0890.1020.1630.143
Table 29. Normalized weighted decision-making matrix for the summarizing part and the multiplication part.
Table 29. Normalized weighted decision-making matrix for the summarizing part and the multiplication part.
C1C2C3C4C14C15
Max/MinMaxMinMaxMaxMinMax
A10.9460.9820.9810.9540.9470.975
A70.9740.9661.0001.0000.9471.000
A81.0000.9531.0000.9780.9471.000
A100.9461.0000.9600.9261.0000.947
A110.8781.0000.9350.9261.0000.947
Table 30. The results of WASPAS.
Table 30. The results of WASPAS.
0.5 j = 1 n X ¯ ¯ i j , s u m 0.5 j = 1 n X ¯ ¯ i j , m u l t WSPiRanking
A10.4020.4010.8033
A70.4490.4460.8951
A80.4470.4410.8882
A100.4030.3980.8014
A110.3700.3600.7305
Table 31. Weights of criteria based on the scenarios.
Table 31. Weights of criteria based on the scenarios.
C1C2C3C4C5C6C7C8C9C10C11C12C13C14C15
S10.21630.1410.16220.13180.16220.1865---------
S20.17310.0944-0.1047-0.14710.20080.15740.1226------
S30.2016-------0.16260.22370.15050.12230.1394--
S40.22150.11930.14190.1632---------0.16360.1909
Average weights0.2030.1180.1520.1330.1620.1670.2010.1570.1430.2240.1510.1220.1390.1640.191
Table 32. Investigation on effectiveness of criteria based on scenarios.
Table 32. Investigation on effectiveness of criteria based on scenarios.
Impact on ScenariosAverage WeightsAverage Based on Priorities (Min)Normalization Based on PrioritiesWeights Based on EffectivenessRanking Based on Effectiveness
C14 of 4 = 100%0.203(1 + 2 + 2 + 1)/4 = 1.51/1.5 = 0.661*0.203*0.66 = 0.133981
C23 of 4 = 75%0.118(5 + 7 + 6)/3 = 61/6 = 0.170.75*0.118*0.17 = 0.015059
C32 of 4 = 50%0.152(3 + 5)/2 = 41/4 = 0.250.5*0.152*0.25 = 0.0196
C43 of 4 = 75%0.133(6 + 6 + 4)/3 = 5.331/5.33 = 0.190.75*0.133*0.19 = 0.018957
C51 of 4 = 25%0.16241/4 = 0.250.25*0.162*0.25 = 0.0101312
C62 of 4 = 50%0.167(2 + 4)/2 = 31/3 = 0.330.5*0.167*0.33 = 0.027564
C71 of 4 = 25%0.20111/1 = 10.25*0.201*1 = 0.050253
C81 of 4 = 25%0.15731/3 = 0.330..25*0.157*0.33 = 0.0129511
C92 of 4 = 50%0.143(5 + 3)/2 = 41/4 = 0.250.5*0.143*0.25 = 0.017888
C101 of 4 = 25%0.22411/1 = 10.25*0.224*1 = 0.0562
C111 of 4 = 25%0.15141/4 = 0.250.25*0.151*0.25 = 0.0094413
C121 of 4 = 25%0.12261/6 = 0.170.25*0.122*0.17 = 0.0051915
C131 of 4 = 25%0.13951/5 = 0.20.25*0.139*0.2 = 0.0069514
C141 of 4 = 25%0.16431/3 = 0.330.25*0.164*0.33 = 0.0135310
C151 of 4 = 25%0.19121/2 = 0.50.25*0.191*0.5 = 0.023885
Table 33. Alternatives and their priorities in the scenarios.
Table 33. Alternatives and their priorities in the scenarios.
A1A2A3A4A5A6A7A8A9A10A11
S14312-------
S2----4321---
S34-----1-32-
S43-----12-45
Table 34. Investigation on applicability of alternatives based on scenarios.
Table 34. Investigation on applicability of alternatives based on scenarios.
Applicability Impact on Scenarios (1)Priority Based on Average (2)Primary RankingWeights Based on EffectivenessPriority Based on ApplicabilityAverage in State of Max Criteria (ASMAC)Average State of Min Criteria (ASMIC)ASMAC Normalization (3)ASMIC Normalization (4)Final Estate of Alternatives Based on ASMAC and ASMIC (3*4)Priority Based on ASMAC and ASMIC
A13 of 4 = 75%3.6694.884(4 + 6 + 5 + 4 + 4 + 4 + 3 + 8 + 6 + 6 + 7 + 7 + 7 + 6)/14 = 5.5(5 + 8 + 7 + 7)/4 = 6.755.5/8 = 0.68752/6.75 = 0.29620.203611
A21 of 4 = 25%35126(4 + 8 + 8 + 2)/4 = 5.5(5 + 8)/2 = 6.55.5/8 = 0.68752/6.5 = 0.30760.211410
A31 of 4 = 25%1143(3 + 7 + 7 + 4)/4 = 5.25(2 + 5)/2 = 3.55.25/8 = 0.65622/3.5 = 0.57140.37492
A41 of 4 = 25%2485(5 + 8 + 5 + 3)/4 = 5.25(4 + 5)/2 = 4.55.25/8 = 0.65622/4.5 = 0.44440.29164
A51 of 4 = 25%4101610(5 + 2 + 2 + 2 + 2 + 4)/6 = 2.8322.83/8 = 0.35372/2 = 10.35373
A61 of 4 = 25%35126(6 + 6 + 6 + 6 + 6 + 8)/6 = 6.3366.33/8 = 0.79122/6 = 0.33330.26375
A73 of 4 = 75%1.3321.7731(7 + 7 + 7 + 6 + 7 + 5 + 7 + 7 + 7 + 6 + 7 + 7 + 8 + 8 + 8 + 8)/16 = 7(7 + 8 + 7)/3 = 7.337/8 = 0.8752/7.33 = 0.27280.23878
A82 of 4 = 50%1.5332(8 + 8 + 8 + 8 + 8 + 8 + 9 + 8 + 7 + 8)/10 = 888/8 = 12/8 = 0.250.257
A91 of 4 = 25%35126(4 + 6 + 6 + 6 + 7 + 7)/6 = 6-6/8 = 0.75-0.75*1*
A102 of 4 = 50%35126(7 + 5 + 8 + 4 + 6 + 6 + 7 + 6 + 5 + 6)/10 = 6(6 + 5)/2 = 5.56/8 = 0.752/5.5 = 0.36360.26526
A111 of 4 = 25%5112011(5 + 5 + 5 + 6)/4 = 5.25(6 + 5)/2 = 5.55.25/8 = 0.65622/5.5 = 0.36360.23859

Share and Cite

MDPI and ACS Style

Hashemkhani Zolfani, S.; Dehnavieh, R.; Poursheikhali, A.; Prentkovskis, O.; Khazaelpour, P. Foresight Based on MADM-Based Scenarios’ Approach: A Case about Comprehensive Sustainable Health Financing Models. Symmetry 2020, 12, 61. https://0-doi-org.brum.beds.ac.uk/10.3390/sym12010061

AMA Style

Hashemkhani Zolfani S, Dehnavieh R, Poursheikhali A, Prentkovskis O, Khazaelpour P. Foresight Based on MADM-Based Scenarios’ Approach: A Case about Comprehensive Sustainable Health Financing Models. Symmetry. 2020; 12(1):61. https://0-doi-org.brum.beds.ac.uk/10.3390/sym12010061

Chicago/Turabian Style

Hashemkhani Zolfani, Sarfaraz, Reza Dehnavieh, Atousa Poursheikhali, Olegas Prentkovskis, and Payam Khazaelpour. 2020. "Foresight Based on MADM-Based Scenarios’ Approach: A Case about Comprehensive Sustainable Health Financing Models" Symmetry 12, no. 1: 61. https://0-doi-org.brum.beds.ac.uk/10.3390/sym12010061

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop