Next Article in Journal
Analysis of Possibility to Apply Preharvest 1-Methylcyclopropene (1-MCP) Treatment to Delay Harvesting of Red Jonaprince Apples
Previous Article in Journal
Assessment of Exposure to Electric Vehicle Inductive Power Transfer Systems: Experimental Measurements and Numerical Dosimetry
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Evaluation of Circular and Integration Potentials of Innovation Ecosystems for Industrial Sustainability

by
Tatyana Tolstykh
1,
Nadezhda Shmeleva
2 and
Leyla Gamidullaeva
3,*
1
Department of Industrial Management, National University of Science & Technology (MISIS), 119049 Moscow, Russia
2
Department of Economics, National University of Science & Technology (MISIS), 119049 Moscow, Russia
3
Department of Management and Economic Security, Penza State University, 440026 Penza, Russia
*
Author to whom correspondence should be addressed.
Sustainability 2020, 12(11), 4574; https://0-doi-org.brum.beds.ac.uk/10.3390/su12114574
Submission received: 18 May 2020 / Revised: 27 May 2020 / Accepted: 2 June 2020 / Published: 3 June 2020
(This article belongs to the Section Economic and Business Aspects of Sustainability)

Abstract

:
The aim of this paper is to address the gap in the academic literature towards the development of methodological approaches to the industrial ecosystem potential assessment. This study is focused on the industrial ecosystems formed on the basis of a symbiotic model and implementing the principles of circularity. The article systematizes the problem of using circular and ecosystem approaches in industrial development. A contribution to the literature was achieved by providing a systemic perspective on the sustainable industrial process. In this paper, we develop the methodological foundations to improve the understanding of circular and integration processes’ influence on the industrial ecosystem potential. For a relevant analysis of industrial ecosystem potential, the existing patterns of system functioning were taken into account, including entropy equilibrium and Harrington model. We illustrate our assumptions with an empirical case study of two different industrial ecosystems, Kalundborg Symbiosis and Baltic Industrial Symbiosis, with an assessment of their circular and integration potentials. The results highlight that the potential of Kalundborg Symbiosis in the field of circularity is realized quite productively, but not in full. The holistic knowledge of circularity process provides new information that supports academics, policymakers, government, and individuals with a more appropriate understanding of the conditions that help to eliminate the environmental problems faced in society, helping to achieve the country’s sustainable development goals.

1. Introduction

Over the last decade, the discourse on enhancing the sustainability of industrial development has focused on the circular economy model, and the idea to reshape the industrial systems following the objective of a more balanced interplay of environmental and economic systems has gained increased attention worldwide. Circular economy is widely considered as a strategy to reconcile industrial systems with the natural environment through the careful design of new products and implementing the “closed-loop system” processes [1]. Russian Federation is just starting to develop a circular and green economy [2]. Implementing the circular economy (CE) concept encourages environmental protection and social prosperity [3], eliminate the environmental problems faced by society, while enabling value-added growth of industries in line with country’s sustainable development.
Amid the prolific studies on circular economy conducted by different schools of thought, is the relatively sparse research focusing on specific industrial ecosystems implementing the principles of circularity. The new development paradigm is changing business management approaches, behavioral strategies, and the speed of responses to external challenges. Under this circumstance, it becomes relevant to develop industrial ecosystems ensuring sustainable development and quick response to new technological transformations. At the same time, the integration is of substantial importance, when the various systems interact with each other and create value. This study is focused on the industrial ecosystems formed on the basis of a symbiotic model and implementing the principles of circularity. The article systematizes the problem of using circular and ecosystem approaches in industrial development. The authors propose a comprehensive three-level technique allowing evaluation of the integration and circular potentials of an industrial ecosystem through consistent assessment of the potentials of individual actors and groups of actors.
The remainder of this article is organized as follows. After this introduction, in Section 2, we provide a theoretical overview CE, related schools of thoughts, its principles, underlying concepts, and tools. Section 3 presents a new methodology for the evaluation of circular and integration potentials of industrial innovation ecosystems. With the aim of a relevant analysis of ecosystem potential, the existing patterns of system functioning were taken into account, including entropy equilibrium, and Harrington model. Section 4 is about the theoretical foundations of our research introducing the authors’ conceptual assumptions and chosen approaches. Section 5 focuses on the implementation of the proposed methodological approach. We illustrate our assumptions with an empirical case study of two different industrial ecosystems, Kalundborg Symbiosis and Baltic Industrial Symbiosis, with an assessment of their circular and integration potentials. Section 6 highlights the key findings of the study and presents the theoretical contribution and practical significance of the study for the necessary improvement of the circular economy in Russia. Finally, in Section 7, some limitations of the research and future research perspectives are proposed.

2. Literature Review

Originally, CE aims to increase the efficiency of resource use, with a special focus on urban and industrial waste, to achieve a better balance and harmony between economy, environment, and society [4]. The understanding of circular economy is ambiguous among researchers today. Many studies argue the CE implications in managerial terms for business efficiency [5,6,7].
Meanwhile, “there is no single group with the undisputed authority to define what circular economy means exactly” [8]. Many studies show that the CE model traces different methodological approaches and that its origins seem to be mainly rooted in different fields [9]. The principles of CE are mainly gathered from other schools of thought, including industrial ecology [10,11], ecological economics [12,13], performance economy [14], natural capitalism [15], product-service systems [16], blue economy [17], etc. A deeper analysis of the approaches proposed by these schools of thought is presented in [18].
Our research interest lies with the concepts of symbiosis, ecosystems, and ecoparks as a single school of thought with the industrial ecology, focused on the creation of industrial ecosystems by using ecological principles [19,20,21]. These ecological principles can be successfully applied to different sectors, including energy, construction, agriculture, metallurgy, etc.
In addition, it is crucial to identify how CE and the concept of sustainability relate. As noted in [18], CE can contribute to the United Nations Sustainable Development Goals, including environmental, economic, and partly social dimensions of sustainability.
The term “ecosystem” is widely used in recent studies. Manufacturing companies increasingly generate and implement innovations in collaboration with various stakeholders in different types of innovation ecosystems. The most comprehensive definition of innovation ecosystem is that proposed by Granstrand and Holgersson (2020). According to the authors, such ecosystem is an evolving set of actors, activities, and artifacts, and the institutions and relations, including complementary and substitute relations, that are important for the innovative performance of an actor or a population of actors [22]. The researchers identify two conceptual approaches to the ecosystems [23]. The first approach identifies it as a group of actors interconnected through resources exchange and production cycle. According to the second approach, ecosystem is a system of interconnected technologies, cooperating and competing firms offering related goods and services [24,25].
In parallel, the theory of industrial ecosystems is actively evolving. Kleiner defines industrial ecosystems as localized socioeconomic formations achieving sustainable development through the circulation of resources in objective, environmental, process, and project subsystems [26]. In [23], industrial ecosystem is defined as a set of components made by the product platform’s owner and enhancements made by independent companies from the periphery. In turn, the ecosystem platform is defined as a network of innovations, increasing the platform’s value [27,28].
Several terms related with the industrial ecosystems have appeared in the literature, stressing their interdisciplinary nature, including the industrial symbiosis, (eco-) industrial parks, and (eco-) industrial networks. We will further specify these notions.
Industrial symbiosis is a notion that originated from the industrial ecology field. It refers to an intercompany resource exchange network in which waste outflow of a company constitutes a recourse inflow for another [29]. Industrial symbiosis is often viewed as a sustainable development and circular economy tool [30,31]. Kalundborg Symbiosis is one of the most cited examples of industrial symbiotic relationships.
Eco-industrial network may include sporadic interactions and knowledge exchange interactions as well [32].
The term of eco-industrial parks appeared first in 1992 at the UN Conference on Environment and Development in Rio de Janeiro [33]. According to UNIDO definition, eco-industrial parks are production and service organizations located in close proximity, which achieve sustainable development through cooperative resource management and environmental impact handling [34].
Comparing to industrial parks, eco-industrial parks attain synergies of negative environmental impact mitigation and local living standards growth in line with economic benefits.
United States Environmental Protection Agency (EPA) [35] gives a definition of the industrial park as an association of goods and service providers aimed at improving economic and ecological performance by cooperative resources and environmental management. Burnside Industrial Park in Canada is a well-known example of an industrial park.
Initiatives to integrate technoparks and other innovation infrastructure objects into cooperation networks are taken by the EU, UNIDO, and other international organizations. We view eco-industrial parks as one of the key actors of industrial ecosystems based on circularity principles.
Researchers widely use term “industrial metabolism” referring to “the whole integrated collection of physical processes that convert raw materials and energy plus labor, into finished products and wastes in a (more or less) steady-state condition” [36]. Special tools are used within CE “to study the flows of matter, energy, and information that cross the industrial and natural systems, reflecting different levels of industrial metabolism” [37]. Considering the approaches exposed, we have to emphasize that there is a lack of practical tools for the assessment of ecosystem actors’ symbiotic and circular interrelations leading to reconciling the economic and environmental sphere.

3. Conceptual Framework

Cooperation of ecosystem actors is based on network partnership principles and cognition as a principal mechanism for achieving strategic goals by the actors. Ecosystem operates at a basis of “energy” exchange between business, industry, scientific community, and government. By “energy” we mean information, knowledge, technologies, or key resources. Ecosystem self-organization occurs as a response to digital challenges, ecological and industrial trends in the forms of new innovation projects, products, digital platforms, and technologies, including recycling.
Ecosystem model is the evolution of cluster, network, and infrastructure communication models (Table 1). It brings together best cooperation practices with ecosystem-specific features crucial in terms of new technological challenges.
Self-organization, lack of managerial institutions, and intellectual environment are the basic differences between the industrial ecosystem and clusters or networks.
However, self-organization does not suppose chaotic and spontaneous integration. “Pacemaker” is the center of the ecosystem that coordinates and balancing actions of all other actors. An actor, technology, project, or platform may act as a “pacemaker”.
Actors of the industrial ecosystem include industrial companies, technoparks, start-ups, venture funds, engineering companies, government institutions, funds, and financial structures and other actors whose interests overlap with the strategic goals of the ecosystem, which are defined by the pacemaker.
In terms of the new industrial revolution, we may highlight the following principles for industrial ecosystems establishment:
  • transboundary ecosystem processes;
  • self-organization, self-regulation, and self-development;
  • joint development and use of information, innovation, and intellectual resources;
  • continuous flow of successive projects (one project initiates the following projects’ implementation);
  • agility and flexibility to external challenges;
  • project- and client-orientation;
  • diversity of actors and network organization design;
  • collaboration based on partnership, trust, cooperation, and mutual help;
  • balance between goals and objectives of actors;
  • knowledge circulation;
  • resources conservation priority;
  • maintaining and development of each actor’s potential;
  • circularity principles enabling to extend the life cycle of resources and to regenerate them for use in other projects.
The ecosystem is constantly changing depending on the life cycles of its projects. Actors are, therefore, not static and may fulfill different roles in different projects. The life cycles of the projects under the ecosystem’s implementation imply the following “set” of actors and roles (Figure 1):
For instance, complex industrial objects that need to transform can initiate or create demand for substantial innovative projects. Universities that accumulate and create national and worldwide expertise and cooperate with many companies from the industry can act as integrators involving new actors and enabling collaboration, as well as knowledge and information exchange. An integrator also acts as a pacemaker and a project office. When new members are involved and knowledge is being exchanged, actors start to generate ideas and initiate projects. That provides the principle that ecosystem projects have no time limits. At the project generation stage (construction, logical, and technical elaboration, ideas formalization), technoparks, venture companies, research centers, etc., act as initiators, integrators, and generators. At the implementation stage, other industrial companies, startups, and engineering companies are involved. They act as developers and suppliers and organize themselves in project teams. Industrial companies, together with the actors involved in the project development, operate as distributors implementing the project within industrial systems. The next stage is the promotion of successful projects, where promoters, such as universities, industrial companies, industrial exhibitions, and marketing companies, transform experience into new projects. Actors that promote energy efficiency focus on implementing principles of circular economy and promote circularity in projects.
We define sustainable development of an industrial ecosystem as technological, innovation, and economic transformations fostering production and innovation potential development of all its actors and system as a whole through balancing digital transformation and circularity with human capital and technological development.
Circularity is a modern trend in economic processes assessment. The circular economy model aims to keep products, components, and materials at their highest utility and value at all times, distinguishing between technical and biological cycles [38].
OECD introduced the business models for circular economy based on the revision of relations between the actors [31]. Various combinations might be appropriate for a production system depending on its specificities. Cooperation between industrial companies enables joint resources management to achieve resource efficiency and waste minimization. Cooperation with consumers makes possible closing loops for resources, which would have become waste within linear economy paradigm. Sharing consumption platforms optimizes demand for goods and free resources while improving quality of life. Regulators’ and knowledge institutions’ participation in production cycles enables new technologies and potential partnership identification. Therefore, industrial ecosystems develop around joint resource management by all stakeholders and adopt circularity principles. This contributes to effective resource management and sustainable ecosystem development.
Competitiveness and integration of potential growth of actors are key targets of industrial ecosystems. Therefore, an integrated assessment of all ecosystems’ component potentials may serve as an indicator for its sustainable development (Figure 2 and Figure 3).
We define an ecosystem’s potential as a set of sources, opportunities, and means to reach its goals. Potentials may be classified by types and groups depending on the resources forming these potentials. For instance, material resources form economic potential consisting of resource, production, and investment potentials. Actors are engaged in activities in which prospects depend on the respective innovation, intellectual, and project potentials. Despite their diversity, potentials have the following properties:
  • potentials are the results of the resources’ interaction within a system, therefore, similar sets of resources form different potentials depending on ecosystem profile;
  • potential evaluation and interpretation depend on goals and objectives to which this potential refers;
  • potential is an aggregated resource consisting of tangible and intangible components.
We also introduce a new term “circular potential” and define it as aggregated resources aimed to keep products, components, and materials at their highest utility and value at all times, distinguishing between technical and biological cycles. It is worth noticing that in the international practice, balanced score indicators are used to evaluate cyclic processes—Recycling Potential Index (RPI) and Waste Generation Index (WGI). However, these indicators allow evaluating only the efficiency of processing certain types of waste and materials or the level of circularity.

4. Research Methodology

To assess the compliance of the actual results of the activity of actors in the industrial ecosystem with the target settings, it is possible to use an integral indicator calculated on the basis of the proposed scales for assessing preference indicators (Figure 2).
At the lower, third, level of the hierarchy, the potential of each actor (PA) is evaluated depending on its role in the ecosystem. The potential of actor i can be represented by an integral quantity, including components:
P3i = f(G1i, G2i, G3i, G4i, G5i, G6i, G7i, G8i), i = 1 ... n
where n—number of actors in the ecosystem, G1i—production potential, G2i—innovation potential, G3i—intellectual potential, G4i—human potential, G5i—financial potential, G6i—technological potential, G7i—project potential, G8i—resource potential, G9i—managerial potential.
At the second level, the level of groups of actors, the integral potential can be represented as a function of the following subsystems:
P2j = f(Q1j, Q2j, Q3j, Q4j, Q5j, Q6j, Q7j, Q8j, Q9j), j = 1 ... m
where m—number of groups of actors in the ecosystem, Q1i—image, Q2j—strategic potential, Q3j—intellectual potential, Q4j—communication potential, Q5j—investment potential, Q6j—technological potential, Q7j—project potential, Q8j—resource potential, Q9i—integrative potential.
Finally, the first level of the hierarchy is the level of indicators of the ecosystem as a whole, through indicators to assess the sustainability of development. This range of indicators is determined expertly, depending on the ecosystem’s target settings (Figure 3).
Indicators of the lower level characterizing the potential of the actor are called an elementary group. Each elementary group has its own weight, d j 1 in integral assessment. Elementary groups (first-order groups) in accordance with the hierarchical model are combined into second-order groups in accordance with the roles of actors in the ecosystems, each of which has its own weight, dj2.
We introduce the notation.
For the elementary group:
  • ci—target indicator values characterizing PA;
  • fi—actually achieved indicator value;
  • di—weight (importance level) of the indicator;
  • i—index of the indicator in a group, i = 1 ... n.
For the groups:
  • k—index of the project being implemented in an ecosystem;
  • j—group index for the k-th project;
  • djk—j-th group weight for the k-th project;
  • Fjk—integral assessment of indicators for the k-th project from a group.
Thus, we set the following tasks:
1. To assess indicators in each elementary group.
To solve this problem, the following scale for evaluating indicators of the target value is proposed (Table 2). If the indicator is quantitative, then gradations can be determined through relative (or absolute) deviations, i.e., as (ci − fi) or (fi/ci).
2. To determine the weights of the estimates in the elementary group and the weights of the groups for all projects, starting with the elementary.
Tasks may be solved by pairwise comparisons. The application of the method assumes the presence of the so-called matrix of pairwise comparisons A:
A = a 11 a 12 a 1 n a 21 a 22 a 2 n a n 1 a n 2 a n n
An arbitrary element of the matrix (3) aij—is a positive number showing “how many times” the index i (in the row) exceeds the index j (in the column). i.e., here the value of the element aij is the value of preference in points of one indicator over another. To establish the values of aij, we will use the preference rating scale (Table 3).
Moreover, the matrix A in the ideal case should satisfy the following properties:
(1)
the matrix is inversely symmetric, i.e.,: a j i = 1 / a i j
(1)
the matrix is consistent, i.e.,: a i j = a i k a k j .
In this case, the maximum eigenvalue of the matrix A is equal to its order n (the remaining eigenvalues are zero), and the corresponding eigenvector is a vector of weights of objects.
y ¯ = ( y 1 , y 2 , , y n ) ,   i = 1 , n ¯
It should be noted that the eigenvector (4) is not normalized, and this property must be satisfied for the weights of the compared objects. Normalized weights can be calculated using the formula:
d i = y i i = 1 n y i ,   i = 1 , n ¯
Then the sum of the weights will be equal to 1.
3. To determine the integral estimate of the PA.
The integral PA score is defined as the geometric weighted average of the group score estimates, i.e.,
F j 1 = i f i d i
4. To determine the integral indicator of k-th level groups.
Similarly to Formula (4), for groups of the k-th level we have:
F j k = i F i d i k
i.e., weighted geometric mean of subgroups of j-th group.
5. To identify the potential for sustainable ecosystem development.
The integral indicator of IEP (industrial ecosystem potential) is defined as an indicator of the group of the highest level of the hierarchy, according to Formula (7). Thus, in the integral indicator, we can use both qualitative and quantitative estimates characterizing the effectiveness of the processes occurring in the ecosystem.
A qualitative assessment of the ecosystem potential should be carried out by experts based on the significance of each component. To quantify the potentials of ecosystem actors, the authors propose the use of groups of integrated indicators in accordance with the ecosystem structure shown in Figure 4.
A comprehensive literature review indicates that most publications provide examples of the separate potentials’ compilation for various ecosystems. For example, Hatziiordanou, et al. [39] give the examples of the natural potential assessing for biological ecosystems based on the guidelines of the European Environment Agency and European Commission Research Center [40]. For regional ecosystems [41,42,43], the innovative and investment potentials are mainly evaluated. Kim and Bae [5] provide an example of assessing the circulating potential of automobile vehicles for the automobile concern. Some authors have attempted to assess the potential of clusters using integral indicators, rather than individual types of potentials. In the paper [44], an example of assessing the potential of a textile cluster was given.
When forming a group of integrated indicators, the authors of the article proceeded from the definition of an ecosystem and the principles of its functioning, the circularity of resources and ecosystem sustainability. The set of indicators in each group may vary depending on the objectives of the assessment, types of projects, time intervals and other factors. The interpretation of the results of the potentials’ assessment depends on the goals and objectives of the projects for which they are considered.
Table 4 shows examples of possible integral indicators for assessing the potentials of actors, reflecting their contribution to the development of the ecosystem and groups of actors. The potential of the ecosystem as a whole can be assessed through the sustainability of its development.
When assessing the ecosystem actors’ potentials, an integrated criterion, the potential for the first and second levels of the hierarchy, is determined as the integrating result of indicators of the third hierarchy level (elementary group).
Moreover, there are certain requirements for the formation of an integral criterion through a hierarchy of indicators:
  • The integral criterion should allow evaluating the final results of the efficiency of the processes.
  • The integral criterion should allow presenting it in the form of a hierarchy (pyramid) of local criteria, which, as a result, form an integral system of criteria.
  • The structure of the integral criterion should be invariant, covering several levels simultaneously.
The advantage of the proposed method for assessing the ecosystem actors’ potentials is that the results obtained can be comparable in dynamics at different levels of the ecosystem and with other ecosystems. In addition, the data obtained can be combined with other indicators for further comprehensive analysis.
Basically, the proposed method allows joint assessment of all types of potentials of an ecosystem at three levels (actors, groups of actors, and the ecosystem as a whole). Meanwhile, the potential of an ecosystem is influenced by the interconnections between actors and groups of actors. Therefore, the lack of separate assessment of potentials of individual actors does not affect the reliability of the whole ecosystem potential calculations results. It seems problematic to demonstrate complete calculations for each ecosystem level within one article, mainly due to its volume limitation. Furthermore, the industrial ecosystems presented in the case studies below are at various phases of the life cycle, thereby, it does not allow calculating all types of potentials for one ecosystem. For example, the «Baltic Symbiosis» ecosystem is at the “birth” phase. Accordingly, baseline data on reducing CO2 emissions and resource consumption are not available to measure its circular potential.

5. Results

Empirical Case Studies from Industrial Ecosystems “Kalundborg Symbiosis” and “Baltic Industrial Symbiosis”

Kalundborg Symbiosis is the first industrial ecosystem in the world that works on the basis of a symbiotic model and implements the principle of circularity, consisting in the fact that the waste of one actor becomes resources for others. The introduction of industrial symbiosis as a model of sustainable development and an instrument of a circular economy allowed the Kalundborg industrial ecosystem to reduce annual CO2 emissions by 635 tons, water consumption by 3.6 m3 and energy by 100 GWh, which amounted to 24 million Euros in value terms [45,46].
Kallunborg Symbiosis appeared as a result of interactions between actors around key resources —water, energy, materials. The actors in the Kalundborg ecosystem are 12 public and private companies linked by a network of material and energy flows (Figure 4).
One of Kalundborg’s strategic goals is to fully utilize the resource flows within the production loop. It is planned to implement 10 projects aimed at optimizing and closing resource chains by 2025. Major projects related to the transition to green energy [47].
Project 1 (P1): Obtaining energy from biomass (wood chips) to replace coal energy.
Project 2 (P2): Extraction of biogas from by-products and wastewater.
Project 3 (P3): Abandonment of the principle of power supply by the principle of marginality.
With this approach, to obtain additional capacity, the cheapest source of energy is used at current loads.
Three ecosystem’s actors are involved in the implementation of projects for the transition to green energy: Asnæs power station (A1), Kalundborg Bioenergi (A2), Orsted (A3) [20].
To assess the circular potential of the Kalundborg Symbiosis industrial ecosystem through the potentials of actors implementing joint projects, the authors propose using a group of indicators related to resource efficiency and reducing the environmental burden on the environment. Based on possible models for the implementation of the circularity principle proposed by OECD, it is advisable to use the following indicators to assess the circular potential of an ecosystem: Reduced resource, energy, and CO2 emissions.
The initial data for calculating the circular potential of the Kalundborg ecosystem are presented in Table 5. To convert the quantitative values of the indicators to points on a dimensionless ten-point scale that is common for all parameters of the assessment model, the Harrington desirability function was applied [19]. The desirability scale establishes a correspondence between a numerical and an empirical system of preferences.
In accordance with the Harrington methodology, the lower limit of indicator value admissibility is the reduction of CO2 emissions as 0 (one-sided restriction). Then, on the scale of desirability, this limit corresponds to d = 0.37. The value of this indicator, equal to one million tons, is “very good,” that is, on the scale of desirability, it corresponds to 0.8 (d = 0.8). Then, using Formulas (4) and (5), the coded values of these control points (yij) and the coded value of the desired parameter were calculated.
y ( 1 ) = ln ln ( 1 / 0.37 ) = 0.00576
y ( 10 ) = ln ln ( 1 / 0.8 ) = 1.4999
The equation y = a y + b acts as a mechanism for transition y в y’. The value of “a” and “b” can be found through a system of equations.
0.00576 = a 1 + b
1.4999 = a 10 + b
Therefore, a = 0.16576 and b = −0.16025.
Define the coded value of the parameter CO2 emissions reduction. When y = 0, yij = 0.37, and the level of desirability is d = 0.69. In a similar way, indicators were evaluated for other actors. The calculation results are given in Table 6. The resulting indicator for assessing the ecosystem’s circular potential (Fc) is recommended to be defined as the geometric mean of three components: reduction of CO2 emissions and energy consumption, resource-saving (Formula (6)).
The circulation potential of the ecosystem calculated according to Formula (7), was Fc = 0.575.
Diagnostic results for three components, as well as a general assessment, are determined in points on a scale whose boundary marks are 0 and 1. The closer the actor’s potential rating to 1, the better this participant for the ecosystem from the position of all the potential building components. The value of the actors potential in the range from 0 to 1 correspond to the level on the Harrington scale of “very bad” (0.2–0); from 1 to 2—“bad” (0.37–0.20); from 2 to 3—“satisfactory” (0.63–0.37); from 3 to 4—“good” (0.80–0.63); from 4 to 5—“very good” (1.00–0.80).
According to the Harrington scale, the potentials of the actors Asnæs (0.51) and Orsted (0.55) are classified as “satisfactory”, and the potential of the actor Kalundborg Bioenergi (0.68) is classified as “good”.
The circular potential of the industrial ecosystem “Kalundborg Symbiosis” is realized quite productively, but supposedly, not in full. For example, the actor Asnæs is one of the key participants in the ecosystem around whose resources (energy, steam, and by-products) exchange relationships were formed. In accordance with the EU policy on reducing greenhouse gas emissions and finance the environmental projects, the potential of this actor must be evaluated primarily from a strategic perspective. From a managerial point of view, it is advisable for actors to continue working on joint circular projects, improving joint business processes, introducing new technologies, and thereby, strengthening symbiotic ties within the ecosystem.
The Kalundborg Symbiosis industrial ecosystem initiated a global project to create the Baltic Industrial Symbiosis (BIS) industrial ecosystem under the 2014–2020 Interreg Baltic Sea Region program, which brought together the European Union and Russia to develop innovative, transport and environmental potentials of the Baltic region [48,49]. Later, Kalundborg Symbiosis developed the concept and platform for BIS.
Ecosystem pacemaker—Tyreman Group implements the activities of the Baltic Industrial Symbiosis project in Russia and forms an ecosystem of manufacturing companies interested in symbiosis through the Symbiosis Center in St. Petersburg [50]. The main Russian actors in BIS are the Mineral State Unitary Enterprise, the St. Petersburg cluster of clean technologies for the urban environment, and the “Northern Shrimp». This large-scale program is being implemented in two phases of 2014–2020 and 2021–2027 years.
The objectives of the program second phase:
  • Formation of potentials for the development of industrial enterprises.
  • Growth of potentials among practitioners of industrial symbiosis in taking advantages of ecosystem collaboration.
  • Formation of new business opportunities during the implementation of the program.
  • Acceleration of business development based on circular and ecosystem approaches.
To assess the integration potential of the BIS program second stage o, the authors applied an assessment model based on the Harrington methodology. As the initial data, the quantitative indicators listed in Table 7 are used. To transfer the quantitative value of the integration activities’ results into points on a dimensionless ten-point scale that is common to all parameters of the assessment model, the Harrington desirability function was used.
Evaluation of the ecosystem’s integration potential was carried out on the basis of Formulas (6) and (7). The results are presented in Table 8.
Diagnostic results for three components, as well as a general assessment, are determined in points on a scale whose boundary marks are 0 and 1. The closer the actor’s potential rating is to 1, the better this participant is for the ecosystem from the position of all the potential building components. According to the Harrington scale, the integration potentials of actors Western Europe (0.69) and Eastern Europe (0.63) are classified as “good”. The values of the integration potentials of Northern Europe (0.51) and Russia (0.47) correspond to the “satisfactory” category. The integration potential of the ecosystem calculated by Formula (7) is Fi = 0.61.
It is necessary to enhance the integration potential of actors by increasing the number of international cross-sectoral projects involving new ecosystem participants, increasing the volume of projects co-financing and strengthening international ties between ecosystem actors. Finally, this will lead to an increase in the integration potential of the ecosystem.

6. Discussion and Conclusions

In the modern world, the role of integration processes is growing, and the importance of assessing integration effects and potential is increasing both at the macro- and microlevels. The analysis of international publications on the integration potentials’ assessment of regions, territories, clusters and ecosystems made it possible to identify the following methods: Simple indicators, gravity models, models of cross-industry balance, equilibrium models, general equilibrium models. However, one of the most commonly used tools is the gravity model (CGE), as these models can be easily modified for a specific task. The choice of our method is determined by the availability and specificity of the data, duration of networking, the level of development, and other factors. Another advantage of the proposed tool is the ability to track the multiplicative effect on ecosystem parameters after changing any exogenous indicator.
To assess the compliance of the actual results of the activities of the actors of the industrial ecosystem with the target settings, an integral parameter was calculated based on the proposed groups of indicators. Methodological approaches to assessing ecosystem potentials are based on the laws of ecosystem functioning, including entropy equilibrium, and Harrington’s scale of preference.
We provided the empirical case study of two different industrial ecosystems, Kalundborg Symbiosis and Baltic Industrial Symbiosis. Based on the calculated indicators Fc = 0.575 and Fi = 0.61, it was established that the circular potential of the Kalundborg Symbiosis ecosystem is realized quite productively, but not in full. From a managerial point of view, it is advisable for actors to continue working on joint circular projects, improving joint business processes, introducing new technologies and thereby strengthening symbiotic ties within the ecosystem. The integration potential of the Baltic Industrial Symbiosis ecosystem. To further enhance ecosystem integration, it is recommended to increase the integration potential of actors by increasing the number and volume of co-financing of joint international cross-industry projects.
The holistic knowledge of circularity processes provides new information that supports academics, policymakers, government, and individuals with a more appropriate understanding of the conditions that help to eliminate the environmental problems faced in society, helping to achieve the country’s sustainable development goals.

7. Limitation and Future Research Directions

We have developed a novel methodological framework for industrial ecosystem potential assessment with a focus on integration and circular effects. Meanwhile, the proposed approach has some shortcomings and limitations caused by them. The following main limitations should be mentioned: It is not applicable for scenario calculations, labor-intensive approach, high volatility of estimates, problems of specification selection when choosing data sources, high susceptibility to the ranking method and parameter values.
We raise the following questions to be addressed as future lines of research. Firstly, it is necessary to develop conceptual and methodological aspects of the ecosystem’s sustainability (innovative, industrial, entrepreneurial, etc.) and classify the risks that arise for each actor involved in the ecosystem.
Secondly, the authors plan to further develop the theory of innovation ecosystems in terms of studying the impact of individual actors, the relationship between them, and the external environment on the stability of the ecosystem as a whole.
Thirdly, it will be necessary to adapt a proposed three-level methodology for assessing potentials for different types of ecosystems depending on the stage of the ecosystem’s life cycle.
Finally, it is necessary to validate the theoretical foundations and propose an extended system of indicators for assessing the circular potential of actors in the industrial ecosystem. Currently, most authors use the same indicators to assess circularity for measuring sustainability. This makes it difficult to reveal the contribution of circular processes to the achievement of environmental/green goals.

Author Contributions

T.T.: conceptualization, methodology, formal analysis, supervision. N.S.: writing—original draft preparation, collected data, data validation, performed the first data analyses; L.G.: conceptualization, elaborated the literature review, supervision, data validation, writing—original draft preparation. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the RFBR grant No. 20-010-00470.

Acknowledgments

We acknowledge the support given by anonymous reviewers.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Fischer, A.; Pascucci, S. Institutional incentives in circular economy transition: The case of material use in the Dutch textile industry. J. Clean. Prod. 2017, 155, 17–32. [Google Scholar] [CrossRef] [Green Version]
  2. Fedotkina, O.; Gorbashko, E.; Vatolkina, N. Circular economy in Russia: Drivers and barriers for waste management development. Sustainability 2019, 11, 5837. [Google Scholar] [CrossRef] [Green Version]
  3. Sverko Grdic, Z.; Krstinic Nizic, M.; Rudan, E. Circular economy concept in the context of economic development in EU countries. Sustainability 2020, 12, 3060. [Google Scholar] [CrossRef] [Green Version]
  4. Ghisellini, P.; Cialani, C.; Ulgiati, S. A review on circular economy: The expected transition to a balanced interplay of environmental and economic systems. J. Clean. Prod. 2016, 114, 11–32. [Google Scholar] [CrossRef]
  5. Bocken, N.; De Pauw, I.; Bakker, C.; Van Der Grinten, B. Product design and business model strategies for a circular economy. J. Ind. Prod. Eng. 2016, 33, 308–320. [Google Scholar] [CrossRef] [Green Version]
  6. Lewandowski, M. Designing the business models for circular economy—Towards the conceptual framework. Sustainability 2016, 8, 43. [Google Scholar] [CrossRef] [Green Version]
  7. Farber, S.; Costanza, R.; Childers, D.L.; Erickson, J.; Gross, K.; Grove, M.; Hopkinson, C.S.; Kahn, J.; Pincetl, S.; Troy, A.; et al. Linking ecology and economics for ecosystem management. Bioscience 2006, 56, 121–133. [Google Scholar] [CrossRef] [Green Version]
  8. Gladek, E. The Seven Pillars of the Circular Economy. Available online: https://www.greenbiz.com/article/7-pillars-circular-economy (accessed on 15 May 2020).
  9. Bruel, A.; Kronenberg, J.; Troussier, N.; Guillaume, B. Linking industrial ecology and ecological economics: A theoretical and empirical foundation for the circular economy. J. Ind. Ecol. 2019, 23, 12–21. [Google Scholar] [CrossRef] [Green Version]
  10. Erkman, S. Industrial ecology: An historical view. J. Clean. Prod. 1997, 5, 1–10. [Google Scholar] [CrossRef]
  11. Isenmann, R. Setting the boundaries and highlighting the scientific profile of industrial ecology. Inf. Technol. Env. Eng. 2008, 1, 32–39. [Google Scholar]
  12. Jollands, N. Concepts of efficiency in ecological economics: Sisyphus and the decision maker. Ecol. Econ. 2006, 56, 359–372. [Google Scholar] [CrossRef]
  13. Kallis, G.; Kerschner, C.; Martinez-Alier, J. The economics of degrowth. Ecol. Econ. 2012, 84, 172–180. [Google Scholar] [CrossRef]
  14. Stahel, W.R. The Performance Economy; Springer: Berlin/Heidelberg, Germany, 2010. [Google Scholar]
  15. Lovins, A.B.; Lovins, L.H.; Hawken, P. A road map for natural capitalism. Harv. Bus. Rev. 1999, 77, 218–234. [Google Scholar] [CrossRef]
  16. Mont, O. Clarifying the concept of product-service system. J. Clean. Prod. 2002, 10, 237–245. [Google Scholar] [CrossRef]
  17. Pauli, G.A. The Blue Economy: 10 Years, 100 Innovations, 100 Million Jobs; Paradigm Publications: Boulder, CO, USA, 2010. [Google Scholar]
  18. Borrello, M.; Pascucci, S.; Cembalo, L. Three propositions to unify circular economy research: A review. Sustainability 2020, 12, 4069. [Google Scholar] [CrossRef]
  19. Ayres, R.U. Industrial metabolism: Work in progress. Theory Implement. Econ. Models Sustain. Dev. 1998, 15, 195–228. [Google Scholar] [CrossRef]
  20. Frosch, R.A.; Gallopoulos, N.E. Strategies for manufacturing. Sci. Am. 1989, 261, 144–152. [Google Scholar] [CrossRef]
  21. Xu, F.J. The studies of the concept plan of the fengcheng industrial park towards the circular economy. Adv. Mater. Res. 2012, 598, 220–223. [Google Scholar] [CrossRef]
  22. Granstrand, O.; Holgersson, M. Innovation ecosystems: A conceptual review and a new definition. Technovation 2020, 90–91. [Google Scholar] [CrossRef]
  23. Wareham, J.; Fox, P.; Lluís Cano Giner, J. Technology ecosystem governance. Organ. Sci. 2014, 25, 1195–1215. [Google Scholar] [CrossRef]
  24. Carayannis, E.G.; Campbell, D.F.J. Knowledge Creation, Diffusion, and Use in Innovation Networks and Knowledge Clusters: A Comparative Systems Approach Across the United States, Europe, and Asia; Praeger Publishers: Westport, CT, USA, 2016; p. 253. [Google Scholar]
  25. Jackson, D.J. What is an Innovation Ecosystem? National Science Foundation: Arlington, VA, USA, 2011; pp. 1–11. [Google Scholar]
  26. Кleyner, G.B. Industrial ecosystems: A look into the future. J. Russ. Econ. Revival 2018, 3, 53–62. [Google Scholar]
  27. Shmeleva, N. Innovation ecosystems in metallurgical industry: Evolution, measurements and trends. In Proceedings of the 19th International Multidisciplinary Scientific GEO Conference SGEM 2019, Sofia, Bulgaria, 30 June–6 July 2019; Volume 18, pp. 1138–1147. [Google Scholar]
  28. Vasin, S.; Gamidullaeva, L.; Tolstykh, T.; Rostovskaya, T.; Skorobogatova, V. From innovation system through institutional transformation to digital innovation ecosystem. In Proceedings of the 31st International Business Information Management Association Conference, Milan, Italy, 25–26 April 2018; pp. 4620–4633. [Google Scholar]
  29. Yeo, Z.; Masi, D.; Low, J.; Ng, Y.; Tan, P.; Barnes, S. Tools for promoting industrial symbiosis: A systematic review. J. Ind. Ecol. 2019, 23, 1087–1108. [Google Scholar] [CrossRef] [Green Version]
  30. Dorokhina, E.Y.U. Industrial and eco-industrial parks as a means for the resolution of regional conflicts in the use of natural resources. Probl. Reg. Ecol. 2018, 2, 113–118. [Google Scholar] [CrossRef]
  31. Park, J.; Park, J.M.; Park, H.S. Scaling-up of industrial symbiosis in the Korean national eco-industrial park program: Examining its evolution over the 10 years between 2005–2014. J. Ind. Ecol. 2019, 23, 197–207. [Google Scholar] [CrossRef] [Green Version]
  32. Association of Industrial Parks of Russia. Industrial Parks of Russia. Industry review. 2019. Available online: https://indparks.ru/en/ (accessed on 10 March 2020).
  33. United Nations Industrial Development Organization (UNIDO); World Bank Group; GIZ. 2017 An International Framework for Eco-Industrial Parks. Available online: https://0-doi-org.brum.beds.ac.uk/10.1596/29110 (accessed on 12 April 2020).
  34. United Nations Industrial Development Organization (UNIDO). Eco-Industrial Parks–Achievements and Key Insights from the Global RECP Programme; UNIDO: Vienna, Austria, 2019. [Google Scholar]
  35. Chertow, M.R. Uncovering industrial symbiosis. J. Ind. Ecol. 2007, 1, 11–30. [Google Scholar]
  36. Ayres, R.U.; Simonis, U.E. (Eds.) Industrial Metabolism—Restructuring for Sustainable Development; United Nations University Press: Tokyo, Japan; New York, NY, USA; Paris, France, 1994. [Google Scholar]
  37. Kytzia, S.; Nathani, C. Bridging the gap to economic analysis: Economic tools for industrial ecology. Prog. Ind. Ecol. 2004, 1, 143–144. [Google Scholar] [CrossRef]
  38. Ellen MacArthur Foundation. Towards a Circular Economy: Business Rationale for an Accelerated Transition, Greener Management International; Ellen MacArthur Foundation: Cowes, UK, 2015. [Google Scholar]
  39. Hatziiordanou, L.; Fitoka, E.; Hadjicharalampous, E. Indicators for mapping and assessment of ecosystem condition and of the ecosystem service habitat maintenance in support of the EU Biodiversity Strategy to 2020. One Ecosyst. J. 2019, 4, 71–87. [Google Scholar] [CrossRef]
  40. European Commission Report, 2014. Available online: https://ec.europa.eu/environment/nature/knowledge/ecosystem_assessment (accessed on 24 March 2020).
  41. Mil’skaya, E.; Bychkova, A. Analysis and evaluation of innovation and investment activities potential of economic entities (for example, the Northwestern Federal District). St. Petersburg State Polytechn. Univ. J. Econ. 2017, 2, 45–53. [Google Scholar]
  42. Nauwelaers, C.; Reid, A. Methodologies for the evaluation of regional innovation potential. Sci. J. 1995, 34, 497–511. [Google Scholar] [CrossRef]
  43. Gamidullaeva, L.A.; Vasin, S.M.; Wise, N. Increasing small- and medium-enterprise contribution to local and regional economic growth by assessing the institutional environment. J. Small Bus. Enterp. Dev. 2020, 27, 259–280. [Google Scholar] [CrossRef]
  44. Aluftekin, N.; Tas, A. Assessment of cluster potential and decision making criterion in the textile and apparel sector using the analytic hierarchy process (AHP). Afr. J. Bus. Manag. 2011, 5, 9125–9136. [Google Scholar]
  45. Danielsson, S.; Møller, P.; Randers, L. Modelling CO₂ savings and economic benefits for the Kalundborg symbiosis. Available online: http://www.symbiosis.dk/wp-content/uploads/2018/06/KalundborgSymbiosisPaperLCA2018-06.pdf (accessed on 12 April 2020).
  46. Kalundborg Symbiosis: Six Decades of a Circular Approach to Production. Available online: https://circulareconomy.europa.eu/platform/en/good-practices/kalundborg-symbiosis-six-decades-circular-approach-production (accessed on 2 April 2020).
  47. Ehrenfeld, J.; Gertler, N. The Evolution of Interdependence at Kalundborg. J. Ind. Ecol. 1997, 1, 67–79. [Google Scholar] [CrossRef]
  48. Interreg Baltic Sea Region 2014–2020. Available online: https://projects.interreg-baltic.eu/projects/bis-186.html (accessed on 5 April 2020).
  49. Baltic Industrial Symbiosis. Available online: https://symbiosecenter.dk/project/bis/ (accessed on 2 April 2020).
  50. BIS Baltic Industrial Symbiosis. Available online: http://tyreman.ru/bis (accessed on 4 April 2020).
Figure 1. Roles of the ecosystem’s actors depending on the project’s life cycle. Source: Own elaboration.
Figure 1. Roles of the ecosystem’s actors depending on the project’s life cycle. Source: Own elaboration.
Sustainability 12 04574 g001
Figure 2. Generalized structure of ecosystem potentials. Source: Own elaboration.
Figure 2. Generalized structure of ecosystem potentials. Source: Own elaboration.
Sustainability 12 04574 g002
Figure 3. The potential structure of the industrial ecosystem. Source: Own elaboration.
Figure 3. The potential structure of the industrial ecosystem. Source: Own elaboration.
Sustainability 12 04574 g003
Figure 4. Interaction of actors in the Kallunborg industrial ecosystem. Source: https://www.ellenmacarthurfoundation.org/case-studies/effective-industrial-symbiosis
Figure 4. Interaction of actors in the Kallunborg industrial ecosystem. Source: https://www.ellenmacarthurfoundation.org/case-studies/effective-industrial-symbiosis
Sustainability 12 04574 g004
Table 1. Comparison of different industrial cooperation models.
Table 1. Comparison of different industrial cooperation models.
Models of Industrial CooperationCooperation TargetMatching CriteriaCoordination Mechanism
EcosystemProduct or digital innovation initiation and implementationLife cycle stages of projects, products, technologies and circularity principlesSelf-organization
Industrial symbiosisLimited resources usage optimizationComplementarily of by-products and inputsSelf-organization
ClusterMaintaining industry’s or regional competitivenessStages of the production processFederal and regional management institutions
NetworkEntrepreneurship activity based on joined resources and advantages usage by the participantsProduction or service value chainManaged by the key network participant
TechnoparkDevelopment and commercialization of innovation technologiesProperty complex with administrative infrastructureManaging company
Industrial parkCompetitive industrial productionIndustrial area with engineering infrastructure suitable for new production companiesManaging company
Eco-industrial parkJoint resources management at a certain territory to achieve sustainable socio-economic and ecological developmentGeographic proximity and technological complementarilyFederal and regional management institutions
Eco-industrial networkResource efficiency maintenance and negative environmental impact mitigation through closing resource loops at dispersed areasCooperation of dispersed infrastructure objects and customers based on sophisticated logistic networkKey participant or a managing company
Special economic zoneHi-tech, import substitution and tourism industries developmentBased on special conditions for entrepreneurship activityManaging company with the state as the sole shareholder
Table 2. Scale of estimates of indicators of the elementary group.
Table 2. Scale of estimates of indicators of the elementary group.
Evaluation fi, MarkDefinitionComments
1Absolute lagThe lag is undeniable
2Significant lagThe lag is explicit
3Average lagThe lag has practical confirmation
4Low lagThe lag is confirmed by indirect factors
5Equal to the targeted value
6Weak dominanceDominance is confirmed by indirect factors
7Average dominanceThe dominance has practical confirmation
8Significant dominanceThe dominance is explicit
9Absolute dominanceThe dominance is undeniable
Table 3. Preference rating scale.
Table 3. Preference rating scale.
Evaluation aij, MarkDefinitionComments
1Absolute lagIndicator i (in the line) is equally significant with the indicator j (in the column)
2Significant lagIntermediate value
3Average lag Indicator i slightly preferable than indicator j
4Low lagIntermediate value
5Equal to the targeted valueIndicator i clearly preferable than indicator j
6Weak dominanceIntermediate value
7Average dominanceThe superiority of indicator i over indicator j has practical confirmation
8Significant dominanceIntermediate value
9Absolute dominanceIndicator i undeniably exceeds indicator j
Table 4. Indicators for assessing the potential of ecosystem actors.
Table 4. Indicators for assessing the potential of ecosystem actors.
Potential TypeIntegral IndicatorsQuantitative/Expert
Indicators for Assessing the Potential of Actors in the Ecosystem
Technological potential1. The coefficient of technological exchange (the ratio of income and payments in the circulation of technology and R&D results)+/-
2. Technology update rate+/-
3. The share of unique technologies in the overall structure+/+
4. The level of information and communication support-/+
Innovative potential1. Total Innovation Index SII+/-
2. The innovative activity of the actor (the number of innovations introduced per unit time/activity level)+/+
3. Digital Maturity Level+/+
4. The proportion of the uniqueness of the products+/-
5. Research and development costs-/+
6. Innovation and project level (the number of innovative projects to the total number of ongoing projects)+/-
HR potential1. The level of managerial maturity-/+
2. The level of digital maturity of staff-/+
3. The level of maturity of project management+/+
4. The level of competency uniqueness (the number of employees with unique competencies to the total number of personnel).+/-
Financial potential1. Balanced financial result of the actor+/-
2. Return on total assets+/-
3. The level of financial leverage+/-
Strategic potential1. Correspondence of resources to the strategic goals of the actor-/+
2. Index of actor satisfaction with environmental quality-/+
3. The level of corporate culture-/+
Circular potential1. Reduced energy consumption+/+
2. Saved resources
3. Reduced CO2 emissions
Indicators for Assessing the Potential of Actor Groups in An Ecosystem
IntellectualIntegral indicator, which includes intellectual assets, unique technologies, percentage of submitted ideas.+/+
Integrative1. The level of cooperation between actors (cooperation)-/+
2. Transfer of knowledge, technology, results within the ecosystem+/-
3. The number and cost of joint projects in which ecosystem actors are involved.+/-
Table 5. Initial data for calculating the circular potential of the ecosystem for 2019.
Table 5. Initial data for calculating the circular potential of the ecosystem for 2019.
IndicatorsActor 1Actor 2Actor 3
1. Reducing CO2 emissions, tons685,54318,7735150
2. Reducing energy consumption, (MWh)650682,8880
3. Saving resources, tons−79,88000
Table 6. Interpretation of standard marks on the Harrington scale for assessing the circular potential of ecosystem actors.
Table 6. Interpretation of standard marks on the Harrington scale for assessing the circular potential of ecosystem actors.
ActorsReducing CO2 Emissions, TonsReducing Energy Consumption, (MWh)Saving Resources, TonsCircular Potential (Fc)
yijd1yijd2yijd3
A10.370.69−0.710.49−0.920.400.51
A2−0.960.380.200.820.001.000.68
A3−0.990.37−0.790.450.001.000.55
Table 7. The data for calculating the integration potential of Baltic Industrial Symbiosis (BIS).
Table 7. The data for calculating the integration potential of Baltic Industrial Symbiosis (BIS).
IndicatorsWestern EuropeEastern EuropeNorthern EuropeRussia
The cost of joint projects, in mln euros263.88.86.04.4
The amount of co-financing, up to%75855070
Number of joint projects10753
Table 8. Interpretation of standard marks on the Harrington scale for assessing the integration potential of the ecosystem.
Table 8. Interpretation of standard marks on the Harrington scale for assessing the integration potential of the ecosystem.
Actors Number of Joint ProjectsThe Cost of Joint ProjectsThe Amount of Co-FinancingHarrington’s Desirability Function
yijd1yijd2yijd3
WE1.4970.804.360.98−0.040.410.69
EU1.0000.691.300.76−0.020.450.63
NU 0.6690.600.830.65−0.080.340.51
Russia0.3370.480.010.56−0.030.380.47

Share and Cite

MDPI and ACS Style

Tolstykh, T.; Shmeleva, N.; Gamidullaeva, L. Evaluation of Circular and Integration Potentials of Innovation Ecosystems for Industrial Sustainability. Sustainability 2020, 12, 4574. https://0-doi-org.brum.beds.ac.uk/10.3390/su12114574

AMA Style

Tolstykh T, Shmeleva N, Gamidullaeva L. Evaluation of Circular and Integration Potentials of Innovation Ecosystems for Industrial Sustainability. Sustainability. 2020; 12(11):4574. https://0-doi-org.brum.beds.ac.uk/10.3390/su12114574

Chicago/Turabian Style

Tolstykh, Tatyana, Nadezhda Shmeleva, and Leyla Gamidullaeva. 2020. "Evaluation of Circular and Integration Potentials of Innovation Ecosystems for Industrial Sustainability" Sustainability 12, no. 11: 4574. https://0-doi-org.brum.beds.ac.uk/10.3390/su12114574

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop