Next Article in Journal
You Really Affect Me: The Role of Social Influence in the Relationship between Procedural Justice and Turnover Intention
Next Article in Special Issue
Influence of the Thermal Environment on Occupational Health and Safety in Automotive Industry: A Case Study
Previous Article in Journal
Occupational Traffic Accidents among Teachers in Spain
Previous Article in Special Issue
Healthcare Supply Chain Reliability: The Case of Medical Air Transport
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

How Should We Measure? A Review of Circular Cities Indicators

by
Andreea Loredana Bîrgovan
1,2,
Elena Simina Lakatos
1,2,
Andrea Szilagyi
1,2,
Lucian Ionel Cioca
3,4,
Roxana Lavinia Pacurariu
1,
George Ciobanu
5 and
Elena Cristina Rada
6,*
1
Institute for Research in Circular Economy and Environment “Ernest Lupan”, Calea Dorobantilor 71-73, 400609 Cluj-Napoca, Romania
2
Faculty of Industrial Engineering, Robotics and Production Management, Engineering and Management, Technical University of Cluj-Napoca, B-ul Muncii 103-105, 400609 Cluj-Napoca, Romania
3
Faculty of Engineering, Lucian Blaga University of Sibiu, Blv. Victoriei 10, 550024 Sibiu, Romania
4
Academy of Romanian Scientists, 010071 Bucharest, Romania
5
Faculty of Economics and Business Administration, University of Craiova, Str. Alexandru Ioan Cusa 13, 200585 Craiova, Romania
6
Department of Theoretical and Applied Sciences, Insubria University of Varese, Via G.B. Vico 46, 21100 Varese, Italy
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(9), 5177; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph19095177
Submission received: 28 March 2022 / Accepted: 20 April 2022 / Published: 24 April 2022

Abstract

:
As the world continues to urbanize, it is necessary to identify and implement new urban development models and strategies in order to meet the challenges of sustainable development. As cities continue to face challenges in becoming fully circular, the need to establish a framework to measure the circular economy in urban areas grows. Many definitions for circular cities have been developed and addressed in recent years, as have numerous indicators. To make the transition to a circular city, we must integrate the findings and develop a general definition and measurement framework. This article aims at outlining a framework for circular cities indicators based on their key characteristics, as well providing directions for fostering circularity at the city level. To accomplish this goal, we conducted a systematic review and analyzed key papers published in the field of circular economy to determine how circular cities are measured. Choosing the right indicators to use for developing, monitoring, and evaluating circular cities is a difficult task for urban policymakers, managers, and planners. This highlights the significance of standardized frameworks for urban indicators. As a result, the authors propose a framework and highlight some key points about circular cities and smart urban metabolism.

1. Introduction

The majority of the world’s population currently lives in cities, with the 50% mark being broken in 2007. The global urban population share was 55% in 2018 [1], with the UN expecting a 68% share by 2050 [2]. Cities have a significant economic impact, accounting for over 70% of global GDP [3]. Cities consume more than 70% of all global resources energy produced, emit 70% of all greenhouse gases [4], and generate almost 70% of global waste [3].
The present linear model of production and consumption in modern society is unsustainable. It is urgent to address the socioeconomic issues of population increase and a growing middle class [5]. The circular economy (CE), which aims to design out waste, maximize resource value, reduce negative effects, and generate economic, environmental, and social capital [5,6], is gaining traction as a potential solution to these concerns.
Indicators to assess the efficiency of the circular economy model are necessary to support the transition towards the circular city model. Currently, there is not a set of indicators for assessing how a city is effective in moving towards circularity, nor are there tools for supporting it.
While acknowledging that many metrics have already been developed that could be used to measure circularity, the present review focuses on the frameworks, indicators, and indices specifically developed for the environment, economics, and social and smart technologies at a macro level.

2. The Importance of Circular Economy in Cities

2.1. Circular Economy and Sustainability

The concept of sustainable development presented by the World Commission on Environment and Development (WCED) in the report “Our Common Future”, often known as the Brundtland Report, is undoubtedly the most well-known definition: “sustainable development is growth that seeks to meet the needs of the present without compromising the ability of future generations to meet their own needs” [7]. This indicates that economic, social, and environmental sustainability are required.
In terms of circular economy, the researchers discovered 114 different definitions on 17 dimensions after analyzing the literature [8]. The Ellen MacArthur Foundation (EMF) provided the definition to which we are referring in this article. The EMF defines “an industrial economy that is restorative and renewable by intention and design” [9]. “The word “recovery” is key since the circular economy tries to heal earlier damage by developing better mechanisms inside the industry unit itself, not just as a preventative method to minimize pollution” [10]. This approach tries to activate efficient flows of materials, energy, labor, and information in order to restore natural and social capital, according to EMF’s definition, which combines both environmental and economic benefits through the notion of regenerative performance. McDonough and Braungart (in Cradle to Cradle: Remaking the Way We Make Things) divide materials into two categories: biological materials designed to safely re-enter the biosphere and contribute to the restoration of natural capital, and nonbiological materials [9,11].
The circular economy is an economic model that was created as an alternative to the linear economic model that is presently used in most industries. The linear model comprises the production and consumption of products and services without assigning significant weight to environmental externalities, such as waste generation and pollution resulting from the exploitation of virgin resources, a model in which economic goals take precedence. The circular economy, on the other hand, refers to the production and consumption of goods and services through closed-loop material flows that account for environmental externalities that occur during the design phase of products and goods with the goal of decoupling economic prosperity from resource consumption [12].

2.2. The Importance of Circular Cities

According to official data, the European Union generates more than 2.5 billion tons of waste each year. It is actively adjusting its waste management regulations in order to facilitate the transition to a more sustainable circular economy. In March 2020, the European Commission announced a new action plan for the circular economy, which includes ideas for a more sustainable product design, waste reduction, and consumer empowerment, as part of the European Green Agreement and in line with a planned new industrial strategy (repairs).
Parliament passed a resolution on the new circular economy action plan in February 2021, calling for additional measures to achieve a carbon-neutral, environmentally sustainable, nontoxic, and fully circular economy by 2050, including rigorous recycling rules and mandatory material use and consumption targets by 2030.
“You can’t improve what you can’t measure!” as the saying goes. There are four key objectives in measuring the state of the art, progress, and impact of a circular economy, according to the Organization for Economic Co-operation and Development (OECD) report “Circular Economy in Cities and Regions”, which looked at 51 cities and regions. The four key objectives are: raising awareness, supporting the circular economy, triggering actions, performance monitoring, and evaluation of results [13].
Over 90% of raw materials used around the world are not recycled, resulting in tremendous overexploitation of our planet’s finite natural resources and a harmful impact on our climate. Every year, Earth Overshoot Day, an annual measure of the planet’s overexploitation, gets closer. It fell on 29 July this year, although it was 23 September before the turn of the century. Greenhouse gas emissions and pollution have risen to historic levels, posing a threat to the planet’s overall well-being [14].
In their search for solutions, the forerunners of sustainability began to shift away from the widely held linear economy of products and services production and use (take, manufacture, discard) toward circular solutions (make, (re)use, recycle). By decreasing the usage of raw materials and keeping materials in the loop for as long as is feasible, circularity offers the potential to address our world’s global sustainability concerns. Every human-made product’s ecological footprint is reduced and minimized, protecting the world. According to UN Environmental Statistics, a fully circular economy could reduce resource use by 28% while also reducing carbon emissions by 72% [14].
Cities are growth engines that require monitoring and control. These are the primary causes of climate change, accounting for up to 76% of all carbon emissions. Despite occupying fewer than 2% of the Earth’s area, they account for 75% of world natural resource usage and 50% of global garbage generation. In terms of solutions, cities attract creative talent and so allow societal transformations toward sustainability in both the public and commercial sectors. Cities are among the most powerful entities that can impact development favorably if they become circular:
  • The local government can encourage the reuse of building materials from its own construction, renovations, and demolition projects. As a result, the market for recycled building materials is stimulated.
  • Grants, incentives, and tax exemptions can be used by local governments to encourage the development of new technology.
  • Cooperation with other advanced cities to facilitate circular economy implementation. Supporting bottom–up efforts (idea competitions, startup funding).
An integrative definition for circular cities is the one synthesized by Paiho et al. (2020):
“A circular city is based on closing, slowing and narrowing the resource loops as far as possible after the potential for conservation, efficiency improvements, resource sharing, servitization and virtualization has been exhausted, with remaining needs for fresh material and energy being covered as far as possible based on local production using renewable natural resources”
[15]
Cities are one of the largest consumers of resources, but at the same time, they are incubators for innovation and have a huge potential to lead the transition to a circular economy. It has become really important to understand and define operable circular city indicators in order to understand where cities and citizens can have a real impact.

2.3. Circular Cities Indicators

The word “indicator” is derived from the Latin verb “indicare”, which means “to reveal” or “to indicate”, as well as “to announce” or “to make public”. According to Gallopin, indicators are valuable instruments for analyzing conditions and trends (even in connection to specific goals and targets), comparing places and situations, providing early warning information, and forecasting conditions and trends [16]. In terms of sustainability, indicators can help with communication by summarizing or simplifying key data, achieving perceptible phenomena of interest, and quantifying and measuring relevant data [16,17]. At various levels, such a communication role is expected to have a significant impact on supporting and improving political and decision-making processes [18].
In the context of circular cities, indicators can be used for monitoring, evaluation, and decision making. In reality, while establishing plans for the development and implementation of the circular economy, they can aid decision making by government officials and policymakers at both the local and national levels [19,20].
At the corporate level, however, indicators can assist managers in resolving operational difficulties, such as recognizing prospects for circular cities that are not currently (completely) explored and enhancing efficiency in utilizing existing synergies [21].
It is vital to build a measurement system in order to determine whether the CE principles result in meaningful changes [22]. “The ability to simplify, focus, and reduce the tremendous complexity of our dynamic environment into an easy to understand amount of useful information” is what indicators do [23]. Indicators, according to Church and Rogers [24], are “means of measuring change” that can be used to manage the transition to CE. Policy information, fostering literacy around the CE issue, allowing new quality standards, and comparing corporations for indices and sustainable investment markets could all benefit from CE indicators. In any case, Beratan et al. [17] emphasize the need of linking indicators to decision making and implementation. As a result, indicators are not sufficient in and of themselves to ensure a smooth transition to an CE, but they are a vital instrument in achieving this aim.
Many indicators are at the national level rather than at the level of the product [25,26]. The most high-profile of these comes from China, where the government uses well-known evaluation tools to analyze the effectiveness of its CE programs (e.g., life cycle assessment, ecoefficiency, and carbon footprint). Geng et al. (2013) [22] recognize that these indicators “weren’t designed for the closed-loop systemic feedback functions that characterize CE”.
The circular economy (CE) is being adopted by a number of countries throughout the world. Material flow analysis (MFA), energy analysis, and input–output analysis are currently used in macroscale CE monitoring [27]. In 2008, China became the first country to enact a particular law [28]; much of the CE literature pertains to China [29,30]. Germany and Japan have also been at the forefront of promoting the EC through real policy [22]. The European Union (EU) has agreed an action plan for the circular economy’s implementation towards the end of 2015 [31]. Other EU programs, such as resource efficiency [32] and waste legislation developed since the 1970s, previously included elements of the CE [33]. The European Commission (EC) recently suggested a circular economy monitoring framework [34]. The Ellen MacArthur Foundation (EMF) is credited for developing the concept of CE among private consultants [29].
Despite these efforts, there is no one-size-fits-all circular economy model at this time. Different players have different views of what CE can or should describe [35], and the connection to sustainability is not always obvious [8]. Despite the CE definition’s ambiguous constraints, particular procedures are required to track the CE’s progress. In this regard, indicators might be useful at various sizes of implementation and as a tool for assessing circularity [27,36].
However, because the concept is unclear and the indicators could lead to varied or even contradictory findings, what has to be monitored is being contested. Some authors have looked at the tools and approaches that have already been employed. Elia et al. [37] assessed a collection of procedures and indicators chosen from the European Environment Agency based on five features [38]. The authors pointed out that none of the indicators or approaches could track all of the characteristics. Iacovidou et al. [39] examined the strategies for evaluating waste resource recovery in order to enhance CE. Its findings revealed that none of the methodologies could explain the preservation of value in waste resources on their own, and that a comprehensive examination of the environmental, economic, social, and technical components of CE was required.
The monitoring framework for the circular economy is a concept for measuring development in the EU and its member states [34]. The indicators are divided into four categories under the “monitoring framework”: production and consumption, waste management, secondary raw materials, and competitiveness and innovation. Plastics, food waste, vital raw resources, building and demolition, and biomass and bio-based goods are all linked to the CE Action Plan for Europe’s priority areas [31]. There are ten indicators in the European Commission’s proposal, although six of them contain “sub-indicators”. The concept employs a total of twenty-four measuring guidelines. The metrics are based on data from Eurostat, the raw materials scoreboard, and the resource efficiency scoreboard, among other sources [34].
The indicators proposed by the European Commission are intended to assess and track the progress of the circular economy strategies announced by the European Union in the CE Action Plan 2015 [4], which measures four areas related to the various phases of the circular economy, including production and consumption, waste management, secondary raw resources, and competitiveness and innovation: all represented in the table below. As a result, the EC has released ten indicators, some of which are further subdivided into a set of sub-indicators, all of which are based on current Eurostat official statistics and backed up by additional official sources. Some metrics, such as green government procurement and food waste, are included despite the lack of a methodology.

3. Research Method

This study aims to see how the indicators of circular cities are distributed and to see which main themes are repeated frequently. This article aims at outlining a framework for circular cities indicators based on their key characteristics, as well as to further investigation and providing directions for fostering circularity at the city level. In order to do that, this study analyzes the most important research papers within the database of Web of Science (WOS). The goal is to see all the indicators and categories discussed in the research papers in order to understand the current situation in the academic world and how far the sector is from measuring circularity at the city level.
We used the stages suggested by Kitchenham [40] and adapted them in order to perform a systematic review: (1) planning the review, (2) conducting the review, and (3) reporting and dissemination (Figure 1).
In order to provide an overview of how the scientific community responds to methodological issues in order to measure the circularity of cities, a review of the literature on the WOS search engine was conducted using keywords in different combination (circular economy, circular cities, circular indicators, smart cities indicators, etc.). The search focused on (1) scientific articles or book chapters published in English from 2010 to 2021; (2) topics of interest (circular economy indicators, circular cities, implementation of the circular economy at the city level, urban metabolism); (3) the comparison between the measurement of circular cities in Europe versus the world. Metrics available online without a published methodological background were not considered in the present study.
This report, which is structured in the form of a review of circular city indicators, consisted of an advanced search, with the aim of exploring the instruments used to measure circularity with a focus on the city. The search was followed by a screening process, performed by reading the title and summary of each result.
The search returned 1065 results of which only 130 articles were considered the most representative at the first screening process (Figure 2). In the second step of the screening process, the authors read the abstract of every article which was selected in the first phase and decided to delete the following studies: (a) studies that did not directly address the issue of measuring circularity in a quantitative way or showed a high similarity to other articles already included in the review; (b) the articles which did not have developed or analyzed indicators at the city level; (c) the articles which were not presenting new ideas. After that, 30 articles remained. In addition to those articles, the authors decided to compare results with the action plan paper of European Union and add it to our review.

4. Results of the Review

Results came from examining research articles, including a series of other reviews in which indicators of circular cities were studied, both established by researchers in scientific journals and by analyzing a series of official documents and reports of cities that have adopted the circular city model. Thus, a number of interesting elements for aspects related to city measurement were observed after taking further steps in the transition to a circular economy.
Following our analysis, we discovered that there are various perspectives and definitions of circular cities. It would be extremely beneficial if everyone starts using a comprehensive definition that takes into account the various perspectives that researchers have when addressing circular cities. As a result of these various perspectives and definitions, we discovered that Paiho et al. [15] developed an integrative approach:
“A circular city is based on closing, slowing and narrowing the resource loops as far as possible after the potential for conservation, efficiency improvements, resource sharing, servitization and virtualization has been exhausted, with remaining needs for fresh material and energy being covered as far as possible based on local production using renewable natural resources”
[15]
However, even this definition which tried to synthetize more perspectives is referring mostly to the environmental dimension and it does not include the economic and social components. In order to make the definition more complex, we added to the above vision, as follows: It also integrates a way across all its functions in collaboration with researchers, citizens, and businesses in order to improve human well-being, reduce emissions, protect and enhance biodiversity, and promote social justice, in line with Sustainable Development Goals.
Additionally, not only were there many definitions for circular cities, this was also the case with indicators that were not very clearly defined or transparent. They often appear in articles, but there is no definition to understand exactly what they measure. To make the analysis easier, we attempted to categorize the information identified into four categories: environmental, social, economic, and smart.
Analyzing the indicators according to the framework proposed by us, it emerged that the indicators reported in scientific studies are primarily concerned with the environmental aspect, with little attention paid to the economic and social aspects. In the review conducted by Girard and Nocca [41], a total of 52 indicators assessing the environmental component (e.g., use of recycled goods in Municipal administration, amount of landfilled waste, recycling, rate of municipal waste, etc.) were identified, while only 6 indicators assessing the economic and financial components (spending on waste management, disposable income of households, reduction through reduced products and service costs, etc.) were identified (e.g., employment opportunities, job creation, active population in circular economy initiatives) with smart cities indicators.
In addition, we discovered some smart city indicators in the literature. These cities indicators, along with economic, environmental, and social indicators, are especially important at this time because we can now discuss smart urban metabolism. Considering the pandemic as well as the importance of technologies and digitalization, they should be incorporated into the measurement of circular cities.
Smart urban metabolism is a hybrid approach to developing smart and sustainable cities that takes into account technological, economic, environmental, and social perspectives. Smart urban metabolism becomes a strategic tool for decision makers, urban managers, and planners as a result of this feature. However, little is known about smart urban metabolism indicators.
To understand the functioning of cities and improve the efficiency of the processes that characterize urban metabolism, a holistic and multidimensional vision is required in order to support the following: waste management [42]; energy efficiency [43,44]; renewable energy sources [45,46]; water management [47]; cultural, social, and health aspects [48]; material flow [49,50]; biodiversity [51]; transport [52]; land use optimization [53]; air and noise pollution prevention [54]; environmental management systems [55]; and economic growth [56]—all within a resilient and technological context [57].
Figure 3 was generated to organize all of the publications that established and addressed circular city indicators that measure the environmental, social, economic, and smart components [58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,126,127,128,129,130,131,132,133,134,135,136].
However, the proportion of indicators identified in official documents and city-level reports is slightly different. As a result, a series of 96 environmental indicators were identified (e.g., recycling rate of municipal waste, use of recycled goods in municipal administration, public transportation usage, amount of reused resources, etc.), as well as 35 economic indicators (e.g., money saved in a year for an average household due to reducing the amount of products thrown away, budget allocated to stimulate pilot projects that employ circular economy at the local level; and environmental costs, such as cost of exhaustion, water pollution, CO2 emissions, toxicity, and land use); in addition, there were 46 social indicators identified (e.g., number of new green jobs, new business opportunities, number of training opportunities related to circular economy) and a series of standards and indicators for smart cities.
Circular cities can benefit from smart technologies in order to operate in a sustainable manner that meets the requirements of a circular economy. Intelligent electrical transportation, and green energy systems, for example, can be created using smart technologies to improve resource efficiency. Furthermore, smart technologies can aid in the creation of new jobs and the development of innovative products that can be easily recycled or repurposed without generating waste or releasing CO2 or toxins into the environment [137].
Many of the indicators identified in this study overlap, and we consider them more difficult to apply effectively in measuring a city and more difficult to manage by the authorities. Therefore, analyzing the indicators presented in Figure 3, we propose a series of indicators that appear most frequently in articles on the three dimensions: economic, environmental, and social. Our proposal is that the smart indicators should not be placed separately, considering that they address the three categories. We believe that the way we now talk about circular cities should overlap more with studies on intelligent urban metabolism. Thus, in Table 1, we can see our proposal of indicators. Of course, we selected these indicators, but we took into account another aspect, namely the seven pillars of the circular economy: materials are cycled at continuous high value; all energy is based on renewable sources; biodiversity is supported and enhanced through human activity; human society and culture are preserved; the health and well-being of humans and other species are structurally supported; human activities maximize the generation of societal value; and water resources are extracted and cycled sustainably.

5. Discussion

In order to facilitate the transition to a circular economy and to be able to make decisions in this direction, we need to understand the flow of materials and energy flows entering, being consumed, transformed, or stocked in and leaving cities, or, in other words, the urban metabolism. This means more specifically to use indicators to help us measure material, waste, water, and energy flows and stocks in cities and to have a clearer picture of the usefulness of infrastructure, stakeholders, and the elements that facilitate them. The fact that we can measure and have an overview of these loops can be a real help to see where we need to intervene and how we can connect the key elements. Additionally, in this way we can have a ranking system that can be used to measure the competitiveness of a city system and motivate cities to became circular.
Measuring cities’ performance in their transition to a circular economy allows cities to self-assess their achievements, identify barriers and opportunities, and adjust their development trajectory toward circularity accordingly. As a result of these considerations, the need for a solid and realistic framework of indicators for a circular economy transition in cities emerges. What is really missing, even though there are more and more studies in this direction, is a shared view on circular economy indicators among authorities and policy makers especially. There are data that every city can access more easily, so our initial proposal for a framework aims to have a core list of indicators that can fit every city.
For these reasons, we first tried through this study to provide a more complete definition and to define a simpler framework that can be applied in cities. However, of course, if we do not standardize such measuring instruments and do not have a series of similar assessments, it will be very difficult to compare cities and accelerate the transition.
This study has a number of limitations primarily due to the fact that it is a qualitative study, and even if we presented as the data transparently as possible, the way in which we selected the studies and the criteria used may include research bias. Additionally, only the articles in Web of Science have been included, and we may have omitted very relevant papers that do not appear in this database. Additionally, another limitation of this study is the fact that not all the indicators could be analyzed as accurately as possible because definitions were lacking in a large part of the articles. Another limitation is the combination of keywords we used in the way we built the database.

6. Conclusions

The circular economy (CE) is gaining attention, and monitoring frameworks and assessment tools are critical for documenting and measuring progress.
This systematic review examined the state of circular indicators at the city level, focusing on the issue of a large number of indicators that are currently more focused on the economic components in the scientific literature, with less emphasis on the social or environmental components and often exclude the smart technology factor.
Additionally, computerization, digitalization, and the efficiency of urban processes have become a priority for the development of residential areas, with the concept of “intelligent urban metabolism”/smart sustainable cities allowing us to achieve this goal [138,139]. In this sense, a city can be regarded as an open ecosystem characterized by a complex urban metabolism, owing to the numerous social, environmental, economic, governmental, and technological interactions between a wide range of internal and external actors [140,141,142,143].
This paper contributes to the theoretical development of the concept of circular cities by providing an integrated framework for circularity in cities and proposing some direction in order to make city measurement possible.
Circular cities indicators can be criticized for their lack of transparency and scientific basis. It was almost impossible to see how an indicator with similar label differs from another because of the lack of definitions. In order to solve this problem, we suggest that future studies standardize categories of indicators in order to have an appropriate level of transparency, quality, reliability, and consistency in their results. As a result, moving forward in measuring cities is extremely difficult if a widely accepted academic concept for the circular economy, circular cities, and indicators is not yet available. To figure out how to organize the indicators or how to use them to help with the transition to a more circular economy, we must first figure out what we want to monitor.
The authors believe that analyzing all of the criteria used to construct the indicators for circular cities would be beneficial to a future study as well. The authors tried to organize them by level of concern (environmental, economic, and social, using smart indicators at every level) in this review; however, in the literature we can see that there are many different ways in which these indicators have been organized and developed. We consider that the way we organize is simple and easy to use by everyone. Future studies could include more databases and articles to see which indicators are used the most according to the areas proposed by us and to improve this framework.
Future research should also consider using indicators that already exist and incorporating them into models such as Lakatos et al. [144], as well as the indicators for the 10R, to see how to achieve circular economy innovation at various levels.
Aside from the many different types of categories, we believe that having so many indicators can be a problem, making the implementation and measurement of cities more difficult and overwhelming.

Author Contributions

Conceptualization, A.L.B., A.S., R.L.P., E.S.L. and G.C.; methodology, A.L.B., A.S., R.L.P., E.S.L., L.I.C. and E.C.R.; software, A.L.B.; validation, A.L.B., A.S., R.L.P., E.S.L. and E.C.R.; formal analysis, A.L.B., A.S., R.L.P., E.S.L., L.I.C. and G.C.; investigation, A.L.B., A.S., R.L.P. and E.S.L.; resources, E.S.L.; data curation, A.L.B., A.S., R.L.P. and E.S.L.; writing—original draft preparation, A.L.B., A.S., R.L.P., E.S.L., and L.I.C.; writing—review and editing, A.L.B., A.S., R.L.P., E.S.L. and E.C.R.; visualization, L.I.C. and E.C.R.; supervision, E.S.L., L.I.C., G.C. and E.C.R.; project administration, E.S.L.; funding acquisition, E.S.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Institute for Research in Circular Economy and Environment “Ernest Lupan” on research and innovation programmer: GI2018-02, Grant No. 056/23.11.2018.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Acknowledgments

This work was supported by the Erasmus+ Programme, SafeEngine project, contract no 2020-1-RO01-KA203-080085.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. World Bank Open Data. Available online: https://data.worldbank.org/ (accessed on 23 August 2021).
  2. United Nations Department of Economic and Social Affairs. Available online: https://www.un.org/development/desa/en/news/population/2018-revision-ofworld-urbanization-prospects.html (accessed on 23 August 2021).
  3. The United Nations Conference on Housing and Sustainable Urban Development. The New Urban Agenda. Available online: http://habitat3.org/the-newurban-agenda/.EUinvestmentbank (accessed on 23 August 2021).
  4. European Investment Bank. The 15 Circular Steps for Cities; EU Publication: Luxembourg, 2018. [Google Scholar] [CrossRef]
  5. The Ellen MacArthur Foundation, towards a Circular Economy–Economic and Business Rationale for an Accelerated Transition. Available online: https://ellenmacarthurfoundation.org/towards-a-circular-economy-business-rationale-for-an-accelerated-transition (accessed on 23 August 2021).
  6. Webster, K. Ellen MacArthur Foundation, The Circular Economy: A Wealth of Flows. 2015. Available online: https://ellenmacarthurfoundation.org/the-circular-economy-a-wealth-of-flows-2nd-edition (accessed on 23 August 2021).
  7. Brundtland, G.H. Report of the World Commission on Environment and Development: Our Common Future; UN: New York, NY, USA, 1987. [Google Scholar]
  8. Kirchherr, J.; Reike, D.; Hekkert, M. Conceptualizing the circular economy: An analysis of 114 definitions. Resour. Conserv. Recycl. 2017, 127, 221–232. [Google Scholar] [CrossRef]
  9. MacArthur, E. Towards the circular economy. J. Ind. Ecol. 2013, 2, 23–44. [Google Scholar]
  10. Murray, A.; Skene, K.; Haynes, K. The Circular Economy: An Interdisciplinary Exploration of the Concept and Application in a Global Context. J. Bus. Ethics 2017, 140, 369–380. [Google Scholar] [CrossRef] [Green Version]
  11. Lieder, M.; Asif, F.M.A.; Rashid, A.; Mihelič, A.; Kotnik, S. Towards circular economy implementation in manufacturing systems using a multi-method simulation approach to link design and business strategy. Int. J. Adv. Manuf. Technol. 2017, 93, 1953–1970. [Google Scholar] [CrossRef] [Green Version]
  12. Sauvé, S.; Bernard, S.; Sloan, P. Environmental sciences, sustainable development and circular economy: Alternative concepts for trans-disciplinary research. Environ. Dev. 2016, 17, 48–56. [Google Scholar] [CrossRef] [Green Version]
  13. OECD. The Circular Economy in Cities and Regions: Synthesis Report, OECD Urban Studies; OECD Publishing: Paris, France, 2020; Available online: https://0-www-oecd--ilibrary-org.brum.beds.ac.uk/sites/10ac6ae4-en/index.html?itemId=/content/publication/10ac6ae4-en (accessed on 23 August 2021).
  14. Dhawan, P.; Beckmann, J. Circular Economy Guidebook for Cities. 2018. Available online: https://www.cscp.org/wp-content/uploads/2019/03/Circular_Cities_Publication.pdf (accessed on 13 November 2021).
  15. Paiho, S.; Mäki, E.; Wessberg, N.; Paavola, M.; Tuominen, P.; Antikainen, M.; Heikkilä, J.; Rozado, C.A.; Jung, N. Towards circular cities—Conceptualizing core aspects. Sustain. Cities Soc. 2020, 59, 102143. [Google Scholar] [CrossRef]
  16. Gallopín, G.C. Environmental and sustainability indicators and the concept of situational indicators. A systems approach. Environ. Model. Assess. 1996, 1, 101–117. [Google Scholar] [CrossRef]
  17. Beratan, K.K.; Kabala, S.J.; Loveless, S.M.; Martin, P.J.; Spyke, N.P. Sustainability Indicators as a Communicative Tool: Building Bridges in Pennsylvania. Environ. Monit. Assess. 2004, 94, 179–191. [Google Scholar] [CrossRef] [PubMed]
  18. Gallopin, G.C. Indicators and their use: Information for decision-making. In Sustainability Indicators; Moldan, B., Billharz, S., Matravers, R., Eds.; John Wiley & Sons: New York, NY, USA, 2005; p. 13. [Google Scholar]
  19. Chiu, A.S.F.; Yong, G. On the industrial ecology potential in Asian Developing Countries. J. Clean. Prod. 2004, 12, 1037–1045. [Google Scholar] [CrossRef]
  20. Park, H.-S.; Behera, S.K. Methodological aspects of applying eco-efficiency indicators to industrial symbiosis networks. J. Clean. Prod. 2014, 64, 478–485. [Google Scholar] [CrossRef]
  21. Fraccascia, L.; Albino, V.; Garavelli, C.A. Technical efficiency measures of industrial symbiosis networks using enterprise input-output analysis. Int. J. Prod. Econ. 2017, 183, 273–286. [Google Scholar] [CrossRef]
  22. Geng, Y.; Sarkis, J.; Ulgiati, S.; Zhang, P. Measuring China’s Circular Economy. Science 2013, 339, 1526–1527. [Google Scholar] [CrossRef] [PubMed]
  23. Geoffrey, L.; Todd, C. Defining Thresholds for Freshwater Sustainability Indicators within the Context of South African Water Resource Management. In Proceedings of the Second WARFSA/WaterNet Symposium, Cape Town, South Africa, 30–31 October 2001. [Google Scholar]
  24. Church, C.; Rogers, M.M. Designing for Results: Integrating Monitoring and Evaluation in Conflict Transformation Programs; Search for Common Ground: Washington, DC, USA, 2006. [Google Scholar]
  25. Åkerman, E. Development of Circular Economy Core Indicators for Natural Resources. Master’s Thesis, KTH Royal Institute of Technology Stockholm, Stockholm, Sweden, 2016. [Google Scholar]
  26. EASAC. Indicators for a Circular Circular Economy. 2016. Available online: https://easac.eu/fileadmin/PDF_s/reports_statements/Circular_Economy/EASAC_Indicators_web_complete.pdf (accessed on 23 August 2021).
  27. Kalmykova, Y.; Sadagopan, M.; Rosado, L. Circular economy—From review of theories and practices to development of implementation tools. Resour. Conserv. Recycl. 2018, 135, 190–201. [Google Scholar] [CrossRef]
  28. CIRAIG. Circular Economy: A Critical Literature Review of Concepts. Centre for the Life Cycle of Products Processes and Services, Montreal. 2015. Available online: https://www.ciraig.org (accessed on 23 August 2021).
  29. Ghisellini, P.; Cialani, C.; Ulgiati, S. A Review on Circular Economy: The Expected Transition to a Balanced Interplay of Environmental and Economic Systems. J. Clean. Prod. 2016, 114, 11–32. [Google Scholar] [CrossRef]
  30. Homrich, A.S.; Galvão, G.; Abadia, L.G.; Carvalho, M.M. The circular economy umbrella: Trends and gaps on integrating pathways. J. Clean. Prod. 2018, 175, 525–543. [Google Scholar] [CrossRef]
  31. EC. Closing the Loop-An EU Action Plan for the Circular Economy-COM (2015) 614 Final. 2015. Available online: https://www.eea.europa.eu/policy-documents/com-2015-0614-final (accessed on 23 August 2021).
  32. EC. Roadmap to a Resource Efficient Europe-COM (2011) 571 Final. 2011. Available online: https://www.eea.europa.eu/policy-documents/com-2011-571-roadmap-to (accessed on 23 August 2021).
  33. Council Directive 75/442/EEC on Waste. The Council of the European Communities. Available online: https://www.legislation.gov.uk/eudr/1975/442/contents (accessed on 23 August 2021).
  34. CEC. Measuring Progress towards Circular Economy in the European Union–Key Indicators for a Monitoring Framework-SWD (2018) 17 Final. European Commission, Strasbourg. 1975. Available online: https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:52018SC0017&from=LV (accessed on 23 August 2021).
  35. Bîrgovan, A.L.; Vatca, S.D.; Bacali, L.; Szilagyi, A.; Lakatos, E.S.; Cioca, L.I.; Ciobanu, G. Enabling the Circular Economy Transition in Organizations: A Moderated Mediation Model. Int. J. Environ. Res. Public Health 2022, 19, 677. [Google Scholar] [CrossRef] [PubMed]
  36. Geng, Y.; Fu, J.; Sarkis, J.; Xue, B. Towards a national circular economy indicator system in China: An evaluation and critical analysis. J. Clean. Prod. 2012, 23, 216–224. [Google Scholar] [CrossRef]
  37. Elia, V.; Gnoni, M.G.; Tornese, F. Measuring circular economy strategies through index methods: A critical analysis. J. Clean. Prod. 2017, 142, 2741–2751. [Google Scholar] [CrossRef]
  38. EEA. Circular Economy in Europe-Developing the Knowledge Base: Report 2; European Environment Agency: Copenhagen, Denmark, 2016. [CrossRef]
  39. Iacovidou, E.; Millward-Hopkins, J.; Busch, J.; Purnell, P.; Velis, C.A.; Hahladakis, J.N.; Zwirner, O.; Brown, A. A pathway to circular economy: Developing a conceptual framework for complex value assessment of resources recovered from waste. J. Clean. Prod. 2017, 168, 1279–1288. [Google Scholar] [CrossRef]
  40. Kitchenham, B. Procedures for Performing Systematic Reviews; Keele University: Keele, UK, 2004; Volume 33, pp. 1–26. [Google Scholar]
  41. Girard, L.F.; Nocca, F. Moving towards the Circular Economy/City Model: Which Tools for Operationalizing This Model? Sustainability 2019, 11, 6253. [Google Scholar] [CrossRef] [Green Version]
  42. Aazam, M.; St-Hilaire, M.; Lung, C.H.; Lambadaris, I. Cloud-based smart waste management for smart cities. In Proceedings of the 2016 IEEE 21st International Workshop on Computer Aided Modelling and Design of Communication Links and Networks (CAMAD), Toronto, ON, Canada, 23–25 October 2016. [Google Scholar]
  43. Chui, K.T.; Lytras, M.D.; Visvizi, A. Energy Sustainability in Smart Cities: Artificial Intelligence, Smart Monitoring, and Optimization of Energy Consumption. Energies 2018, 11, 2869. [Google Scholar] [CrossRef] [Green Version]
  44. Ghiani, E.; Serpi, A.; Pilloni, V.; Sias, G.; Simone, M.; Marcialis, G.; Armano, G.; Pegoraro, P.A. A Multidisciplinary Approach for the Development of Smart Distribution Networks. Energies 2018, 11, 2530. [Google Scholar] [CrossRef] [Green Version]
  45. Lund, H. Renewable Energy Systems: A Smart Energy Systems Approach to the Choice and Modeling of 100% Renewable Solutions; Academic Press: Cambridge, MA, USA, 2014. [Google Scholar]
  46. Strielkowski, W.; Streimikiene, D.; Fomina, A.; Semenova, E. Internet of Energy (IoE) and High-Renewables Electricity System Market Design. Energies 2019, 12, 4790. [Google Scholar] [CrossRef] [Green Version]
  47. Ler, L.G.; Gourbesville, P. Framework Implementation for Smart Water Management. EPiC Ser. Eng. 2018, 3, 1139–1146. [Google Scholar]
  48. Macke, J.; Sarate, J.A.R.; Moschen, S.D.A. Smart sustainable cities evaluation and sense of community. J. Clean. Prod. 2019, 239, 118103. [Google Scholar] [CrossRef]
  49. Kennedy, C.; Cuddihy, J.; Engel-yan, J. The Changing Metabolism of Cities. J. Ind. Ecol. 2007, 11, 43–59. [Google Scholar] [CrossRef]
  50. Krausmann, F.; Schandl, H.; Eisenmenger, N.; Giljum, S.; Jackson, T. Material Flow Accounting: Measuring Global Material Use for Sustainable Development. Annu. Rev. Environ. Resour. 2017, 42, 647–675. [Google Scholar] [CrossRef]
  51. Morimoto, Y. Biodiversity and ecosystem services in urban areas for smart adaptation to climate change: “Do you Kyoto”? Landsc. Ecol. Eng. 2011, 7, 9–16. [Google Scholar] [CrossRef] [Green Version]
  52. Sadiku, M.N.; Shadare, A.E.; Musa, S.M. Smart Transportation: A Primer. Int. J. Adv. Res. Comput. Sci. Softw. Eng. 2017, 7, 6–7. [Google Scholar] [CrossRef]
  53. Kim, G.; Miller, P.A.; Nowak, D.J. Urban vacant land typology: A tool for managing urban vacant land. Sustain. Cities Soc. 2018, 36, 144–156. [Google Scholar] [CrossRef]
  54. Peng, H.; Bohong, Z.; Qinpei, K. Smart city environmental pollution prevention and control design based on Internet of Things. In IOP Conference Series: Earth and Environmental Science; IOP Publishing: Bristol, UK, 2017; Volume 94. [Google Scholar]
  55. Morrow, D.; Rondinelli, D. Adopting Corporate Environmental Management Systems: Motivations and Results of ISO 14001 and EMAS Certification. Eur. Manag. J. 2002, 20, 159–171. [Google Scholar] [CrossRef]
  56. Kumar, V.; Dahiya, B. Smart economy in smart cities. In Smart Economy in Smart Cities; Springer: Singapore, 2017; pp. 3–76. [Google Scholar]
  57. Shahrokni, H.; Lazarevic, D.; Brandt, N. Smart Urban Metabolism: Towards a Real-Time Understanding of the Energy and Material Flows of a City and Its Citizens. J. Urban Technol. 2015, 22, 65–86. [Google Scholar] [CrossRef]
  58. Linder, M.; Sarasini, S.; van Loon, P. A Metric for Quantifying Product-Level Circularity. J. Ind. Ecol. 2017, 21, 545–558. [Google Scholar] [CrossRef] [Green Version]
  59. Pauliuk, S.; Kondo, Y.; Nakamura, S.; Nakajima, K. Regional distribution and losses of end-of-life steel throughout multiple product life cycles—Insights from the global multiregional MaTrace model. Resour. Conserv. Recycl. 2017, 116, 84–93. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  60. EMF. Circularity Indicators: An Approach to Measure Circularity. 2015. Available online: https://ellenmacarthurfoundation.org/material-circularity-indicator (accessed on 23 August 2021).
  61. Cullen, J.M. Circular Economy: Theoretical Benchmark or Perpetual Motion Machine? J. Ind. Ecol. 2017, 21, 483–486. [Google Scholar] [CrossRef]
  62. De Wit, M.; Hoogzaad, J.; Ramkumar, S.; Friedl, H.; Douma, A. The Circularity Gap Report: An Analysis of the Circular State of the Global Economy; Circle Economy: Amsterdam, The Netherlands, 2018. [Google Scholar]
  63. Cayzer, S.; Griffiths, P.; Beghetto, V. Design of indicators for measuring product performance in the circular economy. Int. J. Sustain. Eng. 2017, 10, 289–298. [Google Scholar] [CrossRef] [Green Version]
  64. Fogarassy, C.; Horvath, B.; Kovacs, A.; Szoke, L.; Takacs-Gyorgy, K. A Circular Evaluation Tool for Sustainable Event Management—An Olympic Case Study. Acta Polytech. Hung. 2017, 14, 161–177. [Google Scholar] [CrossRef]
  65. Park, J.Y.; Chertow, M.R. Establishing and testing the “reuse potential” indicator for managing wastes as resources. J. Environ. Manag. 2014, 137, 45–53. [Google Scholar] [CrossRef]
  66. Di Maio, F.; Rem, P.C.; Baldé, K.; Polder, M. Measuring resource efficiency and circular economy: A market value approach. Resour. Conserv. Recycl. 2017, 122, 163–171. [Google Scholar] [CrossRef]
  67. Franklin-Johnson, E.; Figge, F.; Canning, L. Resource duration as a managerial indicator for Circular Economy performance. J. Clean. Prod. 2016, 133, 589–598. [Google Scholar] [CrossRef]
  68. Rada, E.C.; Ragazzi, M.; Torretta, V.; Castagna, G.; Adami, L.; Cioca, L.I. Circular economy and waste to energy. AIP Conf. Proc. 2018, 1968, 030050. [Google Scholar] [CrossRef]
  69. Laso, J.; Garcia-Herrero, I.; Margallo, M.; Vazquez-Rowe, I.; Fullana, P.; Bala, A.; Gazulla, C.; Irabien, A.; Aldaco, R. Finding an economic and environmental balance in value chains based on circular economy thinking: An eco-efficiency methodology applied to the fish canning industry. Resour. Conserv. Recycl. 2018, 133, 428–437. [Google Scholar] [CrossRef]
  70. Huysman, S.; De Schaepmeester, J.; Ragaert, K.; Dewulf, J.; De Meester, S. Performance indicators for a circular economy: A case study on post-industrial plastic waste. Resour. Conserv. Recycl. 2017, 120, 46–54. [Google Scholar] [CrossRef]
  71. Scheepens, A.E.; Vogtländer, J.G.; Brezet, J.C. Two life cycle assessment (LCA) based methods to analyse and design complex (regional) circular economy systems. Case: Making water tourism more sustainable. J. Clean. Prod. 2016, 114, 257–268. [Google Scholar] [CrossRef]
  72. Adibi, N.; Lafhaj, Z.; Yehya, M.; Payet, J. Global Resource Indicator for life cycle impact assessment: Applied in wind turbine case study. J. Clean. Prod. 2017, 165, 1517–1528. [Google Scholar] [CrossRef]
  73. Haas, W.; Krausmann, F.; Wiedenhofer, D.; Heinz, M. How Circular is the Global Economy? An Assessment of Material Flows, Waste Production, and Recycling in the European Union and the World in 2005. J. Ind. Ecol. 2015, 19, 765–777. [Google Scholar] [CrossRef]
  74. Evans, J.; Bocken, N.M.P. CE Toolkit. 2013. Available online: http://circulareconomytoolkit.org/ (accessed on 23 August 2021).
  75. Lee, H.M.; Lu, W.F.; Song, B. A framework for assessing product End-Of-Life performance: Reviewing the state of the art and proposing an innovative approach using an End-of-Life Index. J. Clean. Prod. 2014, 66, 355–371. [Google Scholar] [CrossRef]
  76. Mesa, J.; Esparragoza, I.; Maury, H. Developing a set of sustainability indicators for product families based on the circular economy model. J. Clean. Prod. 2018, 196, 1429–1442. [Google Scholar] [CrossRef]
  77. Bovea, M.D.; Pérez-Belis, V. Identifying design guidelines to meet the circular economy principles: A case study on electric and electronic equipment. J. Environ. Manag. 2018, 228, 483–494. [Google Scholar] [CrossRef]
  78. Figge, F.; Thorpe, A.S.; Givry, P.; Canning, L.; Franklin-Johnson, E. Longevity and Circularity as Indicators of Eco-Efficient Resource Use in the Circular Economy. Ecol. Econ. 2018, 150, 297–306. [Google Scholar] [CrossRef]
  79. Collivignarelli, M.C.; Abbà, A.; Miino, M.C.; Caccamo, F.M.; Torretta, V.; Rada, E.C.; Sorlini, S. Disinfection of Wastewater by UV-Based Treatment for Reuse in a Circular Economy Perspective. Where Are We at? Int. J. Environ. Res. Public Health 2020, 18, 77. [Google Scholar] [CrossRef] [PubMed]
  80. Li, R.; Su, C. Evaluation of the circular economy development level of Chinese chemical enterprises. Procedia Environ. Sci. 2012, 13, 1595–1601. [Google Scholar] [CrossRef] [Green Version]
  81. Li, W. Comprehensive evaluation research on circular economic performance of eco-industrial parks. Energy Procedia 2011, 5, 1682–1688. [Google Scholar] [CrossRef] [Green Version]
  82. Zhao, H.; Guo, S.; Zhao, H. Comprehensive benefit evaluation of eco-industrial parks by employing the best-worst method based on circular economy and sustainability. Environ. Dev. Sustain. 2018, 20, 1229–1253. [Google Scholar] [CrossRef]
  83. Kayal, B.; abu Ghunmi, L.; Archenti, A.; Nicolescu, M.; Larkin, C.; Corbet, S. An economic index for measuring firm’s circularity: The case of water industry. J. Behav. Exp. Financ. 2019, 21, 123–129. [Google Scholar] [CrossRef]
  84. Pagotto, M.; Halog, A. Towards a Circular Economy in Australian Agri-food Industry: An Application of Input-Output Oriented Approaches for Analyzing Resource Efficiency and Competitiveness Potential. J. Ind. Ecol. 2016, 20, 1176–1186. [Google Scholar] [CrossRef]
  85. Felicio, M.; Amaral, D.; Esposto, K.; Durany, X.G. Industrial symbiosis indicators to manage eco-industrial parks as dynamic systems. J. Clean. Prod. 2016, 118, 54–64. [Google Scholar] [CrossRef]
  86. Wen, Z.; Li, R. Materials Metabolism Analysis of China’s Highway Traffic System (HTS) for Promoting Circular Economy. J. Ind. Ecol. 2010, 14, 641–649. [Google Scholar] [CrossRef]
  87. Sałabun, W.; Palczewski, K.; Wątróbski, J. Multicriteria Approach to Sustainable Transport Evaluation under Incomplete Knowledge: Electric Bikes Case Study. Sustainability 2019, 11, 3314. [Google Scholar] [CrossRef] [Green Version]
  88. Faizi, S.; Rashid, T.; Sałabun, W.; Zafar, S.; Wątróbski, J. Decision Making with Uncertainty Using Hesitant Fuzzy Sets. Int. J. Fuzzy Syst. 2018, 20, 93–103. [Google Scholar] [CrossRef] [Green Version]
  89. Chun-Rong, J.; Jun, Z. Evaluation of Regional Circular Economy Based on Matter Element Analysis. Procedia Environ. Sci. 2011, 11, 637–642. [Google Scholar] [CrossRef] [Green Version]
  90. Qing, Y.; Qiongqiong, G.; Mingyue, C. Study and Integrative Evaluation on the development of Circular Economy of Shaanxi Province. Energy Procedia 2011, 5, 1568–1578. [Google Scholar] [CrossRef] [Green Version]
  91. Haupt, M.; Vadenbo, C.; Hellweg, S. Do We Have the Right Performance Indicators for the Circular Economy? Insight into the Swiss Waste Management System. J. Ind. Ecol. 2016, 21, 615–627. [Google Scholar] [CrossRef]
  92. Mayer, A.; Haas, W.; Wiedenhofer, D.; Krausmann, F.; Nuss, P.; Blengini, G.A. Measuring Progress towards a Circular Economy: A Monitoring Framework for Economy-wide Material Loop Closing in the EU28. J. Ind. Ecol. 2018, 23, 62–76. [Google Scholar] [CrossRef] [Green Version]
  93. Tisserant, A.; Pauliuk, S.; Merciai, S.; Schmidt, J.; Fry, J.; Wood, R.; Tukker, A. Solid Waste and the Circular Economy: A Global Analysis of Waste Treatment and Waste Footprints. J. Ind. Ecol. 2017, 21, 628–640. [Google Scholar] [CrossRef] [Green Version]
  94. Rada, E.; Zatelli, C.; Cioca, L.; Torretta, V. Selective Collection Quality Index for Municipal Solid Waste Management. Sustainability 2018, 10, 257. [Google Scholar] [CrossRef] [Green Version]
  95. IDEAL&COExplore. Circularity Calculator. 2016. Available online: http://www.circularitycalculator.com (accessed on 23 August 2021).
  96. Prendeville, S.; Cherim, E.; Bocken, N. Circular Cities: Mapping Six Cities in Transition. Environ. Innov. Soc. Transitions 2018, 26, 171–194. [Google Scholar] [CrossRef] [Green Version]
  97. Williams, J. Circular Cities: Challenges to Implementing Looping Actions. Sustainability 2019, 11, 423. [Google Scholar] [CrossRef] [Green Version]
  98. Pacurariu, R.L.; Vatca, S.D.; Lakatos, E.S.; Bacali, L.; Vlad, M. A Critical Review of EU Key Indicators for the Transition to the Circular Economy. Int. J. Environ. Res. Public Health 2021, 18, 8840. [Google Scholar] [CrossRef]
  99. Croci, E. Circular cities: Setting the agenda. In Proceedings of the International Conference Circular Cities: Promoting Sustainable Innovation in Urban Systems and Service within the Energy-Food-Water-Climate Nexus, Milan, Italy, 12 March 2018. [Google Scholar]
  100. Cavaleiro de Ferreira, A.; Fuso-Nerini, F. A Framework for Implementing and Tracking Circular Economy in Cities: The Case of Porto. Sustainability 2019, 11, 1813. [Google Scholar] [CrossRef] [Green Version]
  101. Marin, J.; De Meulder, B. Interpreting Circularity. Circular City Representations Concealing Transition Drivers. Sustainability 2018, 10, 1310. [Google Scholar] [CrossRef] [Green Version]
  102. Owen, A.; Liddell, J. Implementing a circular economy at city scale—A challenge for data and decision making, not technology. In Proceedings of the International SEEDS Conference 2016: Sustainable Ecological Engineering Design for Society, Leeds, UK, 14–15 September 2016. [Google Scholar]
  103. Agenda Stad. The Perspective of the Circular City; Agenda Stad: Amsterdam, The Netherlands, 2015. [Google Scholar]
  104. Li, Y.; Matsumoto, T.; Fujiyama, A. Consideration and Application of Evaluation Indicators of Regional Circular and Ecological Sphere (CES) for the Utilization of Woody Biomass. Nat. Environ. Pollut. Technol. 2021, 20, 1989–1995. [Google Scholar] [CrossRef]
  105. Cities of Tomorrow. Circular Cities. Available online: https://www.enel.com/content/dam/enel-com/media/document/cities-of-tomorrow_it.pdf (accessed on 23 August 2021).
  106. Circular Cities: Hello Jobs, Goodbye Waste. Available online: https://envisioncharlotte.com/wp-content/uploads/2018/03/20180201_S_Charlotte_EcoNetworkSeries_EN_Eva.pdf (accessed on 23 August 2021).
  107. Karaeva, A.; Magaril, E.; Torretta, V.; Viotti, P.; Rada, E.C. Public Attitude towards Nuclear and Renewable Energy as a Factor of Their Development in a Circular Economy Frame: Two Case Studies. Sustainability 2022, 14, 1283. [Google Scholar] [CrossRef]
  108. Papageorgiou, A.; Henrysson, M.; Nuur, C.; Sinha, R.; Sundberg, C.; Vanhuyse, F. Mapping and assessing indicator-based frameworks for monitoring circular economy development at the city-level. Sustain. Cities Soc. 2021, 75, 103378. [Google Scholar] [CrossRef]
  109. Moraru, R.I.; Babut, G.B.; Cioca, L.I. Study of methane flow in caved goafs ajacent to longwall faces in Valea Jiului basin. In Proceedings of the Internetional Multidisciplinary Scientific GeocConference: SGEM, Albena, Bulgaria, 16–22 June 2013; Volume 1, pp. 731–738. [Google Scholar]
  110. Cong, L.; Zhao, F.; Sutherland, J.W. A Design Method to Improve End-of-Use Product Value Recovery for Circular Economy. J. Mech. Des. 2019, 141, 044502. [Google Scholar] [CrossRef]
  111. Schiavone, F.; Paolone, F.; Mancini, D. Business model innovation for urban smartization. Technol. Forecast. Soc. Chang. 2019, 142, 210–219. [Google Scholar] [CrossRef]
  112. ISO 37106:2018; Sustainable Cities and Communities—Guidance on Establishing Smart City Operating Models for Sustainable Communities. ISO: Geneva, Switzerland, 2018. Available online: https://www.iso.org/obp/ui/#iso:std:iso:37106:ed-1:v1:en (accessed on 23 August 2021).
  113. SF-SSCC-Sector Forum on Smart and Sustainable Cities and Communities. Available online: https://www.cencenelec.eu/standards/Sectors/SmartLiving/smartcities/Pages/SSCC-CG (accessed on 23 August 2021).
  114. ISO/IEC 30146:2019; Information Technology—Smart city ICT Indicators. ISO: Geneva, Switzerland; IEC: Geneva, Switzerland, 2019. Available online: https://www.iso.org/obp/ui/#iso:std:iso-iec:30146:ed-1:v1:en (accessed on 23 August 2021).
  115. ISO 37120:2018; Sustainable Cities and Communities—Indicators for City Services and Quality of Life. ISO: Geneva, Switzerland, 2018. Available online: https://www.iso.org/obp/ui/#iso:std:iso:37120:ed-2:v1:en (accessed on 23 August 2021).
  116. CITYkeys. 2015. Available online: http://www.citykeys-project.eu/ (accessed on 23 August 2021).
  117. ISO 37122:2019; Sustainable Cities and Communities—Indicators for Smart Cities. ISO: Geneva, Switzerland, 2019. Available online: https://www.iso.org/standard/69050.html (accessed on 23 August 2021).
  118. ITU. Evaluation and Assessment Key Performance Indicators for Smart Sustainable Cities to Assess the Achievement of Sustainable Development Goals. 2016. Available online: https://www.itu.int/en/ITUT/ssc/united/Documents/SmartSustainableCities-KPI-ConceptNote-U4SSC-website.pdf (accessed on 23 August 2021).
  119. Lee, J.H. Smart Cities Index Report; Yonsei University: Seoul, Korea, 2019; p. 63. [Google Scholar]
  120. OECD. How’s Life? 2020: Measuring Well-Being; OECD Publishing: Paris, France, 2020. [Google Scholar] [CrossRef]
  121. Myeong, S.; Jung, Y.; Lee, E. A Study on Determinant Factors in Smart City Development: An Analytic Hierarchy Process Analysis. Sustainability 2018, 10, 2606. [Google Scholar] [CrossRef] [Green Version]
  122. Huovila, A.; Bosch, P.; Airaksinen, M. Comparative analysis of standardized indicators for Smart sustainable cities: What indicators and standards to use and when? Cities 2019, 89, 141–153. [Google Scholar] [CrossRef]
  123. Yeh, H. The effects of successful ICT-based smart city services: From citizens’ perspectives. Gov. Inf. Q. 2017, 34, 556–565. [Google Scholar] [CrossRef]
  124. Ismagilova, E.; Hughes, L.; Dwivedi, Y.K.; Raman, K.R. Smart cities: Advances in research—An information systems perspective. Int. J. Inf. Manag. 2019, 47, 88–100. [Google Scholar] [CrossRef]
  125. Chatterjee, S.; Kar, A.K.; Gupta, M. Success of IoT in Smart Cities of India: An empirical analysis. Gov. Inf. Q. 2018, 35, 349–361. [Google Scholar] [CrossRef]
  126. Sepasgozar, S.M.; Hawken, S.; Sargolzaei, S.; Foroozanfa, M. Implementing citizen centric technology in developing smart cities: A model for predicting the acceptance of urban technologies. Technol. Forecast. Soc. Chang. 2019, 142, 105–116. [Google Scholar] [CrossRef]
  127. Kumar, H.; Singh, M.K.; Gupta, M. A policy framework for city eligibility analysis: TISM and fuzzy MICMAC-weighted approach to select a city for smart city transformation in India. Land Use Policy 2019, 82, 375–390. [Google Scholar] [CrossRef]
  128. Yadav, G.; Mangla, S.K.; Luthra, S.; Rai, D.P. Developing a sustainable smart city framework for developing economies: An Indian context. Sustain. Cities Soc. 2019, 47, 101462. [Google Scholar] [CrossRef]
  129. Sureshchandra, S.M.; Bhavsar, J.J.; Pitroda, J.R. Assesment of Critical Success Factors for Smart Cities Using Significant Index Assesment Method. IJARIIE 2016, 2, 802–810. [Google Scholar]
  130. Aldegheishem, A. Success Factors of Smart Cities: A Systematic Review of Literature from 2000–2018. TeMA-J. Land Use Mobil. Environ. 2019, 12, 55–64. [Google Scholar]
  131. Lee, J.H.; Hancock, M.G.; Hu, M.-C. Towards an effective framework for building smart cities: Lessons from Seoul and San Francisco. Technol. Forecast. Soc. Chang. 2014, 89, 80–99. [Google Scholar] [CrossRef]
  132. McKinsey Global Institute. Smart Cities: Digital Solutions for a More Livable Future. 2018. Available online: https://www.mckinsey.com/~/media/mckinsey/business%20functions/operations/our%20insights/smart%20cities%20digital%20solutions%20for%20a%20more%20livable%20future/mgi-smart-cities-full-report.pdf (accessed on 23 August 2021).
  133. Gotlib, D.; Kulisiewicz, T.; Muraszkiewicz, M.; Olszewski, R. Multiagency Modeling of Transformation Strategies towards Sustainable Smart Cities. Appl. Sci. 2020, 10, 853. [Google Scholar] [CrossRef] [Green Version]
  134. Borsekova, K.; Koróny, S.; Vaňová, A.; Vitálišová, K. Functionality between the size and indicators of smart cities: A research challenge with policy implications. Cities 2018, 78, 17–26. [Google Scholar] [CrossRef]
  135. Shen, L.; Huang, Z.; Wong, I.S.; Liao, S.; Lou, Y. A holistic evaluation of smart city performance in the context of China. J. Clean. Prod. 2018, 200, 667–679. [Google Scholar] [CrossRef]
  136. Šiurytė, A.; Davidavičienė, V. An Analysis of Key Factors in Developing a Smart City. Moksl.-Liet. Ateitis/Sci.-Future Lith. 2016, 8, 254–262. [Google Scholar] [CrossRef] [Green Version]
  137. de Jong, M.; Joss, S.; Schraven, D.; Zhan, C.; Weijnen, M. Sustainable–smart–resilient–low carbon–eco–knowledge cities; making sense of a multitude of concepts promoting sustainable urbanization. J. Clean. Prod. 2015, 109, 25–38. [Google Scholar] [CrossRef] [Green Version]
  138. Boeri, A.; Gaspari, J.; Gianfrate, V.; Longo, D.; Boulanger, S.O.M. Circular city: A methodological approach for sustainable districts and communities. WIT Transact. Built Environ. 2019, 183, 73–82. [Google Scholar] [CrossRef] [Green Version]
  139. Sun, Y.; Song, H.; Jara, A.J.; Bie, R. Internet of Things and Big Data Analytics for Smart and Connected Communities. IEEE Access 2016, 4, 766–773. [Google Scholar] [CrossRef]
  140. Bibri, S.E.; Krogstie, J. Smart sustainable cities of the future: An extensive interdisciplinary literature review. Sustain. Cities Soc. 2017, 31, 183–212. [Google Scholar] [CrossRef]
  141. Batty, M. Model cities. Town Plan. Rev. 2007, 78, 125–151. [Google Scholar] [CrossRef]
  142. Sharifi, A. A critical review of selected smart city assessment tools and indicator sets. J. Clean. Prod. 2019, 233, 1269–1283. [Google Scholar] [CrossRef]
  143. Ioppolo, G.; Heijungs, R.; Cucurachi, S.; Salomone, R.; Kleijn, R. Urban Metabolism: Many open questions for future answers. In Pathways to Environmental Sustainability; Springer: Cham, Switzerland, 2014; pp. 23–32. [Google Scholar]
  144. Lakatos, E.; Yong, G.; Szilagyi, A.; Clinci, D.; Georgescu, L.; Iticescu, C.; Cioca, L.-I. Conceptualizing Core Aspects on Circular Economy in Cities. Sustainability 2021, 13, 7549. [Google Scholar] [CrossRef]
Figure 1. Systematic review steps adapted from Kitchenham [40].
Figure 1. Systematic review steps adapted from Kitchenham [40].
Ijerph 19 05177 g001
Figure 2. The study selection process.
Figure 2. The study selection process.
Ijerph 19 05177 g002
Figure 3. The reviewed studies on circular cities indicators [58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,126,127,128,129,130,131,132,133,134,135,136].
Figure 3. The reviewed studies on circular cities indicators [58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,126,127,128,129,130,131,132,133,134,135,136].
Ijerph 19 05177 g003
Table 1. Circular cities indicators.
Table 1. Circular cities indicators.
EnvironmentEconomicSocial
MFA AnalysisBudget allocated to stimulate pilot projects that employ circular economy at the local levelLivability/Quality of life ranking
Annual amount of CO2 emissionsMoney granted to businesses or research projects linked to the circular economyEmployment opportunities, job creation. Number of new jobs (circular economy, green, recycling)
Amount or percentage of cycled materialWaste management costsNumber of training opportunities related to circular economy events
Amount of waste produced in the cityEnvironmental costs (costs of exhaustion, water pollution, CO2 emissions, toxicity, and land use in EUR per kilogram)New business opportunities (that have integrated circularity into their development), number of local “green” companies
Use of renewable resourceE-governmentUnemployment rate
Virgin resources usedEconomic value of the resources used and the value at the time they are reintroduced into the systemQuality drinking water (population with access to safe drinking water)
Eco-car strategy—Municipal fleet powered by biogas, hydrogen, or electricity (including plug-in hybrids)Green public procurement/e-procurementNumber of new circular initiatives
ICT infrastructureSales of locally produced goodsEnvironmental education (% of schools)
Smart buildingsEconomic value of the resources usedPercent of population living below poverty line
Percentage of biodiversityResource usage: total raw material productivityPercentage of inhabitants with housing deficiency in any of the following 5 areas: potable water, sanitation, overcrowding, deficient material quality, or lacking electricity
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Bîrgovan, A.L.; Lakatos, E.S.; Szilagyi, A.; Cioca, L.I.; Pacurariu, R.L.; Ciobanu, G.; Rada, E.C. How Should We Measure? A Review of Circular Cities Indicators. Int. J. Environ. Res. Public Health 2022, 19, 5177. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph19095177

AMA Style

Bîrgovan AL, Lakatos ES, Szilagyi A, Cioca LI, Pacurariu RL, Ciobanu G, Rada EC. How Should We Measure? A Review of Circular Cities Indicators. International Journal of Environmental Research and Public Health. 2022; 19(9):5177. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph19095177

Chicago/Turabian Style

Bîrgovan, Andreea Loredana, Elena Simina Lakatos, Andrea Szilagyi, Lucian Ionel Cioca, Roxana Lavinia Pacurariu, George Ciobanu, and Elena Cristina Rada. 2022. "How Should We Measure? A Review of Circular Cities Indicators" International Journal of Environmental Research and Public Health 19, no. 9: 5177. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph19095177

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop