Next Article in Journal
Adaptation to the Impacts of Climate Extremes in Central Europe: A Case Study in a Rural Area in the Czech Republic
Next Article in Special Issue
Raising Competitiveness for Tourist Destinations through Information Technologies within the Newest Tourism Action Framework Proposed by the European Commission
Previous Article in Journal
Towards Sustainable Tourism Development in Urban Areas: Case Study on Bucharest as Tourist Destination
Previous Article in Special Issue
Organic Food Perception: Fad, or Healthy and Environmentally Friendly? A Case on Romanian Consumers
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Evaluating Romanian Eco-Innovation Performances in European Context

by
Adriana AnaMaria Davidescu
1,
Andreea Maria Vass Paul
2,
Rodica-Manuela Gogonea
1,* and
Marian Zaharia
3
1
Department of Statistics and Econometrics, Bucharest University of Economic Studies, 15–17 Dorobanti St., Sector 1, 010552 Bucharest, Romania
2
Department of International Economic Relations, Bucharest University of Economic Studies, 15–17 Dorobanti St., Sector 1, 010552 Bucharest, Romania
3
Petroleum-Gas University, 39 Bucuresti St., 100680 Ploiesti, Romania
*
Author to whom correspondence should be addressed.
Sustainability 2015, 7(9), 12723-12757; https://0-doi-org.brum.beds.ac.uk/10.3390/su70912723
Submission received: 29 June 2015 / Revised: 31 August 2015 / Accepted: 2 September 2015 / Published: 17 September 2015

Abstract

:
The field of eco-innovation is included in the area of sustainable development being closely related with ecological planning. In this context, this paper aims to evaluate Romanian eco-innovation performance during the period 2003–2013 by constructing a composite index and to also identify the main eco-innovation poles at the European level using multidimensional analysis techniques based on the eco-innovation specific indicators for the year 2013. This approach used the methodology of constructing composite indices proposed by Organization for Economic Co-operation and Development (OECD) in 2008. The index measured the eco-innovation dimensions in 27 countries over the period 2003–2013. The empirical analysis revealed the conclusion that in Romania, the eco-innovation level is low compared with other countries, thus Romania cannot emphasize its eco-innovation performance. The empirical results of the study highlighted that eco-innovation represents a phenomenon leading to significant progress in achieving the objective of sustainable development in Romania, and also at the European level, only if the importance of this area is awarded and eco-innovation measures are enforced through adequate policies, leading to economic growth.

1. Introduction

The third millennium debuts with profound changes, generated by worldwide crises and also by reform intentions of different international organizations. The collaboration of these organizations is aimed at reviving the economies by transforming the internationalization process into globalization.
Throughout time, the process has undergone many changes, as countries’ economies focus on sustainable development, in which environmental protection and resource regeneration are top priorities. Thus, nations attempt to complete their sustainable development plans with strategies that include the issue of eco-innovation.
In this context, this paper highlights issues surrounding the general study objective of eco-innovation performance evaluation during 2003–2013 and identification of Romania’s place among the major eco-innovation poles set at the 2013 European level. The fulfillment of the pursued goals was aimed at shaping new horizons in eco-innovation development, which lead to the adoption of strategic and management decisions that result in a high share of Romania’s economic growth process and its further integration into the international process of sustainable development.
Romania has always had a favorable framework for eco-innovation, being permanently situated at the merging point of domestic and foreign interests, with influences established between challenges, generated by political and economic global trends; pressure, caused by climate change and resource diminishment processes; opportunities, outlined by the global demand of technologies, environmental products and services; and also by financial resources that can be raised through various European funds.
In addition, the country has the suitable context of designing and developing initiatives for eco-innovation business, considering that (OECD Sustainable Manufacturing Toolkit, 2011) [1]:
  • The “green” market is worth trillions of dollars.
  • Retailers require suppliers to be accountable to “green” consumers.
  • A “green” reputation leads to financial value.
  • A small investment in the “green” domain can lead to great savings.
  • The new workforce generation values sustainability and demands “green” jobs—96% of young people want employers to be environmentally responsible.
This paper represents the results of processing 12 indicators grouped into five thematic areas: eco-innovation inputs, eco-innovation activities, eco-innovation outputs, resource efficiency and socio-economic outcomes for the 27 EU countries, through which aspects of eco-innovation are evaluated and analyzed.
The presented issues outline the reasons underlying the design of the research conducted in this article, which is organized into five sections.
Section 2 covers issues concerning the explanation of the eco-innovation concept by presenting different points of view from specialists in the field and from those concerned about this issue, which were included in the specialty literature.
Next, Section 3 highlights the methodology and other details regarding the research that will be applied to eco-innovation. This Chapter prepared framework of an index that measures eco-innovation dimensions in 27 countries over the period 2003–2013. The analysis uses 12 individual variables from five thematic areas for the period 2003–2013. The chosen method to explain the variance of the observed data through a few linear combinations of the original data was a specific technique belonging to Multivariate Analysis—the Multiway Principal Components Analysis (MPCA).
The final value given to each country–year observation is rescaled using the percentile rank. Therefore, the ECO-INNOVATION INDEX, as a percentile ranking, indicates how a country–year observation performs compared to the other country–year observations at its position.
The empirical results presented in Section 4 are highlighted as a consequence of constructing an ECO-INNOVATION INDEX in Romania (Section 4.1), and also of establishing and evaluating the key eco-innovation poles for the EU Member States in 2013 (Section 4.2).
The results showed that, in Romania, discussion of performance in terms of eco-innovation cannot be made, as Romania ranks being among the last countries in the EU, established through the composite index of eco-innovation and cluster analysis, determining the poles of eco-innovation from EU countries.
The paper ends, on the one hand, with conclusions, which include a summary of the obtained results, and, on the other hand, with a specification of their present and future impact on the Romanian economy and its sustainable development.

2. The Concept of Eco-Innovation and the Premises of Research Achievement

In a world dominated by climate change, pollution and diminishing natural resources, the key to prosperity is represented by a strong manifestation of sustainability in all areas of activity and in all countries, regardless of development level.
On the background of this framework, the concept of eco-innovation is outlined by innovation itself, which is manifested in close interdependence between technology and the environment, the activities being carried out without exhausting available resources and destroying the environment, thus according to sustainable principles.
In this context, eco-innovation can be considered an aspect of innovation in which the environmental involvement can be observed in shaping the resources, methods, techniques, activities, as well as the results, without compromising the ability to satisfy the needs of future generations.
Eco-innovation is one of the areas of prime interest in EU policies to ensure a sustainable future. In this regard, there are several studies [2,3,4,5] that identify measures and policies to promote the application and development of environmentally friendly technology.
On the other hand, technological development and application of technologies designed to ensure sustainable development is not only an objective of the EU, but also a global preoccupation [6,7,8].
A clear and complete definition of the eco-innovation concept is very difficult, given the wide range of components and factors that define it, and also their complexity.
The concept of eco-innovation is fairly recent, the first attempts to define it being reported in the book “Eco-Driving Innovation: A Breakthrough for Innovation and Sustainability Courses” by Claude Fussler and Peter James [9].
A year later, Peter James defines eco-innovation as “new products and processes which provide customer and business value but significantly decrease environmental impacts” [10].
In 1999, Klemmer states that “Eco-innovations are all measures of relevant actors (firms, politicians, unions, associations, churches, private households) which develop new ideas, behaviours, products and processes, apply or introduce them, and which contribute to a reduction of environmental burden or to ecologically specified sustainability targets” [11].
Throughout time, the specialty literature has seen many approaches to eco-innovation, in order to shape a more complete and complex notion.
Thus, the concept is seen from multiple points of view, being outlined in close interdependence with the environment (environmental innovation) [12,13,14], as a technological term, using environmental technology (a combination of eco-efficiency, eco-design, and environmental design) [15,16], or as a social process [17].
It is important to note that eco-innovation is a technological term, is usually closely related to eco-efficiency, eco-design and it refers mainly to products and processes that reduce the impact on environment. Although many countries have developed innovative sustainable technologies for industry, these are not always practical, or enforced by policy and legislation. In this context, the decoupling and eco-efficiency issue appears [18], which “refers to breaking the link between ‘environmental bads’ and ‘economic goods’”.
This phenomenon is based on the idea that the notion that the rate of change of environmental variables are either “coupled”, “weakly decoupled”, or “absolutely decoupled” to economic variables, and assumes a priori that these variables are causally linked. At the same time, “decoupling is usually conceived as an elasticity focusing on changes in volumes, whereas efficiency is more concerned with the actual values of these ratios” [19].
Jackson appreciates that “it’s vital to distinguish between ‘relative’ and ‘absolute’ decoupling. Relative decoupling refers to a situation where resource impacts decline relative to the GDP. Impacts may still rise, but they do so more slowly than the GDP. The situation in which resource impacts decline in absolute terms is called ‘absolute decoupling’. Needless to say, this latter situation is essential if economic activity is to remain within ecological limits” [19].
In some studies, eco-innovation as eco-efficiency has been addressed through the ‘decoupling argument’, the possibility provided by technological innovations to diminish the amount of materials, energy and waste per unit of GDP, while other studies have questioned the eco-efficiency approach to sustainability by highlighting the intrinsic link between economic growth and material consumption [19].
Franceschini and Pansera [20] show the interaction between the dynamics of innovations and the evolution of demand as follows: “In the chart innovation can assume essentially three forms: a non-eco form in which eco-efficiency is not contemplated, on the contrary, it might even decrease; an eco-efficiency form in which innovation decouples economic growth from the consumption of non-renewable resources through technological progress; finally a systemic form in which innovation promotes changes in institutions, culture and society in order to create positive feedback between the development of greener technologies and the conservation of non-renewable resources. These three forms of innovation are combined with an increasing or decreasing demand. The result is a space composed by six areas, six interpretations of the relationship between innovation and demand that, we could define as narratives (business as usual, relative decoupling, green growth, limits to growth, absolute decoupling, techno thrift). The area in grey represents the ‘strong sustainability’ zone where natural capital can be preserved in its absolute value by reducing its depletion and/or increasing the efficiency of its exploitation. On the contrary, the white area coincides with the ‘weak sustainability’ zone where human-made capital is considered a legitimate substitute of natural capital”.
This approach was criticized by Hopwood et al. [21] and Carrillo-Hermosilla et al. [22], who attempted to fill in the shortcomings of eco-efficiency. The contradictory relationship between eco-efficiency and consumption, known as the “rebound effect” is found in the literature [23]. Study of the “rebound effect” demonstrated that the increase of the efficiency of extraction and utilization of natural resources might lead to an increase in their consumption [24,25,26,27,28].
Considering that the size of the “rebound effect” changes mainly in relation to price elasticity, exceeding the value of 100% compared to initial efficiency gains, results in the “Jevons Paradox” [29].
In economics, the “Jevons paradox” occurs when technological progress increases the efficiency with which a resource is used (reducing the amount necessary for any one use), but the rate of consumption of that resource rises because of increased demand [30]. This paradox is named by the English economist, William Stanley Jevons, who in 1865 observed that technological improvements that increased the efficiency of coal-use led to increased consumption of coal in a wide range of industries. He argued that, contrary to common intuition, technological progress could not be relied upon to reduce fuel consumption. This paradox occurs when the effect from increased demand predominates, causing resource use to increase [29], or in other words, the gains in efficiency produced by technological innovation can be minimized or even neutralized by increasing demand [25,27,31].
Rebound effects have been described as behavioral responses to technical improvements [32], which have determined that the relationship between innovation and consumption constitute the general basis of crossing technology. In this direction, eco-efficiency solutions can reduce psychological commitment to sustainable behaviors [33,34,35].
The conceptual approaches have one thing in common regarding the need for the sustainability process to involve a compulsory limitation of demand or consumption: a demand reduction is not supported by an increase in eco-efficiency; however, consumption models facing the natural limits of the planet and demand/consumption levels inevitably shrink, and eventually collapse [36]. This scenario can have either pleasant or unpleasant consequences [20]:
  • The pleasant case occurs if societies develop a keener attitude towards frugality and the awareness about the ecological limits in which humanity lives.
  • The unpleasant one occurs when the encounter with the limits happens in societies that encourage consumption.
Jackson “argues compellingly that such‚ decoupling is a myth. A key area of argument, as with so much else in the current world, involves climate change. If we keep growing GNP, Jackson explains, then we fail to cut greenhouse gases deeply. This means we stoke destruction of prosperity beyond the short-term horizons—next quarter’s growth figures’ and all the rest—on which we routinely put such emphasis today” [19]. The author presents a solution to the problem as a global sustainable economy supported by actions of governments with the aim of developing macro-economic capability, investing in public assets and infrastructures, increasing financial and fiscal prudence, and reforming macro-economic accounting.
In 2002, Andersen states that “Eco-innovation is innovation which is able to attract green rents on the market” [36], and in 2008, Kemp, R. and Pearson, P. consider that eco-innovation “is the production, assimilation or exploitation of a product, production process, service or management or business method that is new to the organisation (developing or adopting it) and which results, throughout its life cycle, in a reduction of environmental risk, pollution and other negative impacts of resource usage (including energy usage) compared to relevant alternatives [37]”.
In the same year, OECD defines eco-innovation as “the creation of new or significantly improved products (goods and services), processes, marketing methods, organisational structures and institutional arrangements which—with or without intent—lead to environmental improvements compared to relevant alternatives” [38].
Anthony Arundel and René Kemp do not fully adopt this definition because it conflicts with the Oslo Manual definition of innovation, which includes the implementation of a new technology that was first developed by a different firm or institution [39].
In most developing countries outside the EU and OECD, economic development through eco-innovation is a priority. There are two main reasons for this [40]:
  • Developing countries are often most vulnerable to the impacts of environmental problems (for example, India and China use development to access eco-innovations relevant to both adapting to the impacts of climate change and reducing emissions of greenhouse gases to mitigate against future climate change).
  • Access to technology is a key determining factor of economic development levels (increased access to technology is one of the prerequisites of economic growth, self-reliant development and poverty alleviation).
By accessing eco-innovations, developing nations therefore open up the potential for technological change within existing industries, thus improving their competitive advantage through increased factor productivity and/or the development of new, competitive products and broadening the industrial base of a country via the establishment of new industry sectors with associated employment benefits, profits and public income through taxes [41,42]. Access to new technology not only offers the possibility of moving up the value chain, it also provides opportunities to diversify into new products similar to the ones originally imported [43].
China, like other OECD countries, has focused on eco-innovation policy by including public investment in Research &Development (R&D), mobilizing financing from multiple sources, government procuring environmentally friendly products, adopting prescriptive measures, adopting market-based instruments, awareness raising and capacity building, and acting globally.
The report [44] drafted by Wanxin Li reflects Chinese national priorities on energy security, energy efficiency, and a more environment-friendly model of development. Accordingly, it is focused on technologies for renewable energy, for energy efficiency and for pollution prevention and control; initiatives taken to promote a circular economy are also highlighted as they illustrate (sometimes non-technological) eco-innovations. Eco-cities projects are particularly emphasized. A short section presents selected information on measures to support the deployment of technologies to abate pollution. The report is not comprehensive: policies to support clean production, climate change mitigation and adaptation, and a low-carbon economy are not systematically covered, although they may support eco-innovation.
The introduction of eco-innovations in developing countries is an important factor in effectively tackling global environmental challenges, for eco-innovation markets and sustainable economic development. Policies need to be improved to better respond to technological and cultural requirements of eco-innovation, at both national and international levels [45].
Eco-innovations are a key area where developing countries might access new technologies with the support of international policy incentives. However, it must be acknowledged that this is a source of concern for industrialized country firms, which sometimes fear that this will result in them losing their competitive advantage, the centrality of information flows and indigenous innovation capabilities [23].
An important contribution to the specialty literature is represented by Könnölä et al. [46], which present and clearly justify in a complex fashion that eco-innovation consists of three key dimensions: design, user, product service and governance. It is stated that “the capacity of eco-innovations to provide new business opportunities and contribute to the transformation towards a sustainable society depends on the interplay of those dimensions (design, user, product service and governance) and the engagement of key stakeholders in the innovation process”. It is also noted that in the interaction between the three dimensions mentioned, the crucial role of eco-innovation is highlighted in:
  • The design components through the simultaneity between the optimization of process expansion, cost reduction and harmful impacts of the environment.
  • The design related to system changes through the potential of creating new alternatives for system reshaping and sustainable transaction management.
  • In the dimension “product service” in the direction of creating a new product, by redesigning a value from product chain and also at the level of building a logistic system, causing significant changes for delivered goods and services.
  • In the governance through cooperation, partnerships within and between elements of the public, private, academic, and business communities related to eco-innovation.
Eco-innovation can also be seen as a process that includes three essential elements: the product (seen in its entire life cycle, from conception, design and implementation, to use, reuse, and recycling), the company and the relations between product, company, customers and the environment.
Eco-innovation must not be seen only as a strategy to solve serious environmental problems, but also as a competitive source for firms and the emergence of new fields that can identify the determinants of economic development [47] oriented towards sustainable development.
Bryson and Lombardi [48] state that “The rise of the importance of sustainability leads to the inclusion of green growth in the agendas of corporate managers. Firms try to integrate non-financial objectives into their decision-making processes, to revisit the concepts of value and profitability that drive their business models, and to reevaluate the equilibrium between the objectives of short-term profitability and long-term sustainability [48]”.
In this context, a study presented Romania as a country with significant potential in the field of eco-innovation and with a basic role in the sustainable development process, both nationally and internationally.
The eco-innovation process, including all innovation that benefits the environment, can be regarded as a bridge between policymakers at the microeconomic and macroeconomic level with interconnected perspectives on Romania’s sustainable development.
The implementation of some policies and European requirements on the issue of eco-innovation it is related to the studies on the perception and implementation of eco-innovations in Romanian Small and Medium Enterprises (SMEs) [49,50,51,52].
The European Commission considers eco-innovation the key to Europe’s future competitiveness, stressing that “Eco-innovation refers to all forms of innovation—technological and non-technological—that create opportunities to develop economic activities that have a positive environmental impact through prevent or reduce the impact of these activities, or by optimizing the use of resources. Eco-innovation is closely linked to how we use our natural resources, the way we produce and consume and also to the concepts of “eco-efficiency” and “eco-industry”. It encourages businesses to shift from solutions such as “end-of-pipe” to approaches “closed-loop” who reduce raw material and energy flows by changing products and production methods—creating a competitive advantage for many” enterprises and sectors [53].
In this context, the practical approach, which includes Eco-innovation Action Plan (EcoAP), the European Commission’s flagship initiative “Resource efficient Europe in terms of resource use”, eco-innovation Observatory, etc., which outlines the directions of action in the sustainable development plan can be highlighted. [54,55,56].
Arundel and Kemp [39] mention that “An alternative version developed by the OECD follows the Oslo Manual by dividing eco-innovations into product, process, organizational marketing and institutional innovation [57]. It also includes how firms introduce eco-innovations, for instance through modifying existing technology or creating entirely new solutions” [38]. Moreover, they state that the need to measure eco-innovation derives, on the one hand, from the expected environmental benefits, and on the other hand, from the fact that faced with rising costs for producing goods and managing waste products, the competitiveness of firms, countries and even regions is increasingly linked to their ability to “eco-innovate” [39].
The impact of eco-innovation through the course of sustainable economic activities therefore falls upon:
  • The economy, through the emergence of new services, products, markets, and business methods, namely by reducing material and energy costs.
  • The environment, by improving biodiversity and ecosystems, reducing the negative effects of climate change, through sustainable management of natural resources, etc.
  • Society, by creating new and sustainable jobs, and by raising the quality of life.
  • Politics, through a fair capacity of resource allocation and by fulfilling the goal of “security of materials”.
It is also important to mention the eco-innovation capacity to stimulate the employment process in shaping a green economy with direct impact on the economic growth, highlighting the formation of significant connections presented below [39]:
  • Cost-saving eco-innovations generate wealth that will be spent on goods and services that can have negative environmental impacts, creating second order environmental burdens.
  • Cost-increasing eco-innovations are likely to contribute more to an absolute decoupling but at the expense of lower economic growth.
  • Many normal innovations are de facto eco-innovations (by being more environmentally benign than relevant alternatives), but overall environmental gains will be impaired by economic growth produced by those innovations.
  • To assess the impacts of eco-innovation, one should look at what happens within and across value chains from resource extraction to waste management.
  • 21) Micro-behavior is affected by macro-factors (taxes, regulations, etc.).
Considering that each approach to eco-innovation has certain priority characteristics, it is further stated the existence of an eco-innovation classification developed by OECD in relation to environmental products ((A) pollution management; (B) cleaner technologies and products; and (C) resource management group). In this context, in 2008, OECD prepared and presented a methodology for developing composite indices, which is presented and used in the fulfillment of our purpose. The goal involved the construction of a composite index for assessing the performance of eco-innovation and the identification of the main eco-innovation poles at the European level, using panel analysis over the time (2003–2013) and space (27 EU countries).
If an indicator represents a single variable, a composite index aggregates multiple individual indicators to provide a synthetic measure (a summary statistic) of a complex, multidimensional, and meaningful issue.
The power of the composite index approach is in its ability to portray the results of an integrated analytical framework. While individual indicators can be informative, a well-designed and rigorous composite index has the potential to capture “the bigger picture” and the multidimensionality of complex systems.
Kaufmann and Kraay [58] assert that indicator aggregation has the potential to reduce the influence of measurement error associated with any individual indicator. On the other hand, others warn that indicator aggregation tends to amplify the influence of measurement error and that the problems referenced above that are associated with individual indicators are propagated in the process of aggregation into a composite index. Notwithstanding, building composite indices implies losing a certain amount of information and produce results that are less transparent. Furthermore, composite indices have been criticized because, in a way, they reintroduce unidimensionality.
Maggino and Zumbo [59] argue that a potential advantage of developing composite indices is that they can help to overcome problems concerning precision, reliability, accuracy, and validity that are associated with using individual indicators, a variable that is not directly observable through an individual indicator may require integration of multiple indicators, each corresponding to a particular aspect of the variable. Composite indices have the advantage of allowing the ranking of countries (or periods), because they represent the overall development level in one number [60].
The utility of such an aggregate measure resides in the opportunity to make comparison simultaneously over space and time, illustrating the eco-innovation performance across the EU member states over time. Thus, if we want to know which countries are making more progress toward the overall eco-innovation level and which countries are making less progress, we need to build a composite index.
The issues related to the concept of eco-innovation, from definition to measurement represent the premises for the processing of eco-innovation indicators. They have represented the basis of the research carried out in the article, allowing the construction of the composite index, in order to highlight the performances and to identify the main poles of eco-innovation at the European level, as well as mentioning the rank of Romania.

3. Methodology and Data

The central objective of this paper is to construct a composite index of Romanian eco-innovation performance during the period 2003–2013 and also to highlight main eco-innovation poles at the European level for the year 2013 using principal component analysis (PCA) based on panel data and a clustering technique.
The entirety of this paper has in the spotlight the composite index. The quality of a composite indicator, as well as the soundness of the messages it conveys, depend not only on the methodology used in its construction but also, primarily, on the quality of the framework and the data used (OECD, 2008) [21].
According to the Handbook of on Constructing Composite Indicators published by OCED in 2008 [21], the main ten steps that need to be followed in order to build a composite index are: theoretical framework, data selection, imputation of missing data, multivariate analysis, normalization, weighting and aggregation, uncertainty and sensitivity analysis, back to the data, links to other indicators, and visualization of the results.
After the identification of the theoretical framework, it is time to find the equivalent variables and to select data. The range of twelve variables was selected considering their use in the cited literature, analytical soundness, measurability, country coverage, relevance to the phenomenon being measured and relationship to each other.
The study aims to evaluate and to analyze different aspects of eco-innovation by applying 12 indicators grouped into five thematic areas: eco-innovation inputs, eco-innovation activities, eco-innovation outputs, resource efficiency and socio-economic outcomes for 27 EU countries over the period 2003–2013. Croatia was eliminated from the analysis due to the lack of data. Some specific variables were dropped from the analysis due to a large number of missing values.
The variables included in the analysis conducted in this research paper are presented in the following five thematic areas:
(1)
Eco-innovation inputs
  • Researchers, % of total employment
  • R&D personnel, % of total employment
  • Total intramural R&D expenditure
  • Total Government budget appropriations or outlays on R&D (GBAORD)
(2)
Eco-innovation activities
  • Organizations and sites with EMAS (EU Eco-Management and Audit Scheme for environmental management) registration
(3)
Eco-innovation outputs
  • Ecolabel licenses
  • Total environmental taxes
(4)
Resource efficiency outcomes
  • Greenhouse Gas emissions
  • Energy productivity
  • Material productivity
(5)
Socio-economic outcomes
  • Exports of products from eco-industries
  • Turnover in eco-industries
A detailed description of the variables used in the analysis is presented in the Appendix. The main source of data used for all these indicators is Eurostat, Science, Technology and Innovation database, Eco-Innovation Observatory database and Eurostat, National Accounts database (GDP) and Environment database.
Missing data often hinder the development of robust composite indicators. There are three general methods for dealing with missing data: (i) case deletion; (ii) single imputation; or (iii) multiple imputation. In this paper, we have used the multiple imputation technique that considers the missing data as part of the analysis and try to impute values through regression imputation.
When there are many variables to be combined into one posterior indicator, Nardo et al. [61] write metaphorically that the researcher must avoid “adding up apples and oranges”. Normalization is required prior to any data aggregation as the indicators in a data set often have different measurement units. From several methods of normalization presented by [62] and [37], standardization (or z-scores) converts indicators to a common scale with a mean of zero and standard deviation of one.
This preliminary step is helpful in assessing the suitability of the data set and will provide an understanding of the implications of the methodological choices, e.g., weighting and aggregation, during the construction phase of the composite indicator. To avoid the common criticism, “indicator rich but information poor”, the data were observed through multivariate analysis.
The method used in this study to explain the variance of the observed data through a few linear combinations of the original data was a specific technique belonging to Multivariate Analysis—the Multiway Principal Components Analysis (MPCA).
MPCA represents a generalization of Principal Components Analysis (PCA). PCA is a dimensionality reduction technique.
Even though there are Q variables, much of the data’s variation can often be accounted for by a small number of variables—principal components, or linear relations of the original data that are uncorrelated. The next step is to select the first principal components (factors) that preserve a “high” amount of the cumulative variance of the original data.
PCA is a useful technique for transforming a large number of variables in a data set into a smaller and more coherent set of uncorrelated (orthogonal) factors, the principal components. The principal components account for much of the variance among the set of original variables. Each component is a linear weighted combination of the initial variables. The weights for each principal component are given by the eigenvectors of the correlation matrix or the covariance matrix, if the data were standardized. The variance for each principal component is represented by the eigenvalue of the corresponding eigenvector. The components are ordered so that the first component accounts for the largest possible amount of variation in the original variables. The second component is completely uncorrelated with the first component, and accounts for the maximum variation that is not accounted for by the first. The third accounts for the maximum that the first and the second did not account for, and so on [63].
An alternative way to investigate the degree of correlation among a set of variables is to use the Cronbach coefficient alpha (c-alpha), which is the most common estimate of internal consistency of items in a model or survey. Coefficient alpha (c-alpha) measures the internal consistency in the set of individual indicators, how well they describe a unidimensional Construct (OECD, 2008).
C-alpha is not a statistical test, but a coefficient of reliability based on the correlation between individual indicators. That is, if the correlation is high, then there is evidence that the individual indicators are measuring the same underlying construct. Nunnally [64] suggests 0.7 as an acceptable reliability threshold. Yet some authors use 0.75 or 0.80 as a cut-off value, while others are as lenient as 0.6.
PCA was first used to combine socioeconomic indicators into a single index [65].
When the process involves more than two dimensions (variables observed for some countries in various periods), the PCA method generates the Multiway Principal Components Analysis (MPCA).
As Nomikos and MacGregor [66] stated, MPCA is equivalent to performing ordinary PCA on a large two-dimensional matrix constructed by unfolding the three-way data matrix, considering the data to be organized as panel data (Mourao, 2007) [67].
Hierarchical clustering (HC) is an unsupervised method of clustering that creates a hierarchy of classes (i.e., clusters), frequently used after a PCA or other data mining techniques. The purpose is to find a partition in r classes that maximizes the between-classes inertia or, equivalently, minimizes the within-classes inertia. This clustering criterion based on inertia allows creating classes homogeneous in their composition and heterogeneous between them.
Cluster analysis is another tool used in the development of composite indicators to group information on countries based on their similarity on different individual indicators. Cluster analysis (CLA) is a collection of algorithms to classify objects such as countries, species, and individuals (OECD, 2008) [37]. The classification aims to reduce the dimensionality of a data set by exploiting the similarities/dissimilarities between cases.
Cluster analysis serves as: (i) a purely statistical method of aggregation of the indicators; (ii) a diagnostic tool for exploring the impact of the methodological choices made during the construction phase of the composite indicator; (iii) a method of disseminating information on the composite indicator without losing that on the dimensions of the individual indicators; and (iv) a method for selecting groups of countries for the imputation of missing data with a view to decreasing the variance of the imputed values (OECD, 2008) [21,37].
Frequently, PCA is carried out together with then a clustering algorithm on the object scores on the first few components, called “tandem analysis”. These multivariate analysis techniques are useful for gaining insight into the structure of the data set of the composite.
When used in a benchmarking framework, weights can have a significant effect on the overall composite indicator and the country rankings. Weights may also be chosen to reflect the statistical quality of the data. Higher weights could be assigned to statistically reliable data with broad coverage.
The main problem in the construction of composite indices of development is how to aggregate the information. The aggregation problem concerns two interrelated aspects: the assignment of weights to the components when combining them [68] and the choice of the synthetic function. Most composite indicators rely on equal weighting (EW), where all variables are given the same weight.
From the all possible aggregation strategies presented in OCED handbook, we have chosen in our study the weights from principal component analysis, using the proportion of recovered variance by each principal component in the total variance recovered as weights on the factor score coefficients to compute a non-standardized index.
Apparently, this approach seems more “objective” because the weights are not assigned by the researcher but rather by a statistical technique and seems less arbitrary and more “scientific”, because they are extracted from the data.
This index measures the eco-innovation status of one year relative to the others on a linear scale. The value of the index can be positive or negative, making it difficult to interpret.
Furthermore, the index is transformed using the percentile rank to take values between 0 and 100. The best performing country for each indicator takes the value 100, and the worst, 0. The percentile rank is classified as a categorical scale normalization method.
The percentile rank of a country-year observation (it) of variable x is:
p ¯ c x i t = 100 c f i i t + 0.5 f i i t N i t
where c f i t is the cumulative frequency for all scores lower than the country-year score of interest; f i t is the frequency of the score of interest; and N i t the number of country–year observations ( N i t ) is the product between the number of countries and the number of annual observations).
In this case, the top 1% received a score of 1, the top 2% received a score of 0.99 and so on. This method is very useful in economic and social research because it supplies results that allow a kind of lecture pointing out the effort of convergence among the cases, from the worst (year–case observation) to the best, rewarding the best performing countries and penalizing the worst [67].
The difference between two countries with respect to an indicator is usually measured on the vertical axis as the difference between values of that indicator at a point in time. There is also a complementary measure of difference, which takes time into account, measuring the difference between two countries for a given indicator on the horizontal axis as time distance between those countries.
Trends in country performance, as revealed through a composite indicator, can be presented through trend diagram. When a composite indicator is available for a set of countries for at least two different time points, changes or growth rates can be depicted. The ECO-INNOVATION INDEX is used to track relative performance of European countries on eco-innovation indicators.

4. Empirical Results

4.1. Constructing an ECO-INNOVATION INDEX for Romania and Other EU Countries

The first objective of this section is to construct a composite index of Romanian eco-innovation performances for the period 2003–2013, as well as for other EU countries using principal component analysis (PCA) based on panel data for 12 specific eco-innovation indicators.
In the process of building a composite index for eco-innovation performances at the European level, the first step is the imputation of missing data. The missing values were treated using multiple imputation based on regression analysis using SPSS 18 [69].
In order to treat the problem of different measurement units of the individual variables, a normalization technique is required. From several normalization techniques, we choose to standardize the data and thus to avoid potential bias resulting from the inclusion of data with different scales and data ranges. Standardization is generally acknowledged as a necessary step before proceeding to an aggregation process. This is important to avoid giving variables with different measurement units and disproportionate ranges undue importance at the expense of others [70]. According to Gilthorpe, transformation of constituent variables and removal of skewness, however, are critical when generating a composite index.
In order to identify the eco-innovation dimensions at the European level and then to compute a composite index of eco-innovation, the Multiway PCA combined with the cluster analysis were used in order to highlight the main poles of eco-innovation in the EU member states.
First, the Cronbach Coefficient Alpha was used to assesses how well a set of items measures a single unidimensional object, because estimates the internal consistency of items in a model.
It is important to point out that because the variances of the individual indicators vary widely, we have standardized the individual indicators to a standard deviation of 1 before computing the coefficient alpha.
Table 1. The empirical results of Cronbach’s Alpha.
Table 1. The empirical results of Cronbach’s Alpha.
Cronbach’s AlphaCronbach’s Alpha Based on Standardized ItemsN of Items
0.7210.72112
The c-alpha is 0.721 for the data set of the 27 countries, which is equal to Nunnally’s cut-off value.
Pairwise correlation tests were applied in an attempt to reduce the initial set of metrics to a smaller subset of non-highly correlated metrics. As none of the twelve metrics were highly correlated, all metrics were retained in the PCA analysis.
Information on quality adjustment is expressed using the variance explained with the help of the eigenvalues (presented in Table 1) and the matrix of correlations. The table presents the variance explained by the initial solution (components), the extracted components and also the rotated components. Therefore, the analysis of the quality of the cloud of points adjustment (in our case the countries) is performed using the eigenvalues.
The first six principal components from the extracted solution explain nearly 84.22% of the variability in the original twelve variables and they are the only ones with eigenvalues almost 1. One of the most commonly used techniques is Kaiser’s criterion, or the eigenvalue rule. Regarding the entire process, step by step, we notice that adjusting the points’ cloud by a single factorial axis (accepting only the first synthetic indicator), explains 32.88% of total variance; then, adjusting the points’ cloud by the first two factorial axes (accepting two synthetic indicators), we recover an additional 16.05% of the total variance (a total of 49.26% of the initial variance). The last four principal components explain almost the same amount of the remaining variance, about 10% each.
In order to explain the significance of the principal components obtained through our analysis, one has to analyze the correlation coefficients calculated between the three main components (the extracted components) and the original indicators. By applying such a methodology, the process of explaining the principal components becomes relatively simple. As a first step, one has to use a rotation technique in order to obtain components on orthogonal axes. The most common rotation technique used for this purpose is the “Varimax” method.
Loading results from an orthogonal rotation are correlation coefficients of each variable with the factor, so they naturally range from –1 to +1. A negative loading simply means that the results need to be interpreted in the opposite direction from the way it is worded.
The second step involves finding which initial variables are most correlated with each principal component. Afterwards, each of the principal components needs to be renamed so that it can be regarded as a new dimension, a new class that needs to include the significance of all the initial variables. Therefore, each component can be “explained” by the initial variables for which the correlation coefficients have the highest values (the results are presented in Table 2).
Table 2. The component Eigenvalues.
Table 2. The component Eigenvalues.
ComponentInitial EigenvaluesExtraction Sums of Squared Loadings
Total% of VarianceCumulative %Total% of VarianceCumulative %
Dimension13.94632.88432.8843.94632.88432.884
21.96616.38349.2671.96616.38349.267
31.23010.25359.5201.23010.25359.520
41.1069.21968.7401.1069.21968.740
50.9547.94976.6890.9547.94976.689
60.9047.53184.2200.9047.53184.220
70.5004.16788.387
80.4613.84192.229
90.4493.73895.966
100.3242.70198.667
110.1201.00499.671
120.0400.329100.000
Note: Extraction Method: Principal Component Analysis.
Table 2 revealed the Rotated Factor Loadings for eco-innovation variables, a powerful suggestion of the weights that will calibrate each variable in the aggregate index. These results were achieved through the Principal Components Extraction Method with Varimax normalized variation.
Table 3. The rotated Component Matrix.
Table 3. The rotated Component Matrix.
Variable NameComponent
123456
Zscore: Researchers, % of total employment (numerator in full time equivalents)0.952–0.0510.087–0.102–0.1000.069
Zscore: R&D personnel, % of total employment (numerator in full time equivalents)0.9200.0340.163–0.096–0.0920.091
Zscore: Total GBAORD (% GDP)0.9330.1200.1060.033–0.0240.048
Zscore: Total intramural R&D expenditure (%GDP)0.8000.284–0.1120.1670.1410.004
Zscore: Organizations and sites with EMAS registration (number)0.1190.814–0.1200.0530.075–0.018
Zscore: Ecolabel licenses (number)0.0210.7580.302–0.173–0.1220.116
Zscore: Greenhouse Gas emissions (thousand tons)0.0950.810–0.2230.074–0.019–0.030
Zscore: Total environmental taxes (%GDP)0.130–0.1520.8880.1720.057–0.031
Zscore: Energy productivity (GDP/Gross inland energy consumption)0.4290.4130.436–0.3730.0840.139
Zscore: Material productivity (GDP/Domestic material consumption)0.1250.030–0.008–0.0240.0220.986
Zscore: Exports of products from eco-industries (% of total exports)–0.063–0.0210.060–0.0700.9770.022
Zscore: Turnover in eco-industries (% of total GDP)0.0030.0190.1340.941–0.064–0.014
Note: Extraction Method: Principal Component Analysis. Rotation Method: Varimax with Kaiser Normalization. Rotation converged in six iterations.
The factors are interpreted using the data from rotated component matrix presented in Table 3. The first factor has high positive coefficients (loadings) with researchers, % of total employment (0.952); Total Government budget appropriations or outlays on R&D (GBAORD) (0.933); and R&D personnel, % of total employment (0.92), indicating the factor 1 may be due to eco-innovation inputs.
Factor 2 is mainly dominated by eco-innovation activities: number of organizations and sites with EMAS registration (0.814). The third factor can be explained in terms of total environmental taxes, as eco-innovation output.
Factors 4 and 5 can be interpreted in terms of turnover in eco-industries and exports of products from eco-industries as indicators of socio-economic outcomes. The last factor is mainly subject to material productivity, as resource efficiency outcomes.
In order to evaluate the quality of the results derived from the PCA, the KMO and Bartlett’s test of sphericity were applied. The Kaiser–Meyer–Olkin (KMO) measures the sampling adequacy, which should be greater than 0.5 for a satisfactory factor analysis to proceed.
The KMO measure of sampling adequacy is a statistic for comparing the magnitudes of the observed correlation coefficients to the magnitudes of the partial correlation coefficients. The concept is that the partial correlations should not be very large if distinct factors are expected to emerge from factor analysis. A KMO statistic is computed for each individual indicator, and their sum is the KMO overall statistic. KMO varies from 0 to 1.0. An overall KMO should be 0.60 or higher to proceed with factor analysis (Kaiser and Rice, 1974), though realistically it should exceed 0.80 if the results of the principal components analysis are to be reliable. If not, it is advisable to drop the individual indicators with the lowest individual KMO statistic values, until overall KMO rises above 0.60.
The Bartlett’s test of sphericity is used to test the null hypothesis that the individual indicators in a correlation matrix are uncorrelated, i.e., that the correlation matrix is an identity matrix. The statistic is based on a chi-squared transformation of the determinant of the correlation matrix. However, as Bartlett’s test is highly sensitive to sample size [71], Tabachnick and Fidell suggest implementing it with the KMO measure [72].
Looking at the related table (available under request), the KMO measure is 0.749. From the same table, we can see that the Bartlett’s test of sphericity is significant. That is, its associated probability is less than 0.05 (Approximate Chi-Square = 1902.83) (Table 4). This means that the correlation matrix is not an identity matrix.
Table 4. The empirical results.
Table 4. The empirical results.
Kaiser-Meyer-Olkin Measure of Sampling AdequacyBartlett’s Test of Sphericity
Approx. Chi-SquaredfSig.
0.7491902.835660.000
In the last step of the production of the ECO-INNOVATION INDEX, it is time to deal with the construction of the weights from the matrix of factor loadings after rotation, given that the squares of factor loadings represent the proportion of the total unit variance of the indicator, which is explained by the factor [73]. The approach used is that each normalized variable with a significant factor loading (the six principal components) will have a weight equal to its proportion of the variance explained by all the factors.
A non-standardized ECO-INNOVATION INDEX is:
N o n s t d . E c o I n n o v a t i o n    I n d e x = 32.88 84.22 P C 1 + 16.38 84.22 P C 2 + 10.25 84.22 P C 3 + 9.22 84.22 P C 4 + 7.95 84.22 P C 5 + 7.53 84.22 P C 6
The final value given to each country–year observation is rescaled using the percentile rank, but considering all weighted values. Therefore, the ECO-INNOVATION INDEX as a percentile ranking indicates how a country–year observation performs compared to other country–year observations at its position. The ECO-INNOVATION INDEX ranges from a low of 0 (lowest level of eco-innovation) to a high of 100 (highest level of eco-innovation). A 50 ranking is an average performance.
Figure 1 shows the values of the ECO-INNOVATION INDEX for each one of the studied countries over the period 2003–2013. Analyzing the pattern over time, we can conclude that there are several types of countries:
(1)
Countries with a very high value of the index during the whole period are the benchmark countries (Germany, Denmark, Sweden, Finland, Netherlands and France).
(2)
Countries with improvements over the time in the field of eco-innovation (Czech Republic, Estonia, Spain, Italy, Luxembourg, Portugal and Greece).
(3)
Countries with low performances in the field of eco-innovation (Bulgaria, Hungary, Lithuania, Latvia, Romania and Slovakia).
Figure 1. The ECO-INNOVATION INDEX during the period 2003–2013 in the 25 EU countries.
Figure 1. The ECO-INNOVATION INDEX during the period 2003–2013 in the 25 EU countries.
Sustainability 07 12723 g001aSustainability 07 12723 g001bSustainability 07 12723 g001cSustainability 07 12723 g001d
Analyzing the values of mean scores of ECO-INNOVATION INDEX for the period 2003–2013, we can conclude that the countries with the highest average values are Denmark, Germany, Finland, Sweden and France. Conversely, Romania, Latvia and Slovakia are the countries with the lowest average values (Figure 2).
Figure 2. The mean score of ECO-INNOVATION INDEX in the EU-27 countries.
Figure 2. The mean score of ECO-INNOVATION INDEX in the EU-27 countries.
Sustainability 07 12723 g002
It is very important to point out that there are several differences between our index of eco-innovation and the ECO-INNOVATION INDEX proposed by eco-innovation observatory. The index of eco-innovation covers only the period 2010–2013 and it is not constructed using panel data, while our index is computed for the period 2003–2013.
In order to compute our index, we used 27 EU countries and 12 individual indicators for five thematic areas.
In the normalization process, we have used standardization, unlike the Observatory who used the “Distance-to-reference” method, with the EU average being defined as the reference and set as a value of 100.
We have used multiple imputation for missing data, while the Observatory do not replaced the missing data by estimations; countries for which data is not available do not get a result for the respective indicator.
According to ECO-INNOVATION OBSERVATORY, the score of the index in each of the five areas is calculated by the unweighted mean of the underlying indicators. Consequently, each indicator has the same weighting in the five areas. The overall scoreboard of an EU Member State is calculated by the unweighted mean of the 16 sub-indicators. In the process of building our index, we have decided to use the weights obtained from principal component analysis, because this approach appears to be more “objective” as the researcher does not assign the weights but rather the weights are extracted from the data using a statistical technique, which seems less arbitrary and more “scientific”.

4.2. Evaluating the Main Eco-Innovation Poles for EU Member States in 2013

The second objective of this section is to identify important synthetic indicators of eco-innovation at the level of EU member states using principal component analysis technique and to highlight the main poles of eco-innovation performance using aggregate data at the level of the year 2013.
It is very important to highlight that our essential contribution is reflected by the opportunity to take simultaneously into consideration the evolution in time of eco-innovation performances for several EU countries. Thus, in such a manner, the eco-innovation phenomenon can be seen at the European level over the time 2003–2013.
The ECO-INNOVATION INDEX shows how well individual Member States perform in different dimensions of eco-innovation compared to the EU average. It currently covers a time series from 2003 to 2013. Analyzing the values of ECO-INNOVATION INDEX in 2013 compared with 2003, we can observe that Germany and Denmark have increased their performance, but not by much, considering the fact that they have been at a very high level since 2003. Italy and Luxembourg are the countries with the most improvement in the field of eco-innovation from 2003 to 2013. Romania is the country with the largest decline in eco-innovation from 2003 to 2013, which is even more problematic as the level of performance in the field of eco-innovation was extremely low in 2003 (Figure 3).
Similarly to the indices of the last years, the majority of EU-15 countries can be found at the top, particularly Scandinavian countries, while values for EU-12 countries are all below the average. A few member states have changed their ranking considerably; Italy, Estonia, Czech Republic, Malta and Greece have improved while Cyprus, UK, Lithuania, Bulgaria and Romania have fallen.
Figure 3. The level of ECO-INNOVATION INDEX in 2003 and 2013 for EU countries.
Figure 3. The level of ECO-INNOVATION INDEX in 2003 and 2013 for EU countries.
Sustainability 07 12723 g003
In Figure 4, the horizontal axis gives the EU average value and the vertical axis shows the EU trend. The two axes divide the area into four quadrants. Countries in the upper quadrant are “moving ahead”, because both their value and their trend are above the EU average. Countries in the bottom left quadrant are “falling further behind” because they are below the EU average for both variables.
Figure 4. Overall country trends by ECO-INNOVATION INDEX.
Figure 4. Overall country trends by ECO-INNOVATION INDEX.
Sustainability 07 12723 g004
Poland, Slovakia and Latvia are the best examples of countries catching up from low current values.
Poland is particularly weak in R&D and innovation investments and early stage investments in green technologies as well as in economic outcomes related to eco-innovation. Although the overall picture is rather challenging, the trends indicate a considerable economic opportunity in modernizing the production processes, notably in the most energy- and resource-intensive sectors. The development and implementation of eco-innovative technologies in Poland are supported by the key national and regional strategies.
For the Slovak economy, the concept of “eco-innovation” is dominated by such terms as “green procurement”, “energy transition”, “enforcement of energy efficiency”, “environmental labeling”, and “small- and medium-sized enterprises”. The focus is on economic growth and its relation to the knowledge economy.
Latvia belongs to a group of countries with modest eco-innovation performance. Latvia has a series of environmental issues to be solved. Latvia has no specific eco-innovation policy strategy, neither has it environmental technology action plan.
Italy, Luxembourg and Spain are moving ahead, with above average current and trend performance. Innovation in general in Italy and eco-innovation processes in particular has shown a significant growth trend over the last decade, stimulated by public finance and EU funding and EU R&D projects. Italy has good achievements in improving energy efficiency, expanding renewable energy (solar, hydro, and geothermal), material recycling, as well as in greening transportation and eco-innovations in industrial biotechnology.
Luxembourg has a strong and comprehensive set of environmental and innovation laws, based largely on European legislation, which have been an effective tool for implementing relevant policies, and a main driver for the promotion of eco-technologies and eco-innovation.
Spain has a high recognition of green certification among companies. The country also has a large set of eco-labeled products. Governmental allocation for environmental R&D is higher than in most EU countries.
Denmark, Germany, Finland, Sweden and France are in danger of losing momentum, being in a process of stagnation.
Although their current performance is above the EU average, they did not register significant increases due to the high level of eco-innovation. More likely, we can speak of a stability process of eco-innovation.
Denmark historically has been one of the leaders in the EU in promotion of sustainable economies and eco-innovation. In Denmark, a wide range of public institutions are involved in supporting eco-innovation, either through policy-making (setting standards, creating strategies, and running programs), or through direct funding or co-financing programs for development and demonstration of new technologies and green business plans.
Germany is one of the highest performing countries of the EU in eco-innovations. The country hosts a large number of companies with environmental certificates. Germany’s eco-innovation policy covers action plans (such as the High Tech Strategy) and funding for research (innovation alliances).
Eco-innovation needs and challenges of Finland are strongly associated with material efficiency.
Finland has an explicit policy for developing a national innovation system, and eco-innovation is a part of this system, as seen by a strong emphasis on specific R&D programs. The country also implements a large number of relevant strategies and measures such as environmental taxation.
Sweden is positioned in a group of eco-innovation leader countries. It has especially high performance in eco-innovation inputs and outputs explained by high R&D human resources and generous clean tech investment and high eco-patenting. Eco-innovation is an important component of Sweden’s national environmental policy strategy.
In eco-innovation performance, France displays good levels in terms of environmental (material productivity of the economy) and socio-economic outcomes (jobs and turnover), and underperforms in terms of eco-innovation activities and capturing company level eco-innovative performance. The French government showed its dedication to eco-innovation agenda by launching an ambitious program aimed at further developing the national eco-industrial potential.
Cyprus, Romania, Bulgaria and Lithuania are the best examples of countries falling further behind. In terms of eco-innovation performance, Cyprus underperforms in 2013 compared with 2003, remaining much lower than the EU average.
Although some positive trends are observed in the eco-industry, which shows growing employment and turnover, Romania faces various environmental challenges and is falling further behind the average of the 27 EU countries.
Eco-innovation needs and challenges in Bulgaria are associated with the country’s poor state of the environment (a result of intensive agricultural and industrial activities), energy inefficient buildings stock, growing prices for natural resources, intensified industrialization and urbanization, growing volumes of waste, and climate change.
Promotion of eco-innovations in Lithuania is covered under the general innovation policy agenda; it is understood that environmental considerations are an organic part of innovations nowadays.
Figure 5. The dendogram of EU countries eco-innovation performances in 2013.
Figure 5. The dendogram of EU countries eco-innovation performances in 2013.
Sustainability 07 12723 g005
Applying the hierarchical method of clustering to the six principal components obtained from MPCA for the year 2013, we can identify the main poles of eco-innovation at European level in 2013 (Figure 5).
Figure 5 shows the country clusters based on the individual ECO-INNOVATION INDEX indicators using tree clustering (hierarchical) with centroid clustering and squared Euclidean distances. Similarity between countries belonging to the same cluster decreases as the linkage distance increases.
Analyzing the dendogram of countries, we point out the existence of four classes in 2013:
  • Class 1: Italy.
  • Class 2: Denmark.
  • Class 3: Germany, France and Spain.
  • Class 4: The rest of the countries divided into four sub-groups.
It is necessary to point out that this result does not fully correspond to the division into stagnation, moving ahead, catching up and falling behind countries resulting from the trend diagram, but is relatively similar to it. It is important to mention one particular sub-group of countries, the countries related with the Romania (Poland, Cyprus, Bulgaria, and Latvia), which is very similar to the initial one, with the only difference being the countries Poland and Latvia, who have no joined this group.

5. Conclusions

The aim of the paper was to evaluate the Romanian eco-innovation performances during the period 2003–2013 by constructing a composite index and also to identify the main eco-innovation poles at European level using multivariate analysis techniques based on the eco-innovation specific indicators.
The paper was divided into two main analysis phases and has used 12 variables considered to be relevant from five thematic areas (researchers, % of total employment; R&D, personnel % of total employment; total intramural R&D expenditure; total Government budget appropriations or outlays on R&D; organizations and sites with EMAS registration; ecolabel licenses; Greenhouse Gas emissions; total environmental taxes; energy productivity; material productivity; exports of products from eco-industries; and turnover in eco-industries), in highlighting the importance of eco-innovation at national and international level, towards sustainable development.
The methodology used and data processing for 27 EU countries in the period 2003–2013 revealed the existence of six principal components from the total of 12 original variables, which were used in the construction of the composite index, those being significant for all the member states with a significant influence on eco-innovation, with a high impact in each economy.
The policy adopted by every state in the EU towards developing eco-innovation has resulted in different effects from one country to another. This is, on the one hand, the result of understanding the necessity and the usefulness of eco-innovation, and, on the other hand, the result of the design and implementation of the policy. Thus, the results of the composite resulted highlighted the following hierarchy: countries with a very high value of the index during the whole period-are the benchmark countries (Germany, Denmark, Sweden, Finland, Netherlands and France); countries with improvements over the time in the field of eco-innovation (Czech Republic, Estonia, Spain, Italy, Luxembourg, Portugal and Greece); and countries with low performances in the field of eco-innovation (Bulgaria, Hungary, Lithuania, Latvia, Romania and Slovakia).
The values of the composite index in 2013 compared to 2003, for all the 27 EU member states have produced the following results:
(1)
A total of 15 countries, mostly Scandinavian, in both 2013 and 2003 had a high level of eco-efficiency, given by the value of the composite index placed above average, thanks to the policy implemented within these states who considered eco-innovation as a key element in the sustainable development of the country’s economy.
(2)
In 2013, the composite index was situated below the average for 12 countries, which were not able to maintain the eco-innovation policy at a level applicable to the corresponding needs and requirements.
(3)
For five countries (Italy, Estonia, Czech Republic, Malta and Greece) in 2013 compared to 2003, the composite index was amended to growth, which means that at the national level the awareness of the needs and importance of using eco-innovation in the sustainable development plan was managed.
(4)
Besides Romania, four other countries (Cyprus, UK, Lithuania, and Bulgaria) faced a reduction in the composite index in 2013 compared to 2003, assuming either that this process of eco-innovation has not received the due attention over these 10 years or that the policy adopted in respect to eco-innovation was not well defined or applied at the national level.
The empirical results of cluster analysis revealed the following countries: Italy; Denmark; Germany, France and Spain; and the last class, which includes the rest of the countries divided into four sub-groups. Romania is included in this fourth cluster.
As a final conclusion, the position of Romania in tackling eco-innovation is insignificant compared to the benchmark countries, which have a significant contribution of eco-innovation to economic growth. Therefore, Romania as failed to discuss eco-innovation performance at the national level.
The utility of this study is reflected in the outcome research highlighting Romania’s position among the lowest countries in the adoption of eco-innovation, which allows new perspectives for research towards the design and adoption of measures to remedy the current situation.
For future research, the index provides a relative measure of eco-innovation performance over time and it can be used for comparisons across areas and over time. In addition, in the future, Romania should adopt a policy of eco-innovation to solve problems that arise in relation to: the failure of market prices (prices should reflect significant cost and environmental benefits), obstructionist behavior regarding the introduction of eco-innovation, rigid economic structures towards the adoption of eco-innovation, harmful incentives and subsidies, and infrastructure.
The return on investments of environment protection, the uncertain market demand due to low awareness of the significant impact of eco-innovation on employment and economic growth are barriers that must be solved by applying and implementing an action plan addressing eco-innovation by development of skills oriented to eco-innovation issues, design and implementation of legislation on the relationship between environment and innovation, implementation of projects that aim to introduce eco-innovation in various sectors, deepening of European and international cooperation to promote eco-innovation internally and externally, internal and international mobilization of financial instruments to stimulate eco-innovation, etc.
However, taking into account the results obtained, due to the influence of the most significant factors influencing eco-innovation can be considered. This is a phenomenon that is leading to significant progress in achieving the objective of sustainable development. This approach relies on the measurement and statistical analysis, used to obtain high performance sustainable development at both the EU level and globally.

Author Contributions

Rodica-Manuela Gogonea, Marian Zaharia and Adriana AnaMaria Davidescu conceived and designed the experiments. Adriana AnaMaria Davidescu performed the experiments. Adriana AnaMaria Davidescu and Andreea Maria Vass Paul analyzed the data. Marian Zaharia and Rodica-Manuela Gogonea contributed materials. Adriana AnaMaria Davidescu and Andreea Maria Vass Paul contributed analysis tools. Rodica-Manuela Gogonea and Adriana AnaMaria Davidescu wrote the paper.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix

Table A1. The description and sources of data.
Table A1. The description and sources of data.
Nr. Crt.VariablesDescriptionSources
1.Researchers % of total employment“Researchers are professionals engaged in the conception or creation of new knowledge, products, processes, methods and systems and also in the management of the projects concerned”.
(§ 301, Frascati Manual, OECD 2002).
The unit is Percentage of total employment—numerator in full time equivalents.
The series is available in Eurostat, Science, Technology and Innovation database.
2.R&D personnel % of total employment“R&D personnel include all persons employed directly on R&D, as well as those providing direct services such as R&D managers, administrators, and clerical staff. Those providing an indirect service, such as canteen and security staff, should be excluded”. (§ 294–295, Frascati Manual, OECD 2002). The unit is Percentage of total employment—numerator in full time equivalents.The series is available in Eurostat, Science, Technology and Innovation database.
3.Total intramural R&D expenditure“Intramural R&D expenditures are all expenditures for R&D performed within a statistical unit or sector of the economy during a specific period, whatever the source of funds”.
(§ 358, Frascati Manual, OECD 2002).
The unit is Percentage of gross domestic product (GDP).
The series is available in Eurostat, Science, Technology and Innovation database.
4.Total GBAORDGovernment budget appropriations or outlays on R&D (GBAORD) are all appropriations allocated to R&D in central government or federal budgets and therefore refer to budget provisions, not to actual expenditure. Provincial or state government should be included when its contribution is significant. Local government funds (i.e., those raised by local taxes) should be excluded.The series is available in Eurostat, Science, Technology and Innovation database.
5.Organisations and sites with EMAS registrationThis indicator illustrates the number of organization with implemented EMAS (European Eco-Management and Audit Scheme) systems divided by millions of inhabitants of a country.The series is available in the Eco-Innovation Observatory database
6.Ecolabel licensesThis indicator is defined as the number of Ecolabel or “EU Flower” licenses in European countries. The Community Ecolabel is awarded to products and services with reduced environmental impacts. It is administered by the European Commission and receives the support of all EU Member States and the European Free Trade Association (EFTA). Ecolabel criteria are discussed in the European Union Ecolabeling Board (EUEB) whose membership includes representatives from industry, environmental protection groups, consumer organisztions and representatives for SMEs.The series is available in Eurostat, Sustainable Development database.
7.Greenhouse Gas emissionsThis indicator is an aggregate of 6 greenhouse gases (CO2, N2O, CH4, HFC, PFC, and SF6) and is presented in units of thousand tons.The series is available in Eurostat, Environment database.
8.Total environmental taxesAn environmental tax is a tax whose tax base is a physical unit (or a proxy of a physical unit) of something that has a proven, specific negative impact on the environment, and which is identified in ESA 2010 as a tax.
The data collection for environmental tax revenue is derived from the national tax lists (NTLs) which Eurostat collects as a complement of table 9 which is part of the ESA 2010 (European system of accounts) transmission program. The unit is Percentage of gross domestic product (GDP).
The series is available in Eurostat, Environment database.
9.Energy productivityThis indicator is calculated as GDP (million euro units—current prices) over Gross inland energy consumption (thousand TOE (tons of oil equivalent) units).The series are available in Eurostat, National Accounts database (GDP) and Energy database (Gross inland consumption)
10.Material productivityResource productivity or Material productivity (GDP/DMC) is defined as the ratio of gross domestic product (GDP) over domestic material consumption (DMC) and commonly expressed in Euro per kilogram of material.
The term designates an indicator that reflects the GDP generated per unit of resources used by the economy.
This is typically a macro-economic concept that can be presented alongside labor or capital productivity.
The series are available in Eurostat, National Accounts database (GDP) and Environment database (Domestic material consumption)
11.Exports of products from eco-industriesShare of eco-industry exports in total export (in %). Based on 25 trade codes that have been used for export analysis from Ecotec (“Analysis of the EU Eco-Industries, their Employment and Export Potential”, 2002). The analyzed subsectors are: air pollution control, water pollution control, waste disposal, monitoring equipment, other environmental equipment, solar thermal, photovoltaics and hydropower.The series is available in the Eco-Innovation Observatory database
12.Turnover in eco-industriesShare eco-industry turnover of total GDP, in %, data for 2004 are taken from the Ernst & Young Study (2006): Eco-industry, its size, employment, perspectives and barriers to growth in an enlarged EU, 2008 comes from Ecorys et al.: “Study on the Competitiveness of the EU eco-industry” and data for 2012 based on Thomson One database.The series is available in the eco-innovation Observatory database.

References

  1. OECD Sustainable Manufacturing Toolkit. Available online: http://www.oecd.org/innovation/green/toolkit/ (accessed on 31 August 2015).
  2. Bridging the Valley of Death: Public Support for Commercialization of Eco-Innovation. Available online: http://ec.europa.eu/environment/enveco/innovation_technology/pdf/bridging_valley_report.pdf (accessed on 31 August 2015).
  3. Invention and Transfer of Environmental Technologies. Available online: http://www.oecd.org/env/consumption-innovation/inventionandtransferofenvironmentaltechnologies.htm (accessed on 31 August 2015).
  4. The Development and Diffusion of Environmental Technologies: Technology Transfer, Knowledge Flows and International Cooperation. Available online: http://ec.europa.eu/environment/ecoap/pdfs/final-executive-summary-final-report-idea-consult-env_tech-transfe-13-11-2012_en.pdf (accessed on 31 August 2015).
  5. The Business Case for Eco-innovation. 2014. Available online: http://www.unep.org/resourceefficiency/Business/Eco-Innovation/TheEco-InnovationProject/TheBusinessCaseforEco-innovation/ (accessed on 31 August 2015).
  6. Impact of P&D Incentive Program on the Performance and Technological Efforts of Brazilian Industrial Firms. Available online: http://idbdocs.iadb.org/WSDocs/getdocument.aspx?docnum=907639&Cache=True (accessed on 31 August 2015).
  7. Rethinking the Benchmarking of Agricultural and Rural Innovation. Available online: http://www.ieri.org.za/publications/rethinking-benchmarking-agricultural-and-rural-innovation (accessed on 31 August 2015).
  8. The Market Valuation of Innovation: The Case of Indian Manufacturing. Available online: http://www.esocialsciences.org/Download/repecDownload.aspx?fname=A2014610165027_20.pdf&fcategory=Articles&AId=5911&fref=repec (accessed on 31 August 2015).
  9. Fussler, C.; James, P. Driving Eco-Innovation: A Breakthrough Discipline for Innovation and Sustainability; Pitman Publishing: London, UK, 1996. [Google Scholar]
  10. James, P. The sustainability circle: A new tool for product development and design. J. Sustain. Prod. Des. 1997, 2, 52–57. [Google Scholar]
  11. Klemmer, P.; Lehr, U.; Löbbe’s, K. Environmental Innovation, Incentives and Barriers; Analytica-Verlag: Berlin, Germany, 1999. [Google Scholar]
  12. Survey Indicators for Environmental Innovation. Available online: http://brage.bibsys.no/xmlui/bitstream/handle/11250/226478/Idea8.pdf?sequence=1 (accessed on 31 August 2015).
  13. Employment Impacts of Cleaner Production. Available online: https://books.google.com.hk/books?hl=en&lr=&id=hRfrCAAAQBAJ&oi=fnd&pg=PA3&dq=Employment+Impacts+of+Cleaner+Production&ots=EgOPoIIzLD&sig=87xhE_Q5mA8tkzYzexOFmtWVJgg#v=onepage&q=Employment%20Impacts%20of%20Cleaner%20Production&f=false (accessed on 31 August 2015).
  14. On the Faces and Phases of Eco-Innovation—On the Dynamics of the Greening of the Economy. Available online: http://www2.druid.dk/conferences/viewabstract.php?id=501858&cf=43 (accessed on 31 August 2015).
  15. Rennings, K. Redefining innovation—Eco-innovation research and the contribution from ecological economics. Ecol. Econ. 2000, 32, 319–332. [Google Scholar] [CrossRef]
  16. Huber, J. New Technologies and Environmental Innovation; Edward Elgar: Cheltenham, UK, 2004. [Google Scholar]
  17. Achieving Eco-Innovation through Strategic Alliances: Study Case of Renault Strategic Alliances. Available online: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.304.3115 (accessed on 31 August 2015).
  18. Eco-efficient and Sustainable Urban Infrastructure Development in Asia and Latin America. Available online: http://www.cepal.org/publicaciones/xml/9/51999/Indicators_for_urban_freight_transport.pdf (accessed on 31 August 2015).
  19. Prosperity without Growth? The Transition to a Sustainable Economy. Available online: https://research-repository.st-andrews.ac.uk/handle/10023/2163 (accessed on 31 August 2015).
  20. Franceschini, S.; Pansera, M. Beyond unsustainable eco-innovation: The role of narratives in the evolution of the lighting sector. Technol. Forecast. Soc. Change 2015, 92, 69–83. [Google Scholar] [CrossRef]
  21. Hopwood, B.; Mellor, M.; O’Brien, G. Sustainable development: Mapping different approaches. Sustain. Dev. 2005, 13, 38–52. [Google Scholar] [CrossRef]
  22. Carrillo-Hermosilla, J.; del Rio Gonzalez, P.; Könnölä, T. Diversity of eco-innovations reflections from selected case studies. J. Clean. Prod. 2010, 18, 1073–1083. [Google Scholar] [CrossRef]
  23. Herring, H.; Roy, R. Technological innovation, energy efficient design and the rebound effect. Technovation 2007, 27, 194–203. [Google Scholar] [CrossRef]
  24. Birol, F.; Keppler, J.H. Prices, technology development and the rebound effect. Energy Policy 2000, 28, 457–469. [Google Scholar] [CrossRef]
  25. Alcott, B. Jevons’ paradox. Ecol. Econ. 2005, 54, 9–21. [Google Scholar] [CrossRef]
  26. Herring, H. Energy efficiency—A critical view. Energy 2006, 31, 10–20. [Google Scholar] [CrossRef]
  27. The Jevons Paradox and the Myth of Resource Efficiency Improvements. Available online: http://0-sspp-proquest-com.brum.beds.ac.uk/archives/vol5iss1/book.polimeni.html (accessed on 31 August 2015).
  28. Saunders, H.D.; Tsao, J.Y. Rebound effects for lighting. Energy Policy 2012, 49, 477–478. [Google Scholar] [CrossRef]
  29. Historical Overview of the Jevons Paradox in the Literature. Available online: https://books.google.com.hk/books?hl=en&lr=&id=nfHDSSqi4NQC&oi=fnd&pg=PA7&dq=Historical+Overview+of+the+Jevons+Paradox+in+the+Literature&ots=PX9NemSGv4&sig=Kw1S8uxl10rPWDocNPaRFXeJxmE#v=onepage&q=Historical%20Overview%20of%20the%20Jevons%20Paradox%20in%20the%20Literature&f=false (accessed on 31 August 2015).
  30. Jevons Paradox. Available online: https://en.wikipedia.org/wiki/Jevons_paradox (accessed on 31 August 2015).
  31. Saunders, H.D. The Khazzoom-Brookes Postulate and Neoclassical Growth. Energy 1992, 13, 131–148. [Google Scholar] [CrossRef]
  32. The Rebound Effect: An Assessment of the Evidence for Economy-Wide Energy Savings from Improved Energy Efficiency. Available online: http://aida.econ.yale.edu/~nordhaus/homepage/documents/UK_ReboundEffectReport.pdf (accessed on 31 August 2015).
  33. Lorenzoni, I.; Nicholson-Cole, S.; Whitmarsh, L. Barriers perceived to engaging with climate change among the UK public and their policy implications. Glob. Environ. Change 2007, 17, 445–459. [Google Scholar] [CrossRef]
  34. Theoretical Perspective on Rebound Effects from a Social Science Point of View. Available online: http://www.isi.fraunhofer.de/isi-wAssets/docs/e-x/working-papers-sustainability-and-innovation/WP02-2012_Rebound_psychological_sociological_background.pdf (accessed on 31 August 2015).
  35. Environmental Responsibility Denial Due to Optimism in Green Technology. Available online: http://dce-conference.au.dk/fileadmin/dce-conference.au.dk/abstracts/56_Soland.pdf (accessed on 31 August 2015).
  36. Andersen, M.M. Organising interfirm learning e as the market begins to turn Green. In Partnership and Leadership e Building Alliances for a Sustainable Future; de Bruijn, T.J.N.M., Tukker, A., Eds.; Kluwer Academic Publishers: Dordrecht, The Netherlands, 2002. [Google Scholar]
  37. Measuring Eco-Innovation. Available online: http://collections.unu.edu/view/UNU:324 (accessed on 31 August 2015).
  38. Sustainable Manufacturing and Eco-Innovation. Available online: http://www.oecd.org/innovation/inno/43423689.pdf (accessed on 31 August 2015).
  39. United Nations University—Maastricht Economic and Social Research and Training Centre on Innovation and Technology—Working Paper Series. Available online: http://www.oecd.org/env/consumption-innovation/43960846.pdf (accessed on 31 August 2015).
  40. Policies for the Development and Transfer of Eco-Innovations: Lessons from the Literature. Available online: http://www.oecd.org/environment/consumption-innovation/43811507.pdf (accessed on 31 August 2015).
  41. Investment, Technology and International Competitiveness. Available online: http://www.nzdl.org/gsdlmod?e=d-00000-00---off-0envl--00-0----0-10-0---0---0direct-10---4-------0-0l--11-en-50---20-about---00-0-1-00-0-0-11-1-0utfZz-8-00&cl=CL1.4&d=HASH01bfc6018d482de4457ad77c.8&gt=1 (accessed on 31 August 2015).
  42. Beyond the Producer-Driven/Buyer-Driven Dichotomy—The Evolution of Global Value Chains in the Internet Era. Available online: http://www.soc.duke.edu/~ggere/web/gereffi_ids_bulletin.pdf (accessed on 31 August 2015).
  43. Technology Transfer to Transition Countries: Are There Lessons from the Experience of the Post-War Industrializing Countries? Available online: http://sro.sussex.ac.uk/23027/ (accessed on 31 August 2015).
  44. Eco-Innovation Policies in the People’s Republic of China. Available online: http://www.oecd.org/china/44293445.pdf (accessed on 31 August 2015).
  45. Enhancing Developing Country Access to Eco-Innovation: The Case of Technology Transfer and Climate Change in a Post-2012 Policy Framework. Available online: http://0-www-oecd--ilibrary-org.brum.beds.ac.uk/docserver/download/5kmfplm8xxf5.pdf?expires=1441694281&id=id&accname=guest&checksum=405AF126CA59137385C168FFC45E6646 (accessed on 31 August 2015).
  46. Könnölä, T.; Carrillo-Hermosilla, J.; Gonzalez, P.D.R. Dashboard of Eco-Innovation. In Proceedings of the DIME International Conference—Innovation, Sustainability and Policy, Bordeaux, France, 11–13 September 2008.
  47. Key Business Factors for Eco-Innovation: An Overview of Recent Firm-Level Empirical Studies. Available online: http://www.ehu.eus/cuadernosdegestion/documentos/110308ap.pdf (accessed on 31 August 2015).
  48. Bryson, J.R.; Lombardi, R. Balancing product and process sustainability against business profitability: Sustainability as a competitive strategy in the property development process. Bus. Strategy Environ. 2009, 18, 97–107. [Google Scholar] [CrossRef]
  49. Voicu-Dorobantu, R.; Paraschiv, D.M.; Marinoiu, A.M. Eco-Innovation in Romanian SMEs. In Proceedings of the World Multi conference on Applied Economics, Business And Development, Iasi, Romania, 1–3 July 2011.
  50. Exploring Eco-innovation Trends in the European Construction Sector. Focus on Romania. Available online: http://www.rejournal.eu/sites/rejournal.versatech.ro/files/articole/2014-06-27/2685/paraschiv.pdf (accessed on 31 August 2015).
  51. New Models in Support of the Eco-Innovative Capacity of Companies—A Theoretical Approach. Available online: http://www.ecocyb.ase.ro/2012pdf/Paraschiv%20Dorel%20_T_.pdf (accessed on 31 August 2015).
  52. Eco-Inovare, Leadership Responsabil și Schimbare Organizțională în Procesul de Sustenabilitate Corporativă. Available online: http://www.amfiteatrueconomic.ro/ArticolRO.aspx?CodArticol=1133 (accessed on 31 August 2015).
  53. Comisia Europeană. Available online: http://ec.europa.eu/environment/pubs/pdf/factsheets/ecoinnovation/ro.pdf (accessed on 31 August 2015).
  54. EcoAP for a Sustainable Future. Available online: http://ec.europa.eu/environment/ecoap (accessed on 31 August 2015).
  55. A Resource-Efficient Europe—Flagship Initiative of the Europe 2020 Strategy. Available online: http://ec.europa.eu/resource-efficient-europe (accessed on 31 August 2015).
  56. Eco-Innovation Observatory. Available online: http://www.eco-innovation.eu (accessed on 31 August 2015).
  57. Sustainable Manufacturing and Eco-Innovation. First Steps in Building a Common Framework. Available online: http://www.symbiosis.dk/sites/default/files/Eco-Innovation%20in%20Industry%20OECD.pdf (accessed on 31 August 2015).
  58. Governance Indicators: Where are We, Where Should We Be Going? Available online: http://elibrary.worldbank.org/content/workingpaper/10.1596/1813-9450-4370 (accessed on 31 August 2015).
  59. Measuring the Quality of Life and the Construction of Social Indicators. Available online: http://0-dx-doi-org.brum.beds.ac.uk/10.1007/978-94-007-2421-1_10 (accessed on 31 August 2015).
  60. Composite Indices for Multidimensional Development and Poverty: An Application to MDG Indicators. Available online: http://www.fao.org/fileadmin/templates/ess/pages/rural/wye_city_group/2009/Paper_3_b2_DeMuro-Mazziotta-Pareto_Measuring_progress_towards_MDGs.pdf (accessed on 31 August 2015).
  61. Handbook on Constructing Composite Indicators: Methodology and User Guide. Available online: http://ictlogy.net/bibliography/reports/projects.php?idp=2308 (accessed on 31 August 2015).
  62. Composite Indicators of Country Performance: A Critical Assessment. Available online: http://0-www-oecd--ilibrary-org.brum.beds.ac.uk/science-and-technology/composite-indicators-of-country-performance_405566708255 (accessed on 31 August 2015).
  63. Constructing an Area-Based Socioeconomic Index: A Principal Components Analysis Approach. Available online: http://www.cup.ualberta.ca/wp-content/uploads/2013/04/SEICUPWebsite_10April13.pdf (accessed on 31 August 2015).
  64. Psychometric Theory. Available online: http://rds.epi-ucsf.org/ticr/syllabus/courses/46/2005/10/20/Lecture/readings/Psychometric%20Theory.pdf (accessed on 31 August 2015).
  65. Boelhouwer, J.; Stoop, I. Measuring well-being in the Netherlands: The SCP index from 1974 to 1997. Soc. Indic. Res. 1999, 48, 51–75. [Google Scholar] [CrossRef]
  66. Nomikos, P.; MacGregor, J.F. Monitoring batch processes using multiway principal component analysis. AIChE J. 1994, 40, 1361–1375. [Google Scholar] [CrossRef]
  67. Towards a Fiscal Illusion Index. Available online: http://mpra.ub.uni-muenchen.de/9760/ (accessed on 31 August 2015).
  68. Scott, W. Tracking Human Development: The Use of Statistics in Monitoring Social Conditions; United Nations Development Programme—Bratislava Regional Center (UNDP Bratislava Regi): Bratislava, Slovakia, 2004. [Google Scholar]
  69. SPSS Software Version 18. Available online: http://www-01.ibm.com/software/analytics/spss/downloads.html (accessed on 31 August 2015).
  70. Gilthorpe, M.S. The importance of normalization in the construction of deprivation indices. J. Epidemiol. Community Health 1995, 49, S45–S50. [Google Scholar] [CrossRef] [PubMed]
  71. Knapp, T.R.; Swoyer, V.H. Some empirical results concerning the power of Bartlett’s test of the significance of a correlation matrix. Am. Educ. Res. J. 1967, 4, 13–17. [Google Scholar] [CrossRef]
  72. Tabachnick, B.G.; Fidell, L.S. Profile Analysis of Repeated Measures: Using Multivariate Statistics; Harper Collins: New York, NY, USA, 1989. [Google Scholar]
  73. Davidescu, A. Investigating the impact of unemployment rate on the Romanian shadow economy. A complex approach based on ARDL and SVAR analysis. Romanian J. Econ. Forecast. 2014, 4, 109–127. [Google Scholar]

Share and Cite

MDPI and ACS Style

Davidescu, A.A.; Paul, A.M.V.; Gogonea, R.-M.; Zaharia, M. Evaluating Romanian Eco-Innovation Performances in European Context. Sustainability 2015, 7, 12723-12757. https://0-doi-org.brum.beds.ac.uk/10.3390/su70912723

AMA Style

Davidescu AA, Paul AMV, Gogonea R-M, Zaharia M. Evaluating Romanian Eco-Innovation Performances in European Context. Sustainability. 2015; 7(9):12723-12757. https://0-doi-org.brum.beds.ac.uk/10.3390/su70912723

Chicago/Turabian Style

Davidescu, Adriana AnaMaria, Andreea Maria Vass Paul, Rodica-Manuela Gogonea, and Marian Zaharia. 2015. "Evaluating Romanian Eco-Innovation Performances in European Context" Sustainability 7, no. 9: 12723-12757. https://0-doi-org.brum.beds.ac.uk/10.3390/su70912723

Article Metrics

Back to TopTop