Next Article in Journal
Industry 4.0 in Finance: The Impact of Artificial Intelligence (AI) on Digital Financial Inclusion
Previous Article in Journal
The Impacts of International Political and Economic Events on Japanese Financial Markets
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Non-Price Criteria for the Evaluation of the Tender Offers in Public Procurement of Ukraine

by
Alexander Baranovsky
1,
Nataliia Tkachenko
1,
Vladimer Glonti
2,
Valentyna Levchenko
3,
Kateryna Bogatyrova
4,
Zaza Beridze
2,
Larisa Belinskaja
5 and
Iryna Zelenitsa
6,*
1
Faculty of Banking Technology and Business, University of Banking, 04070 Kyiv, Ukraine
2
Faculty of Economics and Business, Batumi Shota Rustaveli State University, 6010 Batumi, Georgia
3
Faculty of Economics and Business, Kyiv National University of Technologies and Design, 01011 Kyiv, Ukraine
4
Faculty of Trade and Marketing, Kyiv National University of Trade and Economics, 02156 Kyiv, Ukraine
5
Faculty of Economics and Business Administration, Vilnius University, 01513 Vilnius, Lithuania
6
Faculty of International Trade and Law, Kyiv National University of Trade and Economics, 02156 Kyiv, Ukraine
*
Author to whom correspondence should be addressed.
Int. J. Financial Stud. 2020, 8(3), 44; https://0-doi-org.brum.beds.ac.uk/10.3390/ijfs8030044
Submission received: 27 April 2020 / Revised: 20 June 2020 / Accepted: 28 June 2020 / Published: 16 July 2020

Abstract

:
Traditionally, public procurement has been associated with the measurement of achieving savings. However, recent research shows that the economic impact of public procurement is not limited only to savings, but by measuring the impact of four capitals—natural, human, social, and economic—on sustainable well-being over time. Ukraine is a country with a very low gross domestic product (GDP) per capita, which exacerbates the problem of the impact of public procurement results on the population’s welfare. Ukrainian public procurement legislation allows customers to apply non-price criteria (the share of non-price criteria cannot be more than 70%), which, together, are taken into account in the formula of the quoted price. The studies show that the effect of the use of non-price criteria depends on the relevance of the method of the evaluation of non-price criteria. The most important non-price criteria for Ukrainian customers by product categories and the methods of their evaluation are analyzed according to the Bi.prozorro.org analytics module. Therefore, it is concluded that the quoted price method, which is used in Ukrainian practice, is not relevant in comparison with the method used in the EU. A survey of the government buyers on the practice of applying non-price criteria was conducted, and the areas of their use were identified.

1. Introduction

One of the most promising areas of e-commerce is so-called e-procurement (Gelderman et al. 2006), which is increasingly gaining ground in the public procurement markets of developed countries (SIGMA 2016), in particular the European Union common market. In fact, e-procurement is the flow and management in the electronic environment of all stages of the procurement cycle, including marketing research, determining the range of economic agents (potential suppliers), procurement procedures, placing orders, delivering and paying for them, budgeting, and planning procurement (formation of budgeting procurement and its implementation) (Shatkovskyi and Faivesh 2015). Public sector procurement is increasingly seen as an important instrument for inducing innovation in the private sector (Lenderink et al. 2019). Sustainable public procurement is a powerful tool to reflect on national strategic intentions and promote scientific and technological innovation (Hu et al. 2018; Wang et al. 2018a, 2018b; Jobidon et al. 2018; Ivashova and Ivashov 2019, p. 327).
The important step in the public procurement process is to determine the winner with which the procurement contract is concluded. From a market standpoint, considering the specificity of the product, work or service, there is the possibility of its realization, and it is at the point of intersection of the interests of a buyer and a seller. Therefore, the determining factor when choosing a tender winner is an evaluation of its tender offers (Vaidya et al. 2006) on the basis of the proportion of price and non-price criteria, due to the specificity of the procurement items (product, work, or service) (Costantino et al. 2012), technical specifications (Crown Agents 2017a, p. 3), and future operating costs (Edquist et al. 2015).
Therefore, knowing and characterizing public procurement announcements (tenders) is fundamental for managing public resources well (Rodríguez et al. 2019).
The application of the additional (non-price) offer evaluation criteria that are essential to the buyer, such as payment terms, date for implementation, warranty service, etc., is important for both public and commercial procurements (Wozniak et al. 2018; Zimon et al. 2019).
The enactment of the law of Ukraine on public procurement in 2015 provided the opportunity for government buyers to apply non-price criteria to select cost-effective proposals. Environmentally friendly procurement maintenance, the quality of health care, improvement of medical equipment, access to quality education, trust maintenance in the government agencies, the efficient use of economic resources, the development of small and medium enterprises, innovation, and the stimulation of the competitiveness of enterprises are associated with public procurement. For example, if public procurement is considered as a means of the realization of environmental goals through the mechanism of the circular economy, it contributes to the use of resources during and after their life cycle with further processing, and the further use of procurement, and changes the country’s environmental deficit. The Europe 2020 strategy has set an objective that public procurement should mitigate (OECD 2019) climate change, by reducing greenhouse gas emissions by 20%, and increasing energy efficiency by 20%. This approach adds new value to public procurement through its impact on the country’s natural, human, social, and economic capital (Zagirniak et al. 2018; Komarova et al. 2019), which changes the well-being of the population over time. However, to ensure the value of public procurement, government officials need the following tools: an objective method of evaluation of non-price criteria and tenders; the presence of examples of successful procurement with the impact of non-price criteria on efficiency; the opportunity for supplier innovators to be competitive in tenders in the conditions of application of mass price dumping by traditional participants; and a high level of buyer’s professionalism.
Different methods which are used to evaluate the same offers can give different results in determining the successful tender winner. The non-price criteria for the evaluation of tenders must be as objective and quantifiable as possible, and are important for conducting electronic public procurement. The neglect of non-price criteria that could reduce the cost of servicing goods in the future may have negative consequences for meeting public and state needs, which in turn reduces the effectiveness of using public services. This is especially notable during the construction of hospitals, schools, and roads, in providing the population with medications and more. The volume of public procurement in Ukraine in 2019 was UAH 1.03 trillion (at expected value), UAH 31.7 billion of which (3.1%) was announced with non-price criteria.
The electronic evaluation of tender offers is one of the stages that characterizes the level of development of electronic public procurement in a particular country. In 2015, 71% of the EU countries implemented this phase (Tkachenko 2016).
According to Draskovic et al. (2017, p. 596), the conditions of production, exchange, etc. (price regulation, investment decisions, scope of state purchases, changes in foreign trade conditions, etc.) are often crucial (specific interest) for certain groups of people.
Cholopray (2019) considers that the evaluation of tender offers should be an organized process for selecting the best offer to achieve this goal, and pays more attention to the research on how fair the price of tender offer is. The scientist believes that prices justification needs to be analyzed in order to make sure that the participant’s price is fair. There is no such practice in Ukraine. The latest changes in Ukrainian public procurement legislation, from April 2020, will introduce the possibility of rejecting tender offers with abnormally low prices.
The main non-price criteria for the evaluation of tender offers are the term, the guarantee, the payment terms, the functional and environmental properties of the product (Duda 2016). Despite the feasibility of the application of non-price criteria, only 17% of the tender’s non-price criteria have been applied in the Czech Republic. The author explains such a low proportion to the fact that customers are afraid of responsibility for being objective in the evaluation of the offers before the Bureau of Competition Protection based on the audit results of the Czech Republic. In Ukraine, state audit bodies monitor and review procurement only in compliance with legal requirements. The analysis of inflated purchase prices is actively carried out by public organizations that make such cases public.
The application of environmental (Walker and Brammer 2012; Koziuk et al. 2019) and social criteria (Khoma et al. 2018; Glonti et al. 2020) in the area of public procurement (Semple 2015) also takes place, but many customers do not take into consideration the financial sustainability of the participants, which is a more important criterion when choosing a supplier. We agree with the author’s position and believe that such a practice should be implemented in Ukraine.
In the study of the evaluation of the tender offers by government customers, the scientists (Mateus et al. 2010) consider a linear scoring function and note the importance of openness of information on non-price criteria according to the Code of State Contracts. In Ukraine, information on the application of non-price criteria is open, and the price method is the only one that can be applied, which is a significant weakness (Tkachenko et al. 2020).
In public procurement guidelines, the EU project “Harmonization of the Public Procurement System in Ukraine with EU Standards” (Crown Agents 2017a, 2017b) the experts have stated that compliance with the technical specifications on a two-point scale “meets”/“does not meet” does not comply the principle of the best offer in terms of the quality. This two-point scale practice is used by the customers in many cases in Ukraine.
The use of non-price criteria in the evaluation of the tender offers allows one to choose the most cost-effective offer, but on the condition that such criteria are significant, the evaluation methodology is adequate and the evaluation results are controlled.

2. Aims and Methods

The aim of the study is to identify important non-price criteria for Ukrainian government buyers based on the ProZorro (2019) system analytics module; the assessment of the adequacy of the quoted price method which is used in the Ukrainian practice; customers survey on the awareness of the need to apply non-price criteria; the implementation of author’s questionnaire of polling government customers at the online training “Electronic evaluation of tender offers proposals using non-price criteria.”
The analysis of non-price criteria used by the tenderers was based on the ProZorro (2019) analytics module. Non-price criteria have been studied; product groups for which customers have defined non-price criteria and how the use of non-price criteria affect the level of competition have also been investigated. On the one hand, the use of non-price criteria should not restrict competition between suppliers, and, on the other hand, it should allow suppliers who offer the products with higher quality, safety, innovation, environmental measures to be competitive in public procurement by price criteria.
The assessment of the adequacy of the quoted price method used in the Ukrainian public procurement system has been performed on the basis of the comparison of the results using other methods, such as the estimated value method and the comparative method. This comparison allows us to make conclusions on whether an objective choice of the best offer is achieved, taking into account non-price criteria.
The survey of the customers has been conducted in order to assess their level of awareness of the purpose of non-price criteria, and the ratio of expectations and results in the application of non-price criteria.

3. Results

According to the data of the professional analytics module, the use of non-price criteria for the evaluation of the tender offers in Ukraine in 2019 was observed in 1.9 thousand of the tender’s procedures for the nomenclature and lots of the expected value of UAH 31.7 billion. Overall, 97% of public procurement procedures (at the expected value) are carried out under a single price criterion. For comparison, in the EU, the share of purchases for the price criterion is carried out only from 12 to 97% (Table 1).
According to the ProZorro (2019) electronic procurement system analytics module, non-price criteria are used in 3.7% for the procurement of goods, 4.4% for services and 91.9% for works.
The main non-price criterion for the purchase of goods is the delay of payment that, in the percentage terms is 41% (Figure 1), including the term more than 180 days from the date of delivery of goods, receiving of services, execution of tenders, which is a negative phenomenon of the financing of public procurement.
The law of Ukraine stipulates that non-price criteria can be used only in the case of complex or specialized procurement, and in the case of the procurement of goods, works and services produced, performed or provided not for a separately developed specification (technical design)—only the price is a permanent market for them. We have analyzed the nomenclature of goods purchased by non-price criteria (Figure 2). The studies showed that non-price criteria were used to purchase goods, which required the use of price criterion only by the law. No risk indicator is monitored (Merlo et al. 2013, p. 446; Xue et al. 2018; Pyrkova et al. 2018, p. 122; Kaigorodova et al. 2018; Glonti et al. 2019, p. 126; Vinogradova et al. 2019).
Non-price criteria have been observed in 14% of the purchases of goods with non-price criteria, which are determined for the selection of a specific winner—a sign of corruption by the customers. These are criteria, such as a non-payer of value added tax; the availability of certificates and licenses; experience of execution of similar contracts, experience of delivery for the budget sphere.
The study has shown that non-price criteria used by tenderers are absurd. For example, a delay of payment without charging penal sanctions (ProZorro 2018) indicates that the customer considers it as the best offer of the tenderer, who will not use penal sanctions, in case the customer fails to execute the contract in terms of timely payment.
We have investigated how the application of non-price criteria affected the level of competition (Table 2).
The analysis of the use of non-price criteria by the tender organizers has given the following results:
  • Ukrainian customers do not have the current practice of correctly applying non-price evaluation criteria for the tender offers. They often apply irrelevant and nonobjective non-price criteria for evaluating tenders, especially when purchasing goods, which leads to the violation of the principle of maximum procurement efficiency.
  • The use of non-price evaluation criteria for participants in most product groups has led to increased competition in the tenders.
  • The model of evaluation of tender offers with non-price criteria, which is regulated and applied in Ukraine, is unsuccessful for the selection of the best offer.
The national public procurement legislation uses the method of reducing the quoted price to evaluate the tenders with non-price criteria (Formula (1)).
PP = P/(1 + (F1 + F2 + … Fn)/PV,
where
  • PP—the quoted price;
  • P—the offer price;
  • F—the value of non-price criterion of i-participant;
  • PV—the importance of “price” criterion.
or
PP = P/KK,
where
  • KK—the correction coefficient
KK = 1 + (F1 + F2 + … Fn)/PV
Table 3 shows the initial data for the calculation of the quoted price.
The criteria for the evaluation of the tender offers and the range (the example is given in Table 4) are indicated in the electronic procurement announcement, and in the tender documents of the tenderer (section “Tender offer evaluation”).
Legislation of Ukraine “On the Public Procurement” assumes that the customer independently determines the method of evaluation of tender offers, but in fact, except for the method of reducing the quoted price, it is impossible to apply others, as the electronic form of the announcement of the auction does not provide it (Legislation of Ukraine “On the Public Procurement” 2020). The comparative method (Table 5) and the method of valuation (Table 6) are used in world practice. We have carried out calculations of the evaluation of tender offers by different methods, but with the same initial data. The results of the study have shown that the method of reducing the quoted price is not an objective method for choosing the best offer (Table 7).
K 1 = k P i P n ,
where
K1, K2—the total evaluation of the first group criteria;
k—the coefficient of importance of the i criterion of the evaluation of the tender offers;
Pi—the indicator of the criterion of the i offer;
Pn—the indicator of the criterion of the best (base) offer, the second group is the criteria that increase in value, of which reduces the level of competitiveness of the offer (Formula (5)).
K 2 = K P n P i ,
where K2—the total evaluation of the criteria of the second group.
The essence of the estimated value method (World Bank 2011) is that non-price criteria are transferred in monetary terms regarding the specified minimal requirements. The modifiers that reflect non-price criteria as a percentage of the deviation from the offer price are introduced (Table 6).
The results of the evaluation of the tender offers have shown that the most objective method of the evaluation is the method of comparison, while the method of reducing the quoted price is the best formula by which the worst one can be selected.
The offer of Participant 3 is the worst, according to the source data in Table 7, when using the method of reducing the quoted price, while according to the estimated value method, Participant 3 has the best offer, and he will receive the contract. Participant 1 will receive the contract when using the comparison method. Participant 2 will receive the contract when applying the method of reducing the quoted price, while with other methods, the offer of participant 3 is the worst. As we can see, various methods of the evaluation of the tender offers, in which, in addition to price criteria, non-price criteria are used, giving different results on the contract award to a tenderer. The method of reducing the quoted price is the only one which is used in Ukraine. The law of Ukraine establishes that the state customer chooses the evaluation method independently, but the ProZorro electronic system is configured only for one method, and excludes the use of other objective methods that are used in international practice.
Thus, the method of reducing the quoted price, which is used in Ukrainian practice, does not ensure the implementation of the principle of “lower price for better quality”, if we compare it with the methods used in international practice.
In March 2020, we conducted a questionnaire survey of state purchasers in Ukraine on the practice of non-price criteria.
There were six questions in the questionnaire. (1) How often do you use non-price criteria to evaluate the tender offers? (2) Do you think that the method of reducing the quoted price allows you to choose the best tenderer? (3) What are the main reasons for your misuse of non-price criteria in public procurements? (4) Do you think that more stringent requirements for the tenderers (for example, mandatory presence of international ISO quality certificates, IOAS certificates of conformity) are an alternative to using non-price criteria? (5) What requirements do you apply to the tenderer in order to reduce the risk of purchasing low-quality products? (6) What actions do you expect from the state regulator of public procurement to enable innovative and green procurements?
Thus, 76% among 92 state purchasers surveyed in March 2020 believed that the method of reducing the quoted price did not allow one to choose the best offer. The respondents said that innovative and environmentally friendly goods were expensive in comparison with the traditional goods, and the difference in price did not allow the best suppliers to compete, in a situation where unscrupulous suppliers dump during the tenders and win the tenders. Overall, 66% of government purchasers surveyed conspirators did not use non-price criteria, as they believed that they might be a reason for monitoring by the State Audit Office. It should be noted here that the control body (the State Audit Office) does not monitor the criteria for the evaluation of tender proposals. Moreover, 87% of the respondents believed that the application of stricter requirements to suppliers and documentary evidence of compliance was the alternative to non-price criteria. Additionally, 9% of the customers required, from the tenderers, a copy of the certificate of conformity and a copy of the certificate of the accreditation body for conformity assessment (IOAS certificates), in order to reduce the risk of purchasing low-quality products. The choice of a reliable supplier is more important for most customers than the estimation of the total cost of ownership. Furthermore, 91% of the surveyed customers believed that they wanted to see successful practices of the customers who had used non-price criteria to achieve efficiency. Moreover, 98% of the respondents expected, from the regulator, recommendations on the methodology for the assessment of the life cycle value; 11% anticipated recommendations on the method of assessment of the goods impact on the environment; 98% expected recommendations for the purchase of environmentally friendly public procurement.
The recent changes in the EU Public Procurement Directive (Directive 2014/24/EU 2014) have shown a tendency to reject the sole price criterion for the evaluation of the tender offers and the practice of an optimal price-quality ratio is becoming more topical. Models for estimating the total cost of ownership, life cycle cost of public procurement and green public procurement are widely used in the practice of countries with effective public procurement systems. The life cycle cost is calculated at the stage of procurement planning in the international practice, with the use of free online calculators, which are freely available and used as a criterion for the evaluation of the tender offers. In Sweden, online calculators are designed in the form questionnaire for the procurement of lighting, automobiles, vending machines and coffee machines; appliances.
In the construction industry in the EU (the UK, the Netherlands, Portugal, France), LCC contracts (life cycle contracts) are used, under which project payments are made not from the moment of completion of the construction works, but from the moment of the start of the operation of the facility. The payment for the project includes a fee for the service and depends on the quality of execution of the contract terms’ requirements. Penalties are imposed on the company in case of non-compliance. The cost of the contract life cycle construction reduces costs to 40% in comparison with budget construction costs.
The G7 countries (Austria, Denmark, Finland, Germany, the Netherlands, Sweden and England) have introduced a public procurement procedure for eco-labeled goods (Nordic Council of Ministers 2017), in order to minimize the negative impact on the environment. The EU directives contain specific recommendations for green procurement:
-
inclusion of environmental requirements in the technical conditions;
-
use of ecological trademarks;
-
application of ecological criteria for the selection of the winner.
The specific subject of green procurement is, for example, paper for recyclable materials printing, the design and construction of an energy-efficient building (Grandia and Voncken 2019; Sönnichsen and Clement 2020). This confirms the fact that corporate social responsibility is becoming an integral part of human development in the world (Činčalová 2017, 2018; Buzko et al. 2019; Trunina and Khovrak 2019; Trynchuk et al. 2019; Činčalová and Hedija 2020).
The qualification requirement for the tenderers should be the experience of performing similar contracts in the subject of procurement. The LCA (life cycle assessment) method is used to evaluate the tender offers, which allows one to determine the most significant impact of the product on the environment, such as minimal CO2 emissions (European Commission 2020). Green public procurement (GPP) is an increasingly debated “demand side” environmental policy instrument (Brammer and Walker 2011; Cheng et al. 2018; Fuentes-Bargues et al. 2018).
In 2009, Price Waterhouse Coopers (PWC) conducted the research on green public procurement in the G7 countries. The report (The National Agency for Public Procurement 2019) has shown that environmentally sound public procurements can lead to cost reductions over time, rather than cost increases, which is often a common perception.
It is very important to study foreign experience, because in Ukraine, unfortunately, the procurement system does not use such models as: total cost of ownership (TCO) (Ellram 1995), life cycle costing (Hochschorner and Finnveden 2006), and sustainable procurement (Burchard–Dziubińska 2017; Bernal et al. 2019; World Bank 2019).

4. Conclusions

The results of the study have shown that the main non-price criteria, which are used by the Ukrainian customers, are the delay of payment term for the delivery of goods (performance of services, works), the experience of suppliers in the market, qualification requirements for the tenderer, the presence of the certificates and licenses. Product quality criteria are used only in 2% of the tenders. Ukrainian customers do not have the modern practice of applying non-price safety criteria, environmental protection measures and innovativeness, and are waiting for recommendations from the regulator. Insignificant and unobjective non-price criteria for the evaluation of the tender offers are often used, especially with the purchase of goods, which leads to a violation of the principle of the maximum efficiency (effectiveness) of procurement. In Ukraine, there are no tools for monitoring non-price criteria, and there are no assessment methods of the effectiveness of the impact of non-price criteria on the efficiency of public procurement. The use of non-price evaluation criteria for the participants in most product groups has led to increased competition in the tenders.
The model of the evaluation of the tender offers with non-price criteria, which is regulated and applied in Ukraine, is unsuccessful for choosing the best offer. The method of reducing the quoted price used in the ProZorro electronic system of public procurement does not provide the best offer, and does not allow innovative suppliers to be competitive, in comparison with unscrupulous suppliers who often dump during the tender. The comparative method is more reasonable with the use of non-price criteria.
According to the survey of the customers on the practice of the use of non-price criteria, it has been determined that the customers want to buy environmentally friendly and innovative products, but have little knowledge of how to apply such criteria properly, and expect, from the regulator, examples of successful practices.
The subject of our further research will be the methodology of the total cost of ownership, the cost of the life cycle of purchases, and green public procurements in terms of their impact on the economic and natural capital of the country, which is a completely new direction for Ukraine.
The influencing factors at the efficiency of public procurement are identified: the objectification of non-price criteria and the method of the evaluation of the tender offers; the presence of the examples of successful procurement with the impact of non-price criteria on the efficiency; the opportunity for the supplier innovators to be competitive in the tenders in the conditions of the application of mass price dumping by the traditional participants; a high level of buyers professionalism, the active efforts of the state regulator in the promotion of the best practice of public procurements.

Author Contributions

Conceptualization, A.B., N.T., V.G. and V.L.; methodology, A.B., N.T., V.G. and V.L.; software, N.T., Z.B. and I.Z.; validation, N.T., K.B., Z.B. and I.Z.; formal analysis, A.B., N.T., V.G., V.L., K.B., Z.B. and I.Z.; investigation, A.B., N.T., V.G. and V.L.; resources, A.B., N.T., V.G., V.L., K.B., Z.B., L.B. and I.Z.; data curation, A.B., N.T. and I.Z.; writing—original draft preparation A.B., N.T., V.G., V.L., K.B., Z.B. and I.Z.; writing—review and editing, A.B., N.T., V.G., V.L., L.B.; visualization, N.T., K.B., Z.B. and I.Z.; supervision, A.B. and N.T.; project administration, N.T. and I.Z.; funding acquisition A.B., N.T., V.G., V.L., K.B., Z.B., L.B. and I.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Acknowledgments

We are grateful to the editorial team for their support and guidance in preparing the publication. Special thanks also go to reviewers who have dedicated their time and experience to evaluating the quality of the submitted manuscript and giving the authors valuable feedback.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Bernal, Ramon, Leire San-Jose, and Jose Luis Retolaza. 2019. Improvement Actions for a More Social and Sustainable Public Procurement: A Delphi Analysis. Sustainability 11: 4069. [Google Scholar] [CrossRef] [Green Version]
  2. Bi.prozorro. 2019. Indicators (2018–2019). Available online: http://bi.prozorro.org/http/sense/app/fba3f2f2-cf55-40a0-a79f-b74f5ce947c2/sheet/HbXjQep/state/analysis#view/pEh (accessed on 20 January 2020).
  3. Brammer, Stephen, and Helen Walker. 2011. Sustainable procurement in the public sector: An international comparative study. International Journal of Operations & Production Management 31: 452–76. [Google Scholar]
  4. Burchard–Dziubińska, Małgorzata. 2017. Sustainable public procurement as an instrument of implementation of sustainable development. Theoretical and practical approach. Zeszyty Naukowe. Organizacja i Zarządzanie / Politechnika Śląska 104: 9–19. [Google Scholar] [CrossRef]
  5. Buzko, Iryna, Olena Vartanova, Iryna Trunina, and Inna Khovrak. 2019. Theoretical aspects of regional sustainable development in the EU and Ukraine. Paper presented at Innovative Economic Symposium 2018—Milestones and Trends of World Economy (IES2018), Beijing, China, November 8–9. [Google Scholar]
  6. Cheng, Wenjuan, Andrea Appolloni, Alessio D’Amato, and Qinghua Zhu. 2018. Green Public Procurement, missing concepts and future trends—A critical review. Journal of Cleaner Production 176: 770–84. [Google Scholar] [CrossRef]
  7. Cholopray, Aaron. 2019. The Bid Evaluation Process. Available online: https://procurementclassroom.com/the-bid-evaluation-process/ (accessed on 8 March 2020).
  8. Činčalová, Simona. 2017. CSR in the logistics sector and its analyses. Paper presented at 30th International Business Information Management Association Conference, IBIMA 2017—Vision 2020: Sustainable Economic development, Innovation Management, and Global Growth, Madrid, Spain, November 8–9. [Google Scholar]
  9. Činčalová, Simona. 2018. Empirical research on corporate social responsibility in the logistics company. Paper presented at 31st International Business Information Management Association Conference, IBIMA 2018: Innovation Management and Education Excellence through Vision 2020, Milan, Italy, April 25–26. [Google Scholar]
  10. Činčalová, Simona, and Veronika Hedija. 2020. Firm characteristics and corporate social responsibility: The case of Czech transportation and storage industry. Sustainability 12: 1992. [Google Scholar] [CrossRef] [Green Version]
  11. Costantino, Nicola, Mariagrazia Dotoli, Marko Falagario, and Fabio Sciancalepore. 2012. Balancing the additional costs of purchasing and the vendor set dimension to reduce public procurement costs. Journal of Purchasing & Supply Management 18: 189–98. [Google Scholar]
  12. Crown Agents. 2017a. Harmonization of Public Procurement System in Ukraine with EU Standards. Guidelines on Public Procurement Award Criteria on Best Price/Quality Ratio. Available online: https://translate.google.com/translate?hl=ru&sl=en&u=http://eupublicprocurement.org.ua/wp-content/uploads/2017/09/Guidelines_on-award-criteria_ENG.pdf&prev=search (accessed on 10 March 2020).
  13. Crown Agents. 2017b. Public Procurement Guidelines. The EU Project: Harmonisation of Public Procurement System in Ukraine with EU Standards. Available online: https://eupublicprocurement.org.ua/wp-content/uploads/2017/10/Guidelines_UKR_interactive_pages.pdf (accessed on 12 January 2020).
  14. Directive 2014/24/EU of the European Parliament and of the Council “On public Procurement and Repealing Directive 2004/18/EC” of 26 February 2014. 2014. Available online: http://eurlex.europa.eu/legal-content/EN/TXT/?uri=uriserv%3AOJ.L_.2014.094.01.0065.01.ENG (accessed on 1 March 2019).
  15. Draskovic, Mimo, Milica Delibasic, Veselin Draskovic, Mladen Ivic, and Drago Pupavac. 2017. Public sector management as a development problem in the countries of Southeast Europe. Public Policy and Administration 16: 593–604. [Google Scholar]
  16. Duda, Danuta. 2016. Assessment and Evaluation of Tenders in Public Procurement in the Czech Republic. Available online: http://aak.slu.cz/pdfs/aak/2016/04/01.pdf (accessed on 1 March 2019).
  17. Edquist, Charles, Nicholas Vonortas, Jon Zabala-Iturriagagoitia, and Jakob Edler, eds. 2015. Public Procurement for Innovation. Cheltenham: Edward Elgar Publishing. [Google Scholar]
  18. Ellram, Lisa M. 1995. Total Cost of Ownership: An Analysis Approach for Purchasing. International Journal of Physical Distribution & Logistics Management 25: 4–23. [Google Scholar]
  19. European Commission. 2019. Single Market Scoreboard. Public Procurement Reporting Period: 01/2018–12/2018. Available online: https://ec.europa.eu/internal_market/scoreboard/performance_per_policy_area/public_procurement/index_en.htm (accessed on 23 May 2019).
  20. European Commission. 2020. Green Public Procurement. Available online: http://ec.europa.eu/environment/gpp/index_en.htm (accessed on 15 March 2020).
  21. Fuentes-Bargues, Jose Luis, Pablo Sebastian Ferrer-Gisbert, and Mª. Carmen González-Cruz. 2018. Analysis of Green Public Procurement of Works by Spanish Public Universities. International Journal of Environmental Research and Public Health 15: 1888. [Google Scholar] [CrossRef] [Green Version]
  22. Gelderman, Cees, Paul Ghijsen, and Marc Brugman. 2006. Public procurement and EU tendering directives—Explaining non-compliance. International Journal of Public Sector Management 19: 702–14. [Google Scholar] [CrossRef]
  23. Glonti, Vladimer, Rezo Manvelidze, and Lasha Manvelidze. 2019. Big financial crisis: Analysis, assessment, perspectives. Paper presented at 39th International Scientific Conference on Economic and Social Development—Sustainability from an Economic and Social Perspective, Portugal, Lisbon, April 29–30; pp. 126–39. [Google Scholar]
  24. Glonti, Vladimer, Viktor Trynchuk, Inna Khovrak, Ganna Mokhonko, Marina Shkrobot, and Lasha Manvelidze. 2020. Socialization of organization sustainable development based on the principles of corporate social responsibility. Montenegrin Journal of Economics 16: 169–82. [Google Scholar] [CrossRef]
  25. Grandia, Jolien, and Dylan Voncken. 2019. Sustainable Public Procurement: The Impact of Ability, Motivation, and Opportunity on the Implementation of Different Types of Sustainable Public Procurement. Sustainability 11: 5215. [Google Scholar] [CrossRef] [Green Version]
  26. Hochschorner, Elisabeth, and Göran Finnveden. 2006. Life Cycle Approach in the Procurement Process: The Case of Defence Materiel. The International Journal of Life Cycle Assessment 11: 200–8. [Google Scholar] [CrossRef]
  27. Hu, Feihu, Xuan Feng, and Hui Cao. 2018. Short-Term Decision Model for Electricity Retailers: Electricity Procurement and Time-of-Use Pricing. Energies 11: 3258. [Google Scholar] [CrossRef] [Green Version]
  28. Ivashova, Ljudmyla, and Mykhailo Ivashov. 2019. Ukrainian realities and the word experience of fighting corruption in the field of public procurement. Public Administration and Regional Development 4: 316–43. [Google Scholar] [CrossRef]
  29. Jobidon, Gabriel, Pierre Lemieux, and Robert Beauregard. 2018. Implementation of Integrated Project Delivery in Quebec’s Procurement for Public Infrastructure: A Comparative and Relational Perspective. Sustainability 10: 2648. [Google Scholar] [CrossRef] [Green Version]
  30. Kaigorodova, Gulnara, Darya Alyakina, Guzel Pyrkova, Alfiya Mustafina, and Viktor Trynchuk. 2018. Investment activity of insurers and the state economic growth. Montenegrin Journal of Economics 14: 109–23. [Google Scholar] [CrossRef]
  31. Khoma, Iryna, Liudmyla Moroz, and Pavlo Horyslavets. 2018. Diagnostics of conflicts within the Business Social Responsibility Forming System. Journal of Competitiveness 10: 16–33. [Google Scholar] [CrossRef]
  32. Komarova, Anna, Lyudmila Tsvetkova, Svetlana Kozlovskaya, and Nikolay Pronkin. 2019. Organisational educational systems and intelligence business systems in entrepreneurship education. Journal of Entrepreneurship Education 22: 1–15. [Google Scholar]
  33. Koziuk, Victor, Oleksandr Dluhopolskyi, Yurij Hayda, and Yurij Klapkiv. 2019. Does educational quality drive ecological performance? Case of high and low developed countries. Global Journal of Science and Management 5: 22–32. [Google Scholar]
  34. Legislation of Ukraine “On the Public Procurement”. 2020. Available online: https://zakon.rada.gov.ua/laws/show/922-19 (accessed on 18 January 2020).
  35. Lenderink, Bart, Johannes I. M. Halman, and Hans Voordijk. 2019. Innovation and public procurement: From fragmentation to synthesis on concepts, rationales and approaches. Innovation: The European Journal of Social Science Research 2019: 1–25. [Google Scholar] [CrossRef] [Green Version]
  36. Mateus, Ricardo, José Antunes Ferreira, and João Carreira. 2010. Full disclosure of tender evaluation models: Background and application in Portuguese public procurement. Journal of Purchasing and Supply Management 16: 206–15. [Google Scholar] [CrossRef]
  37. MEDT. 2016. Order № 680 from 13.04.2016 On Approval of Approximate Tender Documentation. Available online: http://www.me.gov.ua/Documents/Detail?lang=uk-UA&id=090f94c6-9b7a-47d4-92fd-6cea01d701d9&title=MertNakaz680-Vid13-04-2016-ProPoperedniuAvtorizatsiiuElektronnikhMaidanchik (accessed on 10 January 2020).
  38. Merlo, Pawel, Robert Dankiewicz, and Anna Ostrowska-Dankiewicz. 2013. Probabilistic and statistical methods of risk analysis in the investments effectiveness evaluation and their application in business practice. Actual Problems of Economics 150: 437–46. [Google Scholar]
  39. Nordic Council of Ministers. 2017. Nordic Guidelines—Green Public Procurement. How to Use Environmental Management Systems and Ecolabels in EU Tenders. Available online: http://norden.diva-portal.org/smash/get/diva2:1087097/FULLTEXT01.pdf (accessed on 15 June 2019).
  40. OECD. 2019. The Impact of Public Procurement in Germany: Economic Effects and Beyond, in Public Procurement in Germany: Strategic Dimensions for Well-Being and Growth. Paris: OECD Publishing, Available online: https://0-www-oecd--ilibrary-org.brum.beds.ac.uk/sites/5d89ab8b-en/index.html?itemId=/content/component/5d89ab8b-en (accessed on 28 May 2020).
  41. ProZorro. 2018. Construction Works and Repair (Works of an Unfinished Building for Service Housing for Servicemen). Available online: https://prozorro.gov.ua/tender/UA-2018-05-23-000763-b?fbclid=IwAR0hoxAnxQQ8C8g3h6r22opvfP7ZRbs1NCayXKVei3COJO4D1dQWgsEMY54 (accessed on 10 March 2020).
  42. ProZorro. 2019. Electronic System of Public Procurements. Available online: https://prozorro.gov.ua/ (accessed on 15 March 2020).
  43. ProZorro infobox. 2019. Non-Price Criteria of Evaluation. Available online: https://infobox.prozorro.org/articles/necinovi-kriteriji-ocinki (accessed on 7 March 2020).
  44. Pyrkova, Guzel, Gulnara Kaigorodova, Alfiya Mustafina, and Darya Alyakina. 2018. Financial risks: Methodological approaches and management methods. Journal of Social Sciences Research 5: 122–27. [Google Scholar]
  45. Rodríguez, Manuel J. García, Vicente Rodríguez Montequín, Francisco Ortega Fernández, and Joaquín M. Villanueva Balsera. 2019. Public Procurement Announcements in Spain: Regulations, Data Analysis, and Award Price Estimator Using Machine Learning. Complexity 2019: 1–20. [Google Scholar] [CrossRef]
  46. Semple, Abby. 2015. The Link to the Subject-Matter: A Glass Ceiling for Sustainable Public Contracts? in University of Oslo as part of the European Law Conference 2014, Forthcoming volume published by Cambridge University Press. Available online: http://0-dx-doi-org.brum.beds.ac.uk/10.2139/ssrn.2565051 (accessed on 15 March 2020).
  47. Shatkovskyi, Olexander, and Grem Faivesh. 2015. Electronic Government Procurements: Finding the Ukrainian Way. Available online: https://eupublicprocurement.org.ua/e-procurement-finding-a-way-for-ukraine.html (accessed on 1 March 2019).
  48. SIGMA. 2016. Market Analysis, Preliminary Market Consultations and Prior Involvement of Candidates/Tenderers. Brief 32. Paris: OECD Publishing, Available online: http://www.sigmaweb.org/publications/Public-Procurement-Policy-Brief-32-200117.pdf (accessed on 17 September 2019).
  49. Sönnichsen, Sönnich Dahl, and Jesper Clement. 2020. Review of Green and Sustainable Public Procurement: Towards Circular Public procurement. Journal of Cleaner Production 245: 118901. [Google Scholar] [CrossRef]
  50. The National Agency for Public Procurement. 2019. Available online: http://www.upphandlingsmyndigheten.se/omraden/lcc/lcc-kalkyler/ (accessed on 10 March 2020).
  51. Tkachenko, Nataliia. 2016. Electronic public procurements: The EU experience and implementation in Ukraine. Actual Problems of Economics 184: 471–77. [Google Scholar]
  52. Tkachenko, Nataliia, Rezo Manvelidze, Inna Khovrak, Vladimer Glonti, and Iryna Zelenitsa. 2020. Public procurement performance: Criteria and indicators for Ukraine. Paper presented at 35th International Business Information Management Association Conference, IBIMA 2020, Seville, Spain, April 1–2. [Google Scholar]
  53. Trunina, Iryna, and Inna Khovrak. 2019. Harmonization of the Interests of Employers and Institutions of Higher Education as a Basis for the Sustainable Regional Development. Paper presented at IEEE International Conference on Modern Electrical and Energy Systems (MEES), Kremenchuk, Ukraine, September 23–25. [Google Scholar]
  54. Trynchuk, Viktor, Inna Khovrak, Robert Dankiewicz, Anna Ostrowska-Dankiewicz, and Anna Chushak-Holoborodko. 2019. The role of universities in disseminating the social responsibility practices of insurance companies. Problems and Perspectives in Management 17: 449–61. [Google Scholar] [CrossRef]
  55. Vaidya, Kishor, ASM Sajeev, and Guy Callender. 2006. Critical factors that influence e-procurement implementation success in the public sector. Journal of Public Procurement 6: 70–99. [Google Scholar] [CrossRef] [Green Version]
  56. Vinogradova, Ekaterina, Lyudmila Tsvetkova, and Larisa Orlaniuk-Malitskaia. 2019. Development of the risk insurance zone for high-tech enterprises. International Journal of Management and Business Research 9: 138–48. [Google Scholar]
  57. Walker, Helen, and Stephen Brammer. 2012. The relationship between sustainable procurement and e-procurement in the public sector. International Journal of Production Economics 140: 256–68. [Google Scholar] [CrossRef]
  58. Wang, Kwo-Wuu, Yuan-Yu Hsu, Wen-der Yu, and Shao-tsai Cheng. 2018a. Determination of Project Procurement Method with a Graphical Analytic Model. Sustainability 10: 3583. [Google Scholar] [CrossRef] [Green Version]
  59. Wang, Xiaoli, Yun Liu, and Yanbing Ju. 2018b. Sustainable Public Procurement Policies on Promoting Scientific and Technological Innovation in China: Comparisons with the U.S., the UK, Japan, Germany, France, and South Korea. Sustainability 10: 2134. [Google Scholar] [CrossRef] [Green Version]
  60. World Bank. 2011. Guidelines: Procurement of Goods, Works and Non-Consulting Services under IBRD Loans and IDA Credits and Grants by World Bank Borrowers (English). Investment Climate in Practice; no. 5. Business Operation and Taxation. Washington, D.C.: World Bank, Available online: http://documents.worldbank.org/curated/en/634571468152711050/Guidelines-procurement-of-goods-works-and-non-consulting-services-under-IBRD-loans-and-IDA-credits-and-grants-by-World-Bank-borrowers (accessed on 10 March 2020).
  61. World Bank. 2019. Procurement Guidelines: Sustainable Procurement an introduction for Practitioners to Sustainable Procurement in World Bank IPF Projects. Washington, D.C.: World Bank, Available online: http://pubdocs.worldbank.org/en/788731479395390605/Guidance-on-Sustainable-Procurement.pdf (accessed on 10 March 2020).
  62. Wozniak, Dariusz, Justyna Sokołowska-Wozniak, Barłomiej Jankowiak, Andrzej Cwynar, Wiktor Cwynar, Anna Ostrowska-Dankiewicz, and Robert Dankiewicz. 2018. Trade Credit in Polish Companies. An Empirical Analysis of Macroeconomic Factors Influencing Payment Delays. Business and Non-profit Organizations Facing Increased Competition and Growing Customers’ Demands 17: 627–44. [Google Scholar]
  63. Xue, Kelei, Ya Xu, and Lipan Feng. 2018. Managing Procurement for a Firm with Two Ordering Opportunities under Supply Disruption Risk. Sustainability 10: 3293. [Google Scholar] [CrossRef] [Green Version]
  64. Zagirniak, Denys, Inna Khovrak, and Viktoria Perevozniuk. 2018. The convergence of the systems of education at Scottish and Ukrainian universities in the context of ethic leadership. International Journal of Engineering and Technology (UAE) 7: 550–56. [Google Scholar] [CrossRef]
  65. Zimon, Grzegorz, Anna Ostrowska-Dankiewicz, Robert Dankiewicz, Viktoria Baranovska, and Iryna Zelenitsa. 2019. Trade policy in the aspect of trade credit in group purchasing. Financial and Credit Activity: Problems of Theory and Practice 1: 139–48. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Structure of non-price criteria specified by the customer in the procurement of goods announcement in 2019. Source: compiled by the authors according to the data of the analytics module (Bi.prozorro 2019).
Figure 1. Structure of non-price criteria specified by the customer in the procurement of goods announcement in 2019. Source: compiled by the authors according to the data of the analytics module (Bi.prozorro 2019).
Ijfs 08 00044 g001
Figure 2. Goods purchased by customers by non-price criteria in 2019. Source: compiled by the authors according to the data of the analytics module (Bi.prozorro 2019).
Figure 2. Goods purchased by customers by non-price criteria in 2019. Source: compiled by the authors according to the data of the analytics module (Bi.prozorro 2019).
Ijfs 08 00044 g002
Table 1. Proportion of procedures in which the contract award was carried out only on a price criterion, 2018, %.
Table 1. Proportion of procedures in which the contract award was carried out only on a price criterion, 2018, %.
Country%
Malta97
Lithuania96
Slovakia96
Cyprus93
Iceland92
Greece90
Estonia88
Romania86
Bulgaria84
Sweden79
Czech Republic77
Latvia74
Liechtenstein71
Portugal69
Luxembourg67
Germany65
Slovenia63
Finland56
Poland48
Hungary44
Denmark42
Italy39
Belgium37
Croatia34
Spain31
Austria28
Ireland24
Norway24
Netherlands18
France12
United Kingdom12
Source: compiled by the authors according to the data (European Commission 2019).
Table 2. Level of competition for selected items, depending on the use of non-price criteria.
Table 2. Level of competition for selected items, depending on the use of non-price criteria.
No.Group of GoodsThe Level of Competition in Procurement
Without Non-Price CriteriaWith Non-Price Criteria
Works
1Construction of pipelines, roads2.403.05
Goods
2Transport equipment2.592.78
3Petroleum products, fuel, electricity2.792.80
4Foodstuffs2.093.00
5Printed products2.622.00
6Office and computer appliances3.032.41
7Medical equipment and pharmaceutical products2.152.09
Services
8Repair and maintenance services2.022.40
9Services in the fields of sanitation and environmental protection2.232.57
10Hotel, restaurant and retail services2.032.65
Source: compiled by the authors.
Table 3. Initial data for the calculation of the quoted price.
Table 3. Initial data for the calculation of the quoted price.
Criteria, Unit of MeasureImportance, %Criterion Gradations
Price, UAH80-
Guarantee period, months10More than 18 months—10%
From 6 to 18 months—5%
Less than 6 months—0%
Performance time, days10Less than 30 days—10%
From 30 to 60 days—5%
More than 60 days—0%
Source: compiled by the authors according to the (ProZorro infobox 2019).
Table 4. Obtained results of the evaluation of the quoted price under different variants of the tender offer, according to the recommended method (MEDT 2016).
Table 4. Obtained results of the evaluation of the quoted price under different variants of the tender offer, according to the recommended method (MEDT 2016).
NoVariants of Tender Offers ConditionsCorrection CoefficientQuoted Price, ths. UAH.Purchase Price, ths. UAH.
1Participant 1 submits an offer for the amount of 10,000 UAH, specifying the performance time of 30 days, the guarantee period of 18 months1.19
Calculation:
1 + (0.1 + 0.05)/0.8
8403
(10,000/1.19)
better offer
10,000
2Participant 2 submits an offer for the amount of 10,000 UAH, specifying the performance time of 60 days, the guarantee period of 6 months1.19
Calculation:
1 + (0.1 + 0.05)/0.8
8403
(10,000/1.19)
better offer
10,000
3Participant 3 submits an offer for the amount of 9000 UAH, specifying the performance time of 61 days, the guarantee period of 6 months1.06
Calculation:
1 + (0 + 0.05)/0.8
8470
(9000/1.06)
the worst offer
9000
Source: compiled by the authors.
Table 5. Evaluation of the tender offers by the comparative method.
Table 5. Evaluation of the tender offers by the comparative method.
ParticipantsParameters of Evaluation of Tender Offer, Coefficient of ImportancePoint (Maximum Point is 100)
Price, k = 80%Performance Time, k = 10%Guarantee Period, k = 10%
Price, ths. UAHPn/Pi k P n P i Calendar daysPn/Pi k P n P i MonthsPi/Pn k P i P n
110,0000.9072301.0010181.001092.00
(the best offer)
210,0000.9072600.50560.333.3080.30
(the worst offer)
390001.0080610.494.960.333.3088.20
Source: compiled by the authors.
Table 6. Estimated value method.
Table 6. Estimated value method.
Evaluation CriteriaPerformance TimeGuarantee PeriodEstimated Value
Minimal requirements60 days6 months-
The modifier of the estimated value of the tender offer−1% for 10 full days in advance−1% for increasing the guarantee period on 1 full monthreducing the estimated value on the corresponding%
Participant 1−2%−3%−5%
Participant 2---
Participant 3---
Source: compiled by the authors.
Table 7. Comparison of the results of the tender offers evaluation by different methods.
Table 7. Comparison of the results of the tender offers evaluation by different methods.
No.Variants of Tender OffersMethod of Reducing the Quoted Price, UAHComparison Method, Point (Maximum Point is 100)Estimated Value Method, UAH
1Participant 1 submits an offer for the amount of 10,000 UAH, specifying the performance time of 30 days, the guarantee period of 18 months8403
(the best offer)
92.00
(the best offer)
9500
(better offer in comparison with the other)
2Participant 2 submits an offer for the amount of 10,000 UAH, specifying the performance time of 60 days, the guarantee period of 6 months8403
(the best offer)
80.30
(the worst offer)
10,000
(the worst offer)
3Participant 3 submits an offer for the amount of 9000 UAH, specifying the performance time of 61 days, the guarantee period of 6 months8470
(the worst offer)
88.20
(better offer in comparison with the other)
9000
(the best offer)
Source: compiled by the authors.

Share and Cite

MDPI and ACS Style

Baranovsky, A.; Tkachenko, N.; Glonti, V.; Levchenko, V.; Bogatyrova, K.; Beridze, Z.; Belinskaja, L.; Zelenitsa, I. Non-Price Criteria for the Evaluation of the Tender Offers in Public Procurement of Ukraine. Int. J. Financial Stud. 2020, 8, 44. https://0-doi-org.brum.beds.ac.uk/10.3390/ijfs8030044

AMA Style

Baranovsky A, Tkachenko N, Glonti V, Levchenko V, Bogatyrova K, Beridze Z, Belinskaja L, Zelenitsa I. Non-Price Criteria for the Evaluation of the Tender Offers in Public Procurement of Ukraine. International Journal of Financial Studies. 2020; 8(3):44. https://0-doi-org.brum.beds.ac.uk/10.3390/ijfs8030044

Chicago/Turabian Style

Baranovsky, Alexander, Nataliia Tkachenko, Vladimer Glonti, Valentyna Levchenko, Kateryna Bogatyrova, Zaza Beridze, Larisa Belinskaja, and Iryna Zelenitsa. 2020. "Non-Price Criteria for the Evaluation of the Tender Offers in Public Procurement of Ukraine" International Journal of Financial Studies 8, no. 3: 44. https://0-doi-org.brum.beds.ac.uk/10.3390/ijfs8030044

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop