Evaluating the efficiency of regional innovation systems in Europe: DEA approach
DOI:
https://doi.org/10.15584/nsawg.2025.1.8Keywords:
regional innovation systems, efficiency, Europe, DEAAbstract
For many years, regional innovation systems in Europe have been studied and compared against each other within the framework of the Regional Innovation Scoreboard. However, it has a number of drawbacks, e.g. the combined input-output approach, which does not respond to societal expectations, as in this era of all-round economisation, it is the outputs of the activity that are more important than the potential contained in the inputs. Therefore, in our study we focused on an approach aimed at maximising the outputs achieved by regional innovation systems. The results of the study indicated that, even taking into account negative environmental outcomes, the vast majority of regional innovation systems show efficiency. We have shown that although the regional innovation systems group studied is highly efficient, our research indicates that in the long term, the narrow classification into four innovation groups according to the Regional Innovation Scoreboard methodology is increasingly less useful, as there is a reduction in the number of groups as a result of the ‘shift’ of units to three main ones. We also provided recommendations for EU regional innovation policy on the Regional Innovation Scoreboard tool. Our recommendation is to introduce more differentiated variables into the European survey and to focus more on evaluating the innovation system from the perspective of the results obtained and less on an input approach.
Downloads
References
Ajmone, M.G., Maguire, K. (2011). Categorisation of OECD Regions Using Innovation-Related Variables. OECD Regional Development Working Papers, 03, 1–50. DOI: 10.1787/5kg8bf42qv7k-en.
Alarcón-Martínez, J.E., Güemes-Castorena, D., Flegl, M. (2023). Comparative Analysis of Innovation Districts to Set Up Performance Goals for Tec Innovation District. Quality Innovation Prosperity, 27(2), 158–176. DOI: 10.12776/qip.v27i2.1873.
Almeida, M., Porto-Gómez, I., Leydesdorff, L. (2023). Are Brazilian innovation systems innovative? Regional and sectorial decompositions of triple-helix synergies. Profesional De La información, 32(7), 1–12. DOI: 10.3145/epi.2023.dic.07.
Aristovnik, A. (2014). Efficiency of the R&D Sector in the EU-27 at the Regional Level: An Application of DEA. Lex Localis, 12(3), 519–531. DOI: 10.4335/12.3.519- 531(2014).
Banker, R.D., Charnes, A., Cooper, W.W. (1984). Some models for estimating technical and scale inefficiencies in Data Envelopment Analysis. Management Science, 30, 1078–1092. DOI: 10.1287/mnsc.30.9.1078.
Bianchini, S., Damioli, G., Ghisetti, C. (2023). The environmental effects of the “twin” green and digital transition in European regions. Environmental and Resource Economics, 84(4), 877–918. DOI: 10.1007/s10640-022-00741-7.
Broekel, T., Rogge, N., Brenner, T. (2018). The innovation efficiency of German regions – a shared-input DEA approach. Review of Regional Research, 38(1), 77–109. DOI: 10.1007/s10037-017-0112-0.
Brzezicki, Ł. (2024). The efficiency and productivity of regional innovation systems: a review of studies using DEA and the Malmquist index. Working Paper, 5, 1–8. DOI: 10.13140/RG.2.2.36779.45609.
Brzezicki, Ł., Prędki, A. (2023). An Estimation of the Efficiency of Public Research Institutes in Poland – DEA Approach. Zeszyty Naukowe Uniwersytetu Ekonomicznego w Krakowie/Cracow Review of Economics and Management, 2, 33–50. DOI: 10.15678/ZNUEK.2023.1000.0202.
Cano, L.F.G., Sossa, J.W.Z., Mendoza, G.L.O., Guzmán, L.M.S., Tapasco, D.A.A., Saavedra, J.I.Q. (2023). Agricultural innovation system: analysis from the subsystems of R& D, training, extension, and sustainability. Frontiers in Sustainable Food Systems, 7, 1–17. DOI: 10.3389/fsufs.2023.1176366.
Cao, X.Y., Wu, X.L., Wang, L.M. (2023). Innovation network structure, government R&D investment and regional innovation efficiency: Evidence from China. PLOS ONE, 18(5), 1–20. DOI: 10.1371/journal.pone.0286096.
Carayannis, E.G., Goletsis, Y., Grigoroudis, E. (2015). Multi-level multi-stage efficiency measurement: the case of innovation systems. Operational Research, 15(2), 253–274. DOI: 10.1007/s12351-015-0176-y.
Carayannis, E.G., Campbell, D.F.J. (2009). ‘Mode 3’ and ‘Quadruple Helix’: Toward a 21st century fractal innovation ecosystem. International Journal of technology and Management, 46(3/4), 201–234. DOI: 10.1504/IJTM.2009.023374.
Carayannis, E.G., Barth, T.D., Campbell, D.F. (2012). The Quintuple Helix innovation model: global warming as a challenge and driver for innovation. Journal of Innovation and Entrepreneurship, 1(1), 1–12. DOI: 10.1186/2192-5372-1-2.
Cario, S., Burger, R., Lemos, D., Bittencourt, P. (2023). Adaptive Regional Innovation Systems: Addressing Latin America’s Challenges. Journal of Technology Management & Innovation, 18(4), 44–58. DOI: 10.4067/S0718-27242023000400044.
Charnes, A., Cooper, W.W., Rhodes, E. (1978). Measuring the Efficiency of Decision-making Units. European Journal of Operational Research, 2, 429–444. DOI: 10.1016/0377- 2217(78)90138-8.
Chen, K., Guan, J. (2012). Measuring the Efficiency of China’s Regional Innovation Systems: Application of Network Data Envelopment Analysis (DEA). Regional Studies, 46(3), 355–377. DOI: 10.1080/00343404.2010.497479.
Ciołek, D., Golejewska, A. (2022). Efficiency Determinants of Regional Innovation Systems in Polish Subregions. Gospodarka Narodowa. The Polish Journal of Economics, 311(3), 24–45. DOI: 10.33119/GN/151792.
Cooper, W.W., Seiford, L.M., Tone, K. (2007). Data Envelopment Analysis. A Comprehensive Text with Models, Applications, References and DEA-Solver Software. New York: Springer.
Czyżewska-Misztal, D., Golejewska, A. (2016). The least innovative regions in Poland in the process of smart specialization. Optimum. Studia Ekonomiczne, 5(83), 123–137. DOI: 10.15290/ose.2016.05.83.08.
Doloreux, D., Parto, S. (2005). Regional innovation system: Current discourse and unresolved issues. Technology in Society, 27(2), 133–153. DOI: 10.1016/j.techsoc.2005.01.002.
Dusdal, J., Powell, J.J.W., Baker, D.P., Fu, Y.C., Shamekhi, Y., Stock, M. (2020). University vs. Research Institute? The Dual Pillars of German Science Production, 1950–2010. Minerva, 58, 319–342. DOI: 10.1007/s11024-019-09393-2.
Dzemydaitė, G., Dzemyda, I., Galinienė, B. (2016). The Efficiency of Regional Innovation Systems in New Member States of the European Union: A Nonparametric DEA Approach. Economics and Business, 28(1), 83–89. DOI: 10.1515/eb-2016-0012.
Emrouznejad, A., Brzezicki, Ł., Lu, C. (2025). The Development and Evolution of Slacks- Based Measure Models in Data Envelopment Analysis: A Comprehensive Review of the Literature. Journal of Economic Surveys, 2025, 1–28. DOI: 10.1111/joes.12682.
Etzkowitz, H., Leydersorff, L. (1996). Emergence of a triple helix of university-industry-government relations. Science and Public Policy, 23(5), 279–286. DOI: 10.1093/spp/23.5.279.
European Commission. (2022a). European Innovation Scoreboard 2022 and Regional Innovation Scoreboard 2021. RIS interactive tool. Retrieved from: https://ec.europa.eu/research-and-innovation/en/statistics/performance-indicators/european-innovation-scoreboard/eis (2025.01.26).
European Commission. (2022b). The New European Innovation Agenda. Retrieved from: https://research-and-innovation.ec.europa.eu/strategy/support-policy-making/shaping-eu-research-and-innovation-policy/new-european-innovation-agenda_en (2025.01.26).
European Commission. (2024). Cambridge Econometrics and Directorate-General for Research and Innovation, EU eco-innovation index 2024. Publications Office of the European Union. Retrieved from: https://data.europa.eu/doi/10.2777/4878812 (2025.01.26).
European Innovation Council and SMEs Executive Agency. (2023). European Innovation Ecosystems. Retrieved April 7, 2025. Retrieved from: https://eismea.ec.europa.eu/programmes/european-innovation-ecosystems_en (2025.01.26).
Fischer, M.M., Revilla Diez, J., Snicars, F. (2001). Metropolitan Innovation Systems: Theory and Evidence from three Metropolitan Regions in Europe. Berlin-Heidelberg: Springer.
Foddi, M., Usai, S. (2013). Regional Knowledge Performance in Europe. Growth and Change, 44(2), 258–286. DOI: 10.1111/grow.12007.
Freeman, Ch. (1987). Technology Policy and Economic Performance: Lessons from Japan. London-New York: Pinter.
Granstrand, O., Holgersson, M. (2020). Innovation ecosystems: A conceptual review and a new definition. Technovation, 90–91, 102098. DOI: 10.1016/j.technovation.2019.102098.
Hajdukiewicz, A., Pera, B. (2023). Eco-innovation in the European Union: Challenges for catching-up economies. Entrepreneurial Business and Economics Review, 11(1), 145–164. DOI: 10.15678/EBER.2023.110108.
Han, U., Asmild, M., Kunc, M. (2016). Regional R&D Efficiency in Korea from Static and Dynamic Perspectives. Regional Studies, 50(7), 1170–1184. DOI: 10.1080/ 00343404.2014.984670.
Howells, J. (1999). Regional systems of innovation? In: D. Archibugi, J. Howells, J. Michie (eds.), Innovation Policy in a Global Economy (pp. 67–93). Cambridge: Cambridge University Press.
Johnes, G., Tone, K. (2017). The efficiency of Higher Education Institutions in England revisited: comparing alternative measures. Tertiary Education and Management, 23, 191–205. DOI: 10.1080/13583883.2016.1203457.
Kaihua, C., Mingting, K. (2014). Staged efficiency and its determinants of regional innovation systems: a two-step analytical procedure. The Annals of Regional Science, 52, 627–657. DOI: 10.1007/s00168-014-0604-6.
Łącka, I., Brzezicki, Ł. (2021). The Efficiency and Productivity Evaluation of National Innovation Systems in Europe. European Research Studies Journal, 24(3), 471–496. DOI: 10.35808/ersj/2440.
Łącka, I., Brzezicki, Ł. (2022). Joint analysis of national eco-efficiency, eco-innovation and SDGS in Europe: DEA approach. Technological and Economic Development of Economy, 28(6), 1739–1767. DOI: 10.3846/tede.2022.17702.
Łącka, I., Brzezicki, Ł. (2023). The efficiency of scientific activities and technology transfer in higher education in Poland. Nierówności Społeczne a Wzrost Gospodarczy/Social Inequalities and Economic Growth, 75, 62–89. DOI: 10.15584/nsawg.2023.3.4.
Lopes, J., Farinha, L., Ferreira, J.J. (2020). Regional Innovation Ecosystems and Smart Specialization: Opportunities and Challenges for Regions. Revista Brasileira de Gestão e Desenvolvimento Regional, 16(1), 114–135.
López-Rubio, P., Roig-Tierno, N., Mas-Tur, A. (2020). Regional innovation system research trends: toward knowledge management and entrepreneurial ecosystems. International Journal of Quality Innovation, 6(1), 1–16. DOI: 10.1186/s40887-020-00038-x.
Lundvall, B.A. (ed.). (1992). National Systems of Innovations. London: Pinter.
Malik, A., Sharma, P., Pereira, V., Temouri, Y. (2021). From regional innovation systems to global innovation hubs: Evidence of a Quadruple Helix from an emerging economy. Journal of Business Research, 128, 587–598. DOI: 10.1016/j.busres.2020.12.009.
Miranda Junior, N.da S., Viana, L.F.C., Carneiro, D.K.de O., Filgueiras, R.C., Goulart, G.da S. (2022). Initial actions of the Brazilian regional innovation ecosystem against the COVID-19 pandemic. International Journal of Innovation, 10(2), 291–318. DOI: 10.5585/iji.v10i2.21576.
Pan, X., Li, J., Shen, Z., Song, M. (2023). Life cycle identification of China’s regional innovation systems based on entropy weight disturbing attribute model. Habitat International, 131, 102725. DOI: 10.1016/j.habitatint.2022.102725.
Patel, P., Pavitt, K. (1994). The Nature and Economic Importance of National Innovation Systems. STI Review, 14, 9–32.
Rong, K., Lin, Y., Yu, J., Zhang, Y., Radziwon, A. (2020). Exploring regional innovation ecosystems: an empirical study in China. Industry and Innovation, 28(5), 545–569. DOI: 10.1080/13662716.2020.1830042.
Ribeiro, V.M., Varum, C., Daniel, A.D. (2023). On the Performance of Regional Innovation Systems. In: F. Teles, C. Rodrigues, F. Ramos, A. Botelho (eds.), Territorial Innovation in Less Developed Regions: Governance, Technologies, and Sustainability (pp. 31–75). Cham: Palgrave Macmillan.
Santos, A.M., Haegeman, K., Moncada-Paternò-Castello, P. (2021). The impact of Covid-19 and of the earlier crisis on firms’ innovation and growth: a comparative analysis. JRC Working Papers on Territorial Modelling and Analysis, 3, 1–38.
Singh, L., Joseph, K.J. (eds.). (2024). Reimagining Innovation Systems in the COVID and Post-COVID World. London: Routledge.
Stergiou, E., Kounetas, K., Tsekouras, K. (2024). Innovation Efficiency, Productive Performance and Undesirable Outputs across European Regions: Are there any missing links? Journal of Environmental Management, 367, 122053. DOI: 10.1016/j.jenvman.2024.122053.
Stojčić, N. (2021). Collaborative innovation in emerging innovation systems: Evidence from Central and Eastern Europe. The Journal of Technology Transfer, 46(2), 531–562. DOI: 10.1007/s10961-020-09792-8.
Teirlinck, P., Khoshnevis, P. (2022). SME efficiency in transforming regional business research and innovation investments into innovative sales output. Regional Studies, 56(12), 2147–2163. DOI: 10.1080/00343404.2022.2046263.
Teirlinck, P., Spithoven, A. (2023). Improving the Regional Innovation Scoreboard for policy: how about innovation efficiency? Science and Public Policy, 50(6), 1001–1017. DOI: 10.1093/scipol/scad043.
Theeranattapong, T., Pickernell, D., Simms, C. (2021). Systematic literature review paper: the regional innovation system-university-science park nexus. The Journal of Technology Transfer, 46, 2017–2050. DOI: 10.1007/s10961-020-09837-y.
Tone, K. (2001). A slacks based measure of efficiency in data envelopment analysis. European Journal of Operational Research, 130(3), 498–509. DOI: 10.1016/S0377-2217(99)00407-5.
Tone, K. (2002). A slacks-based measure of super-efficiency in data envelopment analysis. European Journal of Operational Research, 143(1), 32–41. DOI: 10.1016/S0377-2217(01)00324-1.
Vechkinzova, Y., Petrenko, Y., Benčič, S., Ulybyshev, D., Zhailauov, Y. (2019). Evaluation of regional innovation systems performance using Data Envelopment Analysis (DEA). Entrepreneurship and Sustainability Issues, 7(1), 498–509. DOI: 10.9770/jesi.2019.7.1(35).
Wang, Q., Zhang, Q. (2022). Measuring regional innovation efficiency in China using a dynamic network DEA model. The Economics and Finance Letters, 9(2), 244–256. DOI: 10.18488/29.v9i2.317.
Wang, Y., Sutherland, D., Ning, L., Pan, X. (2015). The evolving nature of China’s regional innovation systems: Insights from an exploration–exploitation approach. Technological Forecasting and Social Change, 100, 140–152. DOI: 10.1016/j.techfore.2015.07.010.
Weresa, M. (2012). Systemy innowacyjne we współczesnej gospodarce światowej. Warszawa: Wydawnictwo Naukowe PWN.
Wiig, H., Wood, M. (1995). What Comprises a Regional Innovation System? An Empirical Study, STEP rapport, R-01, Oslo 1995. Retrieved from: https://nifu.brage.unit.no/nifu-xmlui/bitstream/handle/11250/226793/STEPrapport1-1995.pdf?sequence=1 (2025.01.26).
Xu, K., Bossink, B., Chen, Q. (2019). Efficiency Evaluation of Regional Sustainable Innovation in China: A Slack-Based Measure (SBM) Model with Undesirable Outputs. Sustainability, 12(1), 31, 1–23. DOI: 10.3390/su12010031.
Xu, K., Loh, L., Chen, Q. (2020). Sustainable Innovation Governance: An Analysis of Regional Innovation with a Super Efficiency Slack-Based Measure Model. Sustainability, 12(7), 3008, 1–19. DOI: 10.3390/su12073008.
Xu, K., Loh, L., Liang, L., Mei, R. (2023b). Heterogeneous effects of influencing factors on innovation performance: evidence from European Union countries. Technology Analysis & Strategic Management, 36(10), 2817–2832. DOI: 10.1080/09537325.2022.2163889.
Xu, K., Mei, R., Sun, W., Zhang, H., Liang, L. (2023a). Estimation of sustainable innovation performance in European Union countries: Based on the perspective of energy and environmental constraints. Energy Reports, 9, 1919–1925. DOI: 10.1016/j. egyr.2023.01.010.
You, Z., Teirlinck, P. (2024). Heterogeneous influences of specialization and diversification on regional R&D performance: a China, Europe, and US comparison. Science and Public Policy, 51(6), 1169–1184. DOI: 10.1093/scipol/scae059.
Zabala-Iturriagagoitia, J.M., Voigt, P., Gutiérrez-Gracia, A., Jiménez-Sáez, F. (2007). Regional Innovation Systems: How to Assess Performance. Regional Studies, 41(5), 661–672. DOI: 10.1080/00343400601120270.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 University of Rzeszow
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
