Does a Country/Region’s Economic Status Affect Its Universities’ Presence in International Rankings?

doi:10.2478/jdis-2019-0009

Abstract

Abstract:

Purpose: Study how economic parameters affect positions in the Academic Ranking of World Universities’ top 500 published by the Shanghai Jiao Tong University Graduate School of Education in countries/regions with listed higher education institutions.

Design/methodology/approach: The methodology used capitalises on the multi-variate characteristics of the data analysed. The multi-colinearity problem posed is solved by running principal components prior to regression analysis, using both classical (OLS) and robust (Huber and Tukey) methods.

Findings: Our results revealed that countries/regions with long ranking traditions are highly competitive. Findings also showed that some countries/regions such as Germany, United Kingdom, Canada, and Italy, had a larger number of universities in the top positions than predicted by the regression model. In contrast, for Japan, a country where social and economic performance is high, the number of ARWU universities projected by the model was much larger than the actual figure. In much the same vein, countries/regions that invest heavily in education, such as Japan and Denmark, had lower than expected results.

Research limitations: Using data from only one ranking is a limitation of this study, but the methodology used could be useful to other global rankings.

Practical implications: The results provide good insights for policy makers. They indicate the existence of a relationship between research output and the number of universities per million inhabitants. Countries/regions, which have historically prioritised higher education, exhibited highest values for indicators that compose the rankings methodology; furthermore, minimum increase in welfare indicators could exhibited significant rises in the presence of their universities on the rankings.

Originality/value: This study is well defined and the result answers important questions about characteristics of countries/regions and their higher education system.

Key words: Academic Ranking of World Universities, Socio-economic indicators, Regression analysis

Esteban Fernández Tuesta,Esteban Fernández Tuesta,Carlos Garcia-Zorita,Carlos Garcia-Zorita,Rosario Romera Ayllon,Rosario Romera Ayllon,Elías Sanz-Casado,Elías Sanz-Casado. "Does a Country/Region’s Economic Status Affect Its Universities’ Presence in International Rankings?." Journal of Data and Information Science, vol.4, no.2, 2019, pp.56-78. DOI: 10.2478/jdis-2019-0009

References

[1]	Aguillo I. F., Bar-Ilan J., Levene M., & Ortega J. L. (2010). Comparing university rankings. Scientometrics, 85(1), 243-256. doi:10.1007/s11192-010-0190-z
[2]	Azman N., &Kutty, F.M. (2016). Impossing global university rankings on local academic culture. Insights from the National University of Malaysia. The global academic rankings game: changing institutional policy, practice and academic life. p.97-123. Edited by Yudkevich, M., Altbach, P.G. and Rumbley, L.E. New York, NY: Routledge 2016.
[3]	Bar-Ilan J., Levene M., & Lin A. (2007). Some measures for comparing citation databases. Journal of Informetrics, 1(1), 26-34. doi:10.1016/j.joi.2006.08.001
[4]	Barra C., Lagravinese R., & Zotti R. (2018). Does econometric methodology matter to rank universities? An analysis of Italian higher education system. Socio-Economic Planning Sciences, 62(2018), 104-120.
[5]	Billaut J.C., Bouyssou D. &Vincke ,P. (2010). Should you believe in the Shanghai ranking? An MCDM view. Scientometrics, 84(1), 237-263. doi: 10.1007/s11192-009-0115-x
[6]	Bornmann L., &Moya-Anegón ,F. (2011). Some interesting insights from aggregated data published in the World Report SIR 2010. Journal of Informetrics, 5(3), 486-488. doi:10.1016/j.joi.2011.03.005
[7]	Bornmann L., Mutz R., & Daniel H. D. (2013). Multilevel-statistical reformulation of citation-based university rankings: The Leiden ranking 2011/2012. Journal of the American Society for Information Science and Technology, 64(8), 1649-1658. doi:10.1002/asi.22857
[8]	Buela-Casal G., Gutiérrez-Martínez O., Bermúdez-Sánchez M. P., & Vadillo-Mu?oz O. (2007). Comparative study of international academic rankings of universities. Scientometrics, 71(3), 349-365. doi:10.1007/s11192-007-1653-8
[9]	Cheng Y., &Liu, N .C. (2007). Academic ranking of world universities by broad subject fields. Higher Education in Europe, 32(1), 17-29. doi:10.1080/03797720701618849
[10]	Dobrota M., Bulajic., Bornmann M. L. and Jeremic V. (2016). Journal of the Association for Information Science and Technology. V 67, N.1 p 200-211.
[11]	Docampo D. (2008). Rankings internacionales y calidad de los sistemas universitarios. Revista de Educación, (1), 149-176.
[12]	Docampo D. (2011). On using the Shanghai ranking to assess the research performance of university systems. Scientometrics, 86(1), 77-92. doi:10.1007/s11192-010-0280-y
[13]	Docampo D.(2012). Adjusted sum of institutional scores as an indicator of the presence of university systems in the ARWU ranking. Scientometrics, 90(2), 701-713. doi:10.1007/s11192-011-0490-y
[14]	Docampo D. (2013). Reproducibility of the Shanghai academic ranking of world universities results. Scientometrics, 94(2), 567-587. doi:10.1007/s11192-012-0801-y
[15]	Guironnet J.P. &Peypoch ,N. (2018). The geographical efficiency of education and research: The ranking of U.S. universities. Socio-Economic Planning Sciences 62(2018), 44-55.
[16]	Johnes J., &Yu , L. (2008). Measuring the research performance of Chinese higher education institutions using data envelopment analysis. China Economic Review, 19(4), 679-696. doi:10.1016/j.chieco.2008.08.004
[17]	Kaiser H.F. (1991). Coefficient alpha for a principal component and the Kaiser-guttman rule. Psychological Reports, 68(3), 855-858. doi:10.2466/pr0.1991.68.3.855
[18]	Kauppi Niilo (2018) The global ranking game: Narrowing academic excellence through numerical objectification, Studies in Higher Education, 43(10), 1750-1762. doi: 10.1080/03075079.2018.1520416
[19]	Kempkes G., &Pohl ,C. (2010). The efficiency of German universities-some evidence from nonparametric and parametric methods. Applied Economics, 42(16), 2063-2079. doi:10.1080/00036840701765361
[20]	Kutner M. H., Nachtsheim C. J., Neter J., & Li W. (2005). Applied linear statistical models (4th ed.).
[21]	Liang , K.Y., &Zeger S. L. (1993). Regression analysis for correlated data. Annual Review of Public Health, 14(1), 43-68. doi:10.1146/annurev.pu.14.050193.000355
[22]	Lim, M. A., &?erberg , J.W. (2017) Active instruments:On the use of university rankings in developing national systems of higher education. Policy Reviews in Higher Education, 1(1), 91-108. doi: 10.1080/23322969.2016.1236351
[23]	Liu N. C., Cheng Y., & Liu L. (2005). Academic ranking of world universities using scientometrics—A comment to the “Fatal Attraction.” Scientometrics, 64(1), 101-109. doi:10.1007/s11192-005-0241-z
[24]	Liu, N. C., &Cheng Y. (2005). The academic ranking of world universities. Higher Education in Europe, 30(2), 127-136. doi:10.1080/03797720500260116
[25]	Marginson S.(2007). Global university rankings: Implications in general and for Australia. Journal of Higher Education Policy and Management, 29(2), 131-142. doi:10.1080/13600800701351660
[26]	Marginson S., & van der Wende, M. (2007). To rank or to be ranked: The impact of global rankings in higher education. Journal of Studies in International Education, 11(3-4), 306-329. doi:10.1177/1028315307303544
[27]	Millot B. (2015). International rankings: Universities vs. higher education systems. International Journal of Educational Development, 40, 156-165.
[28]	Musselin C. (2018). New forms of competition in higher education. Socio-Economic Review, 16(3), 657-683. doi: 10.1093/ser/mwy033
[29]	Neter J., Kutner M. H., Nachtsheim C. J., & Wasserman W. (1996). Applied linear statistical models (Vol. 4). Irwin Chicago.
[30]	Ordorika I., &Lloyd , M.(2015) International rankings and the contest for university hegemony. Journal of Education Policy, 30(3), 385-405. doi:10.1080/02680939.2014.979247
[31]	Pe?a Sánchez de Rivera,D. (2002). Análisis de datos multivariantes. Madrid [etc.] McGraw-Hill.
[32]	Rhaiem M. (2017). Measurement and determinants of academic research efficiency: A systematic review of the evidence. Scientometrics 110(2), 581-615. Retrieved from
[33]	Rousseeuw P.J., &Leroy A.M. (2003). Robust regression and outlier detection. Hoboken, NJ:Wiley-Interscience.
[34]	Safón V.(2013). What do global university rankings really measure? The search for the X factor and the X entity. Scientometrics, 97(2), 223-244. doi:10.1007/s11192-013-0986-8
[35]	Shin J.C., &Toutkoushian R.K. (2011). The past, present, and future of university rankings. In J. C. Shin, R. K. Toutkoushian, & U. Teichler (Eds.), University Rankings (pp. 1-16). Dordrecht: Springer Netherlands. Retrieved from
[36]	Van Raan, A. F. J. (2005). Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods. Scientometrics, 62(1), 133-143. doi:10.1007/s11192-005-0008-6
[37]	Van Vught, F. A., &Ziegele, F.(2012a). Concluding Remarks. In F. A. van Vught & F. Ziegele (Eds.), Multidimensional Ranking (Vol. 37, pp. 179-189). Dordrecht: Springer Netherlands. Retrieved from
[38]	Van Vught F.A.,&Ziegele F. (Eds.). (2012b). Multidimensional Ranking (Vol. 37). Dordrecht: Springer Netherlands. Retrieved from
[39]	Verardi V. &Croux C.(2009). Robust regression in stata. The Stata Journal, 9(3), 439-453.
[40]	Waltman L., Calero-Medina C., Kosten J., Noyons E.C.M., Tijssen R.J.W., Van Eck N.J., Van Leeuwen T.N., Van Raan A.F.J., Visser M.S., & Wouters P. (2012). The Leiden ranking 2011/2012: Data collection, indicators, and interpretation. Journal of the American Society for Information Science and Technology, 63(12), 2419-2432. doi:10.1002/asi.22708
[41]	Zhang L., Bao W. & Sun, L.(2016). Resources and research production in higher education: A longitudinal analysis of Chinese universities, 2000-2010. Research in Higher Education, 57(7), 869-891.