Research Quality Evaluation in Social Sciences: The Case of Criteria on the Conditions and Requirements for Academic Promotion in Serbia, Slovenia and Montenegro

Stevo Popovic; Sanja Pekovic; Radenko M. Matic

Stevo Popovic^1,2, Sanja Pekovic^2,3, Radenko M. Matic⁴

¹University of Montenegro, Faculty for Sport and Physical Education, Niksic, Montenegro
²Montenegrin Academy of Sciences and Arts, Center of Young Scientists, Podgorica, Montenegro
³University of Montenegro, Faculty of Tourism and Hotel Management, Kotor, Montenegro
⁴University of Novi Sad, Faculty of Sport and Physical Education, Novi Sad, Serbia

Research Quality Evaluation in Social Sciences: The Case of Criteria on the Conditions and Requirements for Academic Promotion in Serbia, Slovenia and Montenegro

Monten. J. Sports Sci. Med. 2019, 8(2), 55-62 | DOI: 10.26773/mjssm.190908

Abstract

The primary goal of the present paper is to analyse and compare the criteria on the conditions and requirements for academic promotion in three countries: Serbia, Slovenia and Montenegro. The University of Novi Sad, the University of Ljubljana, and the University of Montenegro were selected to be subjects in this study. The sources used for the analyses in this study were the official criteria on the condition and requirements for academic promotion at the abovementioned universities. The authors used a descriptive method with the consulting of competent sources and personal experiences. First, it is interesting to note that the universities in Serbia and Slovenia follow official documents at two levels: one at the national level issued by the relevant higher education council/agency and the second at the university level issued by the senate of each university, whose criteria are more strict in terms of quantitative requirements. However, this is not the case in Montenegro, where universities follow only the national criteria in the research quality evaluation. In each country, evaluation exercises usually recognize three fields, one of which is social sciences and humanities, which is concerned with an entire range of interdisciplinary and multidisciplinary scientific areas. Comparing the minimum standards for the appointment of university teachers, it is essential to highlight that Slovenian regulations are the most demanding, especially with regards to quantitative criteria, while Serbian and Montenegrin criteria are similar to each other; however, it is necessary to highlight that Montenegrin regulations contain some unusual criteria, such as the requirement that scientific research work must be achieved through one single-author paper published in an international journal for promotion to academic titles at all three levels (assistant, associate and full professor) in social sciences and humanities; however, this is not the case in other academic fields.

Keywords

evaluation, research, social, science, Yugoslavia

View full article
(PDF – 113KB)

References

Abramo, G. (2018). Revisiting the scientometric conceptualization of impact and its measurement. Journal of Informetrics, 12(3), 590–597. https://doi.org/10.1016/j.joi.2018.05.001

Abramo, G., Cicero, T., & D’Angelo, C. A. (2012). The dispersion of research performance within and between universities as a potential indicator of the competitive intensity in higher education systems. Journal of Informetrics, 6(2), 155–168. https://doi.org/10.1016/j.joi.2011.11.007

Abramo, G., D’Angelo, C. A., & Rosati, F. (2015). The determinants of academic career advancement: evidence from Italy. Science and Public Policy, 42(6), 761–774. https://doi.org/10.1093/scipol/scu086

Abramo, G., D’Angelo, C.A. & Reale, E. (2019). Peer review versus bibliometrics: Which method better predicts the scholarly impact of publications? Scientometrics, 1-18. https://doi.org/10.1007/s11192-019-03184-y

Academic Ranking of World Universities. (2019). Shanghai, Shanghai Ranking Consultancy. Reached on 10.2.2019 from website: http://www.shanghairanking.com/ARWU2018.html.

Aksnes, D. W., & Taxt, R. E. (2004). Peer reviews and bibliometric indicators: A comparative study at Norvegian University. Research Evaluation, 13(1), 33–41. https://doi.org/10.3152/147154404781776563

Chandler, V. (2019). Identifying emerging scholars: seeing through the crystal ball of scholarship selection committees. Scientometrics, 120(1), 39–56. https://doi.org/10.1007/s11192-019-03120-0

Criteria for Appointment to the Titles of University Teacher, Researcher and Associate at the University of Ljubljana. (2011). Ljubljana, University of Ljubljana. Reached on 25.10.2011 from website: https://www.uni-lj.si/university/organization_legal_framework_and_reports/statutes_of_ul_and_regulations/2014010714215361/

Criteria on the Conditions and Requirements for Promotion to Academic Titles. (2016). Podgorica, Council of Higher Education. Reached on 16.6.2017 from website: https://www.ucg.ac.me/objava/blog/6/objava/3745-savjet-za-visoko-obrazovanje-09-09-2016-mjerila-o-uslovima-i-kriterijumima-za-izbor-u-akademska-zvanja

Elango, B., Kozak, M. & Rajendran, P. (2019). Analysis of retractions in Indian science. Scientometrics, 119(2), 1081–1094. https://doi.org/10.1007/s11192-019-03079-y

Harzing, A. W., & Alakangas, S. (2016). Google Scholar, Scopus and the Web of Science: A longitudinal and cross-disciplinary comparison. Scientometrics, 106(2), 787–804. https://doi.org/10.1007/s11192-015-1798-9

Harzing, A.W. (2019). Two new kids on the block: How do Crossref and Dimensions compare with Google Scholar, Microsoft Academic, Scopus and the Web of Science? Scientometrics, 120(1), 341–349. https://doi.org/10.1007/s11192-019-03114-y

Jokic, M., Mervar, A. & Mateljan, S. (2019). Comparative analysis of book citations in social science journals by Central and Eastern European authors. Scientometrics, 1-25. https://doi.org/10.1007/s11192-019-03176-y

Lohr, K.N. (2004). Rating the strength of scientific evidence: Relevance for quality improvement programs. International Journal for Quality in Health Care, 16(1), 9–18. https://doi.org/10.1093/intqhc/mzh005

Minimum Standards for the Appointment of Higher Education Teachers, Researchers and Faculty Assistants at Higher Education Institutions. (2010). Ljubljana, Slovenian Quality Assurance Agency for Higher Education. Reached on 18.11.2010 from website: https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&cad=rja&uact=8&ved=2ahUKEwjfgMP_1a7jAhVOR5oKHYwnBv0QFjAJegQIABAC&url=http%3A%2F%2Ftest.nakvis.si%2Fsl-SI%2FContent%2FGetFile%2F130&usg=AOvVaw0ChOB3W7LP0qq1iGnRGbsu

Minimum standards for the appointment of university teachers at University of Novi Sad. (2018). Novi Sad, University of Novi Sad. Reached on 9.10.2018 from website: https://www.elektronika.ftn.uns.ac.rs/wp-content/uploads/2019/04/UNS_Pravilnik_izbor_u_zvanja_2018.pdf

Minimum standards for the appointment of university teachers. (2016). Belgrade, National Council for Higher Education of the Republic of Serbia. Reached on 24.10.2016 from website: https://www.ucg.ac.me/objava/blog/6/objava/3745-savjet-za-visoko-obrazovanje-09-09-2016-mjerila-o-uslovima-i-kriterijumima-za-izbor-u-akademska-zvanja

Moed, H.F., Burger, W.J.M., Frankfort, J.G., & Van Raan, A.F.J. (1985). The application of bibliometric indicators: Important field- and time-dependent factors to be considered. Scientometrics, 8(3-4), 177–203. https://doi.org/10.1007/BF02016935

Narin, F., & Hamilton, K.S. (1996). Bibliometric performance measures. Scientometrics, 36, 293–310. https://doi.org/10.1007/BF02129596

Peruginelli, G., & Faro, S. (2018). Research Quality Evaluation: The Case of Legal Studies. In A. Bonaccorsi (Ed.), The Evaluation of Research in Social Sciences and Humanities (pp. 103-129). Trento: Springer International Publishing AG.

Popovic, S. (2018). Research and Writing Development in the Area of Sport Science Publishing in Montenegro. Sport Mont, 16(3), 31-36. https://doi.org/10.26773/smj.181006

Shanghai Ranking’s Global Ranking of Sport Science Schools and Departments. (2019). Shanghai, Shanghai Ranking Consultancy. Reached on 10.2.2019 from website: http://www.shanghairanking.com/Special-Focus-Institution-Ranking/Sport-Science-Schools-and-Departments-2018.html#.

Singleton, R.A., Straits, B.C., & Straits, M.M. (1993). Approaches to social research. New York: Oxford University Press.

Taubes, G. (1993). Measure for measure in science. Science, 260, 884–886. https://doi.org/10.1126/science.8493516

Thelwall, M. (2018). Microsoft Academic automatic document searches: Accuracy for journal articles and suitability for citation analysis. Journal of Informetrics, 12(1), 1–9. https://doi.org/10.1016/j.joi.2017.11.001

University of Ljubljana. (2019). Ljubljana, University of Ljubljana. Reached on 23.1.2019 from website: https://www.uni-lj.si

University of Montenegro. (2019). Podgorica, University of Montenegro. Reached on 23.1.2019 from website: http://www.ucg.ac.me

University of Novi Sad. (2019). Novi Sad, University of Novi Sad. Reached on 23.1.2019 from website: http://www.uns.ac.rs

Vieira, E.S., Cabral, J.A.S., & Gomes, J.A.N.F. (2014). Definition of a model based on bibliometric indicators for assessing applicants to academic positions. Journal of the Association for Information Science and Technology, 65(3), 560–577. https://doi.org/10.1002/asi.22981

Zuccala, A. (2018). Language, Culture and Traversing the Scholarly Evaluation Landscape. In A. Bonaccorsi (Ed.), The Evaluation of Research in Social Sciences and Humanities (pp. 395-411). Trento: Springer International Publishing AG.