Assessing the maturity of a research area: bibliometric review and proposed framework
- 1k Downloads
In recent years, many disciplines have begun to adopt more systematic and standardized approaches to evaluate the impact and development of a research area with a stronger emphasis on quantitative techniques. In particular, identifying and analyzing the published literature have become important exercises for many disciplines and methods such as systematic literature review and bibliometric analysis have become more regularly used to obtain a deeper understanding of a research area. One concept that is of particular interest is the maturity, or level of development, of a research area. While this concept has been mentioned in many works, it has not yet been formalized, resulting in a lack of consensus concerning the definition of research area maturity and analysis techniques to assess maturity. Therefore, most assessments of research area maturity consider only a subset of the possible criteria with significant differences in the metrics and analyses used among different disciplines. Due to the inconsistencies in the definition and assessment of this concept, a comprehensive synthesis of this literature area is needed. This paper presents the results of a study to identify and analyze the literature, define the maturity of a research area, and synthesize the criteria for assessing maturity. The results are used to develop a generalized maturity assessment framework that establishes a comprehensive set of criteria, which can be adapted for use across a variety of research areas.
KeywordsResearch area Maturity Systematic literature review Conceptual framework Bibliometric analysis
- Archambault, É., & Larivière, V. (2010). The limits of bibliometrics for the analysis of the social sciences and humanities literature. World Social Science Report, 251–254.Google Scholar
- Becheikh, N. (2010). How to improve knowledge transfer strategies and practices in education? Answers from a systematic literature review. Research in Higher Education Journal, 7, 1–21.Google Scholar
- Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. doi: 10.1002/9780470743386.
- Brookes, B. C. (1990). Biblio-, sciento-, infor-metrics? What are we talking about? In L. Egghe, & R. Rousseau (Eds.), Informetrics 89/90 (pp. 31–43). Diepenbeek.Google Scholar
- Campbell Resource Center. (n.d.). Retrieved January 23, 2015, from http://www.campbellcollaboration.org/resources/resource_center.php.
- Carlile, P. R., & Christensen, C. M. (2004). The cycles of theory building in management research, version 5.0, Harvard Business School Working Knowledge. http://www.hbs.edu/rcscarch/pdf/05-057.pdf. Accessed 21 March 2011.
- Cobo, M. J., López-Herrera, A. G., Herrera-Viedma, E., & Herrera, F. (2011). An approach for detecting, quantifying, and visualizing the evolution of a research field: A practical application to the fuzzy sets theory field. Journal of Informetrics, 5(1), 146–166. doi: 10.1016/j.joi.2010.10.002.CrossRefzbMATHGoogle Scholar
- Cooper, H., & Hedges, L. V. (2009). Research synthesis as a scientific process. In The handbook of research synthesis and meta-analysis (pp. 3–17). Retrieved from http://books.google.com/books?hl=en&lr=&id=LUGd6B9eyc4C&oi=fnd&pg=PA3&dq=RESEARCH+SYNTHESIS+AS+A+SCIENTIFIC+PROCESS&ots=5MEJyT_n6P&sig=QS5-Jcd7-Wzvo8pxzZD0ktb33SM.
- Cooper, H., Hedges, L., & Valentine, J. (2009). The handbook of research synthesis and meta-analysis. Psychological Review April 2006 (Vol. 113).Google Scholar
- Higgins, J., & Green, S. (Eds.). (2011). Chapter 4: Guide to the contents of a Cochrane protocol and review. Cochrane handbook for systematic reviews of interventions. The Cochrane Collaboration. doi: 10.1002/9780470712184.
- Karuga, G., Lowry, P., & Richardson, V. (2007). Assessing the impact of premier information systems research over time. Communications of the Association for Information Systems, 19, 115–131. Retrieved from http://aisel.aisnet.org/cgi/viewcontent.cgi?article=2650&context=cais.
- Keathley, H., Bean, A., Chen, T., Vila, K., Ye, K., & Gonzalez-Aleu, F. (2015). Bibliometric analysis of author collaboration in engineering management research. In Proceedings of the 2015 international annual conference, American Society for Engineering Management, October 7-10, 2015.Google Scholar
- Keathley, H., Bean, A., Chen, T., Vila, K., Ye, K., & Gonzalez-Aleu, F. (2016). Bibliometric analysis of research design characteristics in engineering management research. In Proceedings of the 2016 industrial and systems engineering research conference, Institute of Industrial Engineers, May 21-24, 2016.Google Scholar
- Lim, J., Rong, G., & Grover, V. (2007). An inductive approach to documenting the “core” and evolution of the IS field. Communications of the Association for Information Systems, 19(32), 665–691. Retrieved from http://aisel.aisnet.org/cgi/viewcontent.cgi?article=2675&context=cais.
- Moody, D. L. (2000). Building links between IS research and professional practice: Improving the relevance and impact of IS research. In Proceedings of the twenty first international conference on information systems (Issue 1, pp. 351–360). Retrieved from http://dl.acm.org/citation.cfm?id=359640.359760.
- Nissen, M. E. (1995). A focused review or the reengineering literature: Expert frequently asked questions. Quality Management Journal, 3(3), 52–66.Google Scholar
- Pasqualine, A., Plytiuk, C. F., da Costa, S. E. G., & de Lima, E. P. (2012). Performance management in healthcare: A bibliometric review. In IIE Annual Conference. Proceedings (p. 1). Institute of Industrial Engineers-Publisher.Google Scholar
- Patra, S. K., Bhattacharya, P., & Verma, N. (2006). Bibliometric study of literature on bibliometrics. DESIDOC Bulletin of Information Technology, 26(1), 27–32. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&db=lxh&AN=23638785&site=ehost-live.
- Pritchard, A. (1969). Statistical bibliography or bibliometrics. Journal of Documentation, 25, 348.Google Scholar
- Small, H. (1999). Visualizing science by citation mapping. Journal of the American Society for Information Science, 50(9), 799–813. doi: 10.1002/(SICI)1097-4571(1999)50:9<799:AID-ASI9>3.0.CO;2-G.CrossRefGoogle Scholar