Advertisement

Higher Education Policy

, Volume 31, Issue 3, pp 381–404 | Cite as

Development and Validation of the Multi-dimensional University Research Workplace Inventory (MDURWI)

  • João M. Santos
Original Article
  • 38 Downloads

This study describes the development and validation of an instrument aimed toward measuring organizational features of an academic research workplace. The question pool was developed based on data from a pilot study (N = 43). The survey was deployed to academic researchers in the field of higher education research worldwide (N = 850). An exploratory factor analysis conducted on 36 questions, followed by confirmatory factor analysis, which lead to a final pool of 27 questions in five subscales, one of which divided into three lower-order factors. The final model exhibited very good fit (X 2/df = 2.561; CFI = 0.972; PCFI = 0.784; RMSEA = 0.043; P[rmsea ≤ 0.05] < 0.001; AIC = 891.018; BCC = 987.839) and psychometric properties, in the form of factorial, convergent, and discriminant validity, as well as reliability and sensitivity. Implications of this instrument for research and policymaking are discussed, as well as future research directions.

Keywords

exploratory factor analysis confirmatory factor analysis validation research work academic organizations 

Notes

Acknowledgements

This work was supported by the Fundação para a Ciência e Tecnologia (FCT), co-funded by the European Social Fund (ESF) and the Portuguese Ministry of Science and Education under doctoral Grant PD/BD/113999/2015.

References

  1. Abdi, H. (2003) ‘Factor rotations in factor analyses’, in Lewis-Beck M., Bryman, A., Futing T. (eds.), Encyclopedia for Research Methods for the Social Sciences, Thousand Oaks, CA: Sage, pp. 792–795.Google Scholar
  2. Abouchedid, K. and Abdelnour, G. (2015) ‘Faculty research productivity in six Arab countries’, International Review of Education 61(5): 673–690.CrossRefGoogle Scholar
  3. Allen, N.J. and Meyer, J.P. (1990) ‘The measurement and antecedents of affective, continuance and normative commitment to the organization’, Journal of Occupational and Organizational Psychology 63(1): 1–18.CrossRefGoogle Scholar
  4. Alonderiene, R. and Majauskaite, M. (2016) ‘Leadership style and job satisfaction in higher education institutions’, International Journal of Educational Management 30(1): 140–164.Google Scholar
  5. Altbach, P.G., Bozeman, L.A., Janashia, N. and Rumbley, L.E. (eds) (2006) Higher Education: A Worldwide Inventory of Centers and Programs, Rotterdam: Sense Publishers.Google Scholar
  6. Amabile, T.M., Conti, R., Coon, H., Lazenby, J. and Herron, M. (1996) ‘Assessing the work environment for creativity’, Academy of Management Journal 39(5): 1154–1184.Google Scholar
  7. Anderson, D., Burnham, K. and White, G. (1998) ‘Comparison of Akaike information criterion and consistent Akaike information criterion for model selection and statistical inference from capture-recapture studies’, Journal of Applied Statistics 25(2): 263–282.CrossRefGoogle Scholar
  8. Arbuckle, J. (2007) Amos 16.0 User’s Guide, Chicago, IL: SPSS.Google Scholar
  9. Ashwin, P., Deem, R. and McAlpine, L. (2016) ‘Newer researchers in higher education: policy actors or policy subjects?’, Studies in Higher Education 41(12): 2184–2197.CrossRefGoogle Scholar
  10. Avolio, B.J., Zhu, W., Koh, W. and Bhatia, P. (2004) ‘Transformational leadership and organizational commitment: mediating role of psychological empowerment and moderating role of structural distance’, Journal of Organizational Behavior 25(8): 951–968.CrossRefGoogle Scholar
  11. Babakus, E., Cravens, D.W., Johnston, M., & Moncrief, W.C. (1996) ‘Examining the role of organizational variables in the salesperson job satisfaction model’, Journal of Personal Selling and Sales Management 16(3): 33–46.Google Scholar
  12. Barrett, P. (2007) ‘Structural equation modelling: adjudging model fit’, Personality and Individual Differences 42(5): 815–824.CrossRefGoogle Scholar
  13. Bentler, P.M. (1990) ‘Comparative fit indexes in structural models’, Psychological Bulletin 107(2): 238.CrossRefGoogle Scholar
  14. Bentler, P.M. (2007) ‘On tests and indices for evaluating structural models’, Personality and Individual Differences 42(5): 825–829.CrossRefGoogle Scholar
  15. Blackburn, R.T. and Lawrence, J.H. (1995) Faculty at Work: Motivation, Expectation, Satisfaction, Baltimore: Johns Hopkins University Press.Google Scholar
  16. Böckerman, P. and Ilmakunnas, P. (2012) ‘The job satisfaction-productivity nexus: A study using matched survey and register data’, Industrial and Labor Relations Review 65(2): 244–262.CrossRefGoogle Scholar
  17. Bollen, K.A. (2014) Structural equations with latent variables, New York: Wiley.Google Scholar
  18. Bourdieu, P. (1999) ‘The specificity of the scientific field’ in M. Biagioli (ed.) The Science Studies Reader, New York: Routledge, pp. 31–50.Google Scholar
  19. Cattaneo, M., Meoli, M. and Signori, A. (2016) ‘Performance-based funding and university research productivity: the moderating effect of university legitimacy’, Journal of Technology Transfer 41 (1): 85–104.CrossRefGoogle Scholar
  20. Chen, S. and Hu, L. (2012) ‘Higher education research as a field in China: its formation and current landscape’, Higher Education Research and Development, 31 (5), pp. 655–666.CrossRefGoogle Scholar
  21. Chiok Foong Loke, J. (2001) ‘Leadership behaviours: effects on job satisfaction, productivity and organizational commitment’, Journal of Nursing Management 9(4): 191–204.CrossRefGoogle Scholar
  22. Clark, B.R. (1995) Places of Inquiry: Research and Advanced Education in Modern Universities, Berkeley: University of California Press.Google Scholar
  23. Cuthbert, R. (1996) Working in Higher Education, Bristol, PA: Taylor and Francis.Google Scholar
  24. Dirani, K.M. and Kuchinke, K.P. (2011) ‘Job satisfaction and organizational commitment: validating the Arabic satisfaction and commitment questionnaire (ASCQ), testing the correlations, and investigating the effects of demographic variables in the Lebanese banking sector’, The International Journal of Human Resource Management 22(05): 1180–1202.CrossRefGoogle Scholar
  25. Dobele, A.R. and Rundle‐Theile, S. (2015) ‘Progression through academic ranks: a longitudinal examination of internal promotion drivers’, Higher Education Quarterly 69(4): 410–429.CrossRefGoogle Scholar
  26. Eagly, A.H., Johannesen-Schmidt, M.C. and van Engen, M.L. (2003) ‘Transformational, transactional, and laissez-faire leadership styles: a meta-analysis comparing women and men’, Psychological Bulletin 129(4): 569–591.CrossRefGoogle Scholar
  27. Ebadi, A. and Schiffauerova, A. (2015) ‘How to become an important player in scientific collaboration networks?’, Journal of Informetrics 9(4): 809–825.CrossRefGoogle Scholar
  28. Ek, A.C., Ideland, M., Jönsson, S. and Malmberg, C. (2013) ‘The tension between marketisation and academisation in higher education’, Studies in Higher Education 38(9): 1305–1318.CrossRefGoogle Scholar
  29. Enders, C.K. and Bandalos, D.L. (2001) ‘The relative performance of full information maximum likelihood estimation for missing data in structural equation models’, Structural Equation Modeling 8(3): 430–457.CrossRefGoogle Scholar
  30. Findlow, S. (2012) ‘Higher education change and professional-academic identity in newly “academic”disciplines: the case of nurse education’, Higher Education 63(1): 117–133.CrossRefGoogle Scholar
  31. Fornell, C. and Larcker, D.F. (1981) ‘Evaluating structural equation models with unobservable variables and measurement error’, Journal of Marketing Research 18(1): 39–50.CrossRefGoogle Scholar
  32. Gil, F., Alcover, C.-M., Peiró, J.-M., Gil, F., Rico, R., Alcover, C.M. and Barrasa, Á. (2005) ‘Change-oriented leadership, satisfaction and performance in work groups: effects of team climate and group potency’, Journal of Managerial Psychology 20(3/4): 312–328.CrossRefGoogle Scholar
  33. Hair, J.F., Black, W.C., Babin, B.J., Anderson, R.E. and Tatham, R.L. (2007) Multivariate Data Analysis, New Delhi: Pearson Education.Google Scholar
  34. Harland, T. (2012) ‘Higher education as an open-access discipline’, Higher Education Research and Development 31(5): 703–710.CrossRefGoogle Scholar
  35. Hemlin, S., Allwood, C.M. and Martin, B.R. (2008) ‘Creative knowledge environments’, Creativity Research Journal 20(2): 196–210.CrossRefGoogle Scholar
  36. Henkel, M. (2000) Academic Identities and Policy Change In Higher Education. Higher Education Policy Series; London: Jessica Kingsley Publishers.Google Scholar
  37. Hersey, P., Blanchard, K.H. and Johnson, D.E. (1969) Management of Organizational Behavior, Englewood Cliffs, NJ: Prentice-Hall.Google Scholar
  38. Higgs, M.J. and Dulewicz, S.V. (2003) The Design of a New Instrument to Assess Leadership Dimensions and Styles, Henley-on-Thames: Henley Management College.Google Scholar
  39. Hoffman, D.M. (2009) ‘Changing academic mobility patterns and international migration what will academic mobility mean in the 21st century?’, Journal of Studies in International Education 13(3): 347–364.CrossRefGoogle Scholar
  40. Hooper, D., Coughlan, J. and Mullen, M. (2008) ‘Structural equation modelling: guidelines for determining model fit’, Electronic Journal of Business Research Methods 6(1): 53–60.Google Scholar
  41. Horta, H., Dautel, V. and Veloso, F.M. (2012) ‘An output perspective on the teaching–research nexus: an analysis focusing on the United States higher education system’, Studies in Higher Education 37(2): 171–187.CrossRefGoogle Scholar
  42. Horta, H. and Lacy, T.A. (2011) ‘How does size matter for science? Exploring the effects of research unit size on academics’ scientific productivity and information exchange behaviors’, Science and Public Policy 38(6): 449–460.CrossRefGoogle Scholar
  43. Horta, H. and Martins, R. (2014) ‘The start-up, evolution and impact of a research group in a university developing its knowledge base’, Tertiary Education and Management 20(4): 280–293.CrossRefGoogle Scholar
  44. Horta, H. and Santos, J.M. (2015) ‘The impact of publishing during PhD studies on career research publication, visibility, and collaborations’ Research in Higher Education 57(1): 28–50.CrossRefGoogle Scholar
  45. Jacob, J. and Lamari, M. (2012) ‘Determinanty produktivnosti nauchnykh issledovanii v sfere vysshego obrazovaniya: empiricheskii analiz [Factors Influencing Research Performance in Higher Education: An Empirical Investigation], Foresight-Russia 6(3): 40–50.CrossRefGoogle Scholar
  46. Jemielniak, D. and Greenwood, D.J. (2015) ‘Wake up or perish neo-liberalism, the social sciences, and salvaging the public university’, Cultural Studies↔Critical Methodologies 15(1): 72–82.CrossRefGoogle Scholar
  47. Jing, L. and Zhang, D. (2014) ‘Does organizational commitment help to promote university faculty’s performance and effectiveness?’ The Asia-Pacific Education Researcher 23(2): 201–212.CrossRefGoogle Scholar
  48. Jung, J. (2014) ‘Research productivity by career stage among Korean academics’ Tertiary Education and Management 20(2): 85–105.CrossRefGoogle Scholar
  49. Katz, J.S. and Martin, B.R. (1997) ‘What is research collaboration?’, Research Policy 26(1): 1–18.CrossRefGoogle Scholar
  50. Kauppinen, I. and Kaidesoja, T. (2014) ‘A shift towards academic capitalism in Finland’, Higher Education Policy 27(1): 23–41.CrossRefGoogle Scholar
  51. Kerlin, S.P. and Dunlap, D.M. (1993) ‘For richer, for poorer: Faculty morale in periods of austerity and retrenchment’, Journal of Higher Education 64(3): 348–377.Google Scholar
  52. Kessler, S.R., Spector, P.E., & Gavin, M.B. (2014) ‘Critical look at ourselves: do male and female professors respond the same to environment characteristics?’, Research in Higher Education 55(4): 351–369.CrossRefGoogle Scholar
  53. Kim, Y., Horta, H. and Jung, J. (2017) ‘Higher education research in Hong Kong, Japan, China and Malaysia: exploring research community cohesion and the integration of thematic approaches’, Studies in Higher Education 42(1): 149-168.CrossRefGoogle Scholar
  54. Kline, R.B. (2011) Principles and Practice of Structural Equation Modelling, New York: The Guilford Press.Google Scholar
  55. Kuzhabekova, A., Hendel, D.D. and Chapman, D.W. (2015) ‘Mapping global research on international higher education’, Research in Higher Education 56(8): 861–882.CrossRefGoogle Scholar
  56. Kwan, B.S.C. (2013) ‘Facilitating novice researchers in project publishing during the doctoral years and beyond: a Hong Kong-based study’ Studies in Higher Education 38(2): 207–225.CrossRefGoogle Scholar
  57. Latour, B. and Woolgar, S. (2013) Laboratory Life: The Construction of Scientific Facts, Princeton, NJ: Princeton University Press.CrossRefGoogle Scholar
  58. Leisyte, L. (2016) ‘New public management and research productivity—a precarious state of affairs of academic work in the Netherlands’, Studies in Higher Education 41(5): 828-846.CrossRefGoogle Scholar
  59. Leisyte, L., Enders, J. and de Boer, H. (2008) ‘The freedom to set research agendas—illusion and reality of the research units in the Dutch universities’, Higher Education Policy 21(3): 377–391.CrossRefGoogle Scholar
  60. Lok, P. and Crawford, J. (2004) ‘The effect of organisational culture and leadership style on job satisfaction and organisational commitment: a cross-national comparison’, Journal of Management Development 23(4): 321–338.CrossRefGoogle Scholar
  61. Machado-Taylor, M., White, K. and Gouveia, O (2014) ‘Job satisfaction of academics: does gender matter?’, Higher Education Policy 27(3): 363–384.CrossRefGoogle Scholar
  62. Macfarlane, B. (2012) ‘The higher education research archipelago’, Higher Education Research and Development 31(1): 129–131.CrossRefGoogle Scholar
  63. McNeece, C.A. (1981) ‘Faculty publications, tenure, and job satisfaction in graduate social work programs’, Journal of Education for Social Work 17(3): 13–19.Google Scholar
  64. Madsen, S.R., Miller, D. and John, C.R. (2005) ‘Readiness for organizational change: do organizational commitment and social relationships in the workplace make a difference?’, Human Resource Development Quarterly 16(2): 213–234.CrossRefGoogle Scholar
  65. Marginson, S. (2008) ‘Academic creativity under new public management: Foundations for an investigation’, Educational Theory 58(3): 269–287.CrossRefGoogle Scholar
  66. Maroco, J. (2003) Análise estatística: com utilização do SPSS [Statistical analysis using SPSS], Lisbon: Silabo.Google Scholar
  67. Marôco, J. (2010) Análise de equações estruturais: Fundamentos teóricos, software and aplicações [Structural equations analysis: theoretical fundamentals, software, and applications], Lisbon: ReportNumber, Lda.Google Scholar
  68. Meyer, J.P. and Allen, N.J. (1991) ‘A three-component conceptualization of organizational commitment’, Human Resource Management Review 1(1): 61–89.CrossRefGoogle Scholar
  69. Mowday, R.T., Porter, L.W. and Steers, R. (1982) Employee-organization linkages: the psychology of commitment, absenteeism, and turnover, New York: Academic Press.Google Scholar
  70. Mowday, R.T., Steers, R.M. and Porter, L.W. (1979) ‘The measurement of organizational commitment’, Journal of Vocational Behavior 14(2): 224–247.CrossRefGoogle Scholar
  71. Nguni, S., Sleegers, P. and Denessen, E. (2006) ‘Transformational and transactional leadership effects on teachers’ job satisfaction, organizational commitment, and organizational citizenship behavior in primary schools: the Tanzanian case’, School Effectiveness and School Improvement 17(2): 145–177.CrossRefGoogle Scholar
  72. O’Reilly, C.A. and Chatman, J. (1986) ‘Organizational commitment and psychological attachment: The effects of compliance, identification, and internalization on prosocial behavior’, Journal of Applied Psychology 71(3): 492.CrossRefGoogle Scholar
  73. Peluchette, J.V.E. (1993) ‘Subjective career success: the influence of individual difference, family, and organizational variables’, Journal of Vocational Behavior 43(2): 198–208.CrossRefGoogle Scholar
  74. Pepper, C. and Giles, W. (2015) ‘Leading in middle management in higher education’, Management in Education 29(2): 46–52.CrossRefGoogle Scholar
  75. Podsakoff, P.M., MacKenzie, S.B. and Bommer, W.H. (1996) ‘Transformational leader behaviors and substitutes for leadership as determinants of employee satisfaction, commitment, trust, and organizational citizenship behaviors’, Journal of Management 22(2): 259–298.Google Scholar
  76. Podsakoff, P.M., MacKenzie, S.B., Moorman, R.H. and Fetter, R. (1990) ‘Transformational leader behaviors and their effects on followers’ trust in leader, satisfaction, and organizational citizenship behaviors’, The Leadership Quarterly 1(2): 107–142.CrossRefGoogle Scholar
  77. Polanyi, M. (2000) ‘The republic of science: Its political and economic theory’, Minerva 38(1): 1–21.CrossRefGoogle Scholar
  78. Rammstedt, B. and John, O.P. (2007) ‘Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory in English and German’, Journal of Research in Personality 41(1): 203–212.CrossRefGoogle Scholar
  79. Ren, K. and Li, J. (2013) ‘Academic freedom and university autonomy: a higher education policy perspective’, Higher Education Policy 26(4): 507–522.CrossRefGoogle Scholar
  80. Roberts, K., Miles, R.E. and Blankenship, L.V. (1968) ‘Organizational leadership satisfaction and productivity: a comparative analysis’, Academy of Management Journal 11(4): 401–411.Google Scholar
  81. Schyns, B. and von Collani, G. (2002) ‘A new occupational self-efficacy scale and its relation to personality constructs and organizational variables’, European Journal of Work and Organizational Psychology 11(2): 219–241.CrossRefGoogle Scholar
  82. Shattock, M. (2014) ‘Can we still speak of there being an academic profession?’, History of Education 43(6): 727–739.CrossRefGoogle Scholar
  83. Shin, J.C. and Jung, J. (2014) ‘Academics job satisfaction and job stress across countries in the changing academic environments’, Higher Education 67(5): 603–620.CrossRefGoogle Scholar
  84. Slade, C.P., Ribando, S.J. and Fortner, C.K. (2016) ‘Faculty research following merger: a job stress and social identity theory perspective’ Scientometrics 107(1): 71–89.CrossRefGoogle Scholar
  85. Spector, P.E. (1994) Job Satisfaction Survey, Tampa, FL: Department of Psychology, University of South Florida.Google Scholar
  86. Stahl, M.J. and Koser, M.C. (1978) ‘Weighted productivity in R&D: Some associated individual and organizational variables’, IEEE Transactions on Engineering Management 25(1):20–24.CrossRefGoogle Scholar
  87. Steiger, J.H., Shapiro, A. and Browne, M.W. (1985) ‘On the multivariate asymptotic distribution of sequential Chi square statistics’, Psychometrika 50(3): 253–263.CrossRefGoogle Scholar
  88. Teichler, U. (1996) ‘Comparative higher education: potentials and limits’, Higher Education 32(4): 431–465.CrossRefGoogle Scholar
  89. Teichler, U., Arimoto, A. and Cummings, W.K. (2013) The changing academic profession, Dordrecht: Springer.CrossRefGoogle Scholar
  90. Terpstra, D.E., Olson, P.D. and Lockeman, B. (1982) ‘The effects of MBO on levels of performance and satisfaction among university faculty’ Group and Organization Management 7(3): 353–366.Google Scholar
  91. Tierney, W.G. (1999) Faculty productivity: facts, fictions and issues (Vol. 15), New York : Falmer Press.Google Scholar
  92. Tigelaar, D.E., Dolmans, D.H., Wolfhagen, I.H. and van der Vleuten, C.P. (2004) ‘The development and validation of a framework for teaching competencies in higher education’, Higher Education 48(2): 253–268.CrossRefGoogle Scholar
  93. Tight, M. (2012) Researching Higher Education, Maidenhead: Open University Press.Google Scholar
  94. Veličković, V.M., Višnjić, A., Jović, S., Radulović, O., Šargić, Č., Mihajlović, J. and Mladenović, J. (2014) ‘Organizational commitment and job satisfaction among nurses in Serbia: a factor analysis’, Nursing Outlook 62(6): 415–427.CrossRefGoogle Scholar
  95. Young, M. (2015) ‘Competitive funding, citation regimes, and the diminishment of breakthrough research’, Higher Education 69(3): 421–434.CrossRefGoogle Scholar
  96. Yousef, D.A. (2000) ‘Organizational commitment: a mediator of the relationships of leadership behavior with job satisfaction and performance in a non-western country’, Journal of Managerial Psychology 15(1): 6–24.CrossRefGoogle Scholar
  97. Webber, K. (2012) ‘Research productivity of foreign-and US born faculty: differences by time on task’ Higher Education 64(5): 709–729.CrossRefGoogle Scholar

Copyright information

© International Association of Universities 2017

Authors and Affiliations

  1. 1.Instituto Universitário de Lisboa (ISCTE-IUL)Centro de Investigação e Intervenção SocialLisbonPortugal
  2. 2.IN+ - Center for Innovation, Technology and Policy Research, Instituto Superior TécnicoUniversity of LisbonLisbonPortugal

Personalised recommendations