Abstract
Over the past years, Italian universities have come under increased pressure to be more competitive and attract more students, and students’ satisfaction has received increasing attention. Students’ opinions about a few aspects of academic life are sought by Italian universities in the form of a satisfaction feedback questionnaire. The aim of this paper is to classify university courses into homogeneous classes with respect to the level of students’ satisfaction through the use of a two-level mixture item response model. The data are drawn from the Italian questionnaire on students’ satisfaction administered at a Faculty of Political Sciences. The latent variables measured by the questionnaire are detected performing a model-based hierarchical clustering. Then, a special case of multilevel mixture factor model characterised by an item response parameterisation and discrete latent variables at all hierarchical levels is estimated. The study allowed us to ascertain (i) the latent dimensionality of students’ satisfaction with higher education courses; (ii) the varied effect of first and second-level covariates on the satisfaction dimensions; and (iii) the different sources of strength/weaknesses of the best and worst courses.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Agresti, A.: Categorical Data Analysis. Wiley, New York (2002)
Amendola, A., Vitale, M.: Self-assessment and career choices: a multivariate analysis for the University of Salerno. In: Atti della XLII Riunione scientifica della SIS (2004)
Arena, M., Arnaboldi, M., Azzone, G.: Student perceptions and central administrative services: the case of higher education in Italy. Stud. High. Educ. 35(8), 941–959 (2010)
Bacci, S., Caviezel, V.: Multilevel IRT models for the university teaching evaluation. J. Appl. Stat. 38, 2775–2791 (2011)
Bacci, S., Bartolucci, F., Gnaldi, M.: A class of multidimensional latent class IRT models for ordinal polytomous item responses. Commun. Stat. Theory Methods 43, 787–800 (2014)
Bartolucci, F.: A class of multidimensional IRT models for testing unidimensionality and clustering items. Psychometrika 72, 141–157 (2007)
Bartolucci, F., Montanari, G., Pandolfi, S.: Dimensionality of the latent structure and item selection via latent class multidimensional IRT models. Psychometrika 77, 782–802 (2012)
Bartolucci, F., Bacci, S., Gnaldi, M.: MultiLCIRT: an R package for multidimensional latent class item response models. Comput. Stat. Data Anal. 71, 971–985 (2014)
Bigné, E., Moliner, M., Sánchez, J.: Perceived quality and satisfaction in multiservice organisations: the case of Spanish public services. J. Serv. Mark. 17(4), 420–442 (2003)
Cho, S.J., Cohen, A.S.: A multilevel mixture IRT model with an application to DIF. J. Educ. Behav. Stat. 35, 336–370 (2010)
Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm (with discussion). J. R. Stat. Soc. Ser. B 39, 1–38 (1977)
Douglas, J., Douglas, A., Barnes, B.: Measuring student satisfaction at a UK university. Qual. Assur. Educ. 14(3), 251–267 (2006)
Ford, J., Joseph, M., Joseph, B.: Importance-performance analysis as a strategic tool for service marketers: the case of service quality perceptions of business students in New Zealand and the USA. J. Serv. Mark. 13(2), 171–186 (1999)
Goodman, L.A.: Exploratory latent structure analysis using both identifiable and unidentifiable models. Biometrika 61, 215–231 (1974)
Grilli, L., Rampichini, C.: Multilevel factor models for ordinal variables. Struct. Equ. Model. 14(1), 1–25 (2007)
de Jager, J., Gbadamosi, G.: Specific remedy for specific problem: measuring service quality in South African higher education. High. Educ. 60, 251–267 (2010)
Lai, L., To, W., Lung, J., Lai, T.: The perceived value of higher education: the voice of Chinese students. High. Educ. 63, 271–287 (2012)
Lazarsfeld, P.F., Henry, N.W.: Latent Structure Analysis. Houghton Mifflin, Boston (1968)
Martilla, J., James, J.: Importance-performance analysis. J. Mark. 41(1), 77–79 (1977)
Masters, G.: A Rasch model for partial credit scoring. Psychometrika 47, 149–174 (1982)
Mergen, E., Grant, D., Widrick, S.: Quality management applied to higher education. Total Qual. Manag. 11(3), 345–352 (2000)
Mok, K.: Decentralisation and marketization of education in Singapore: a case study of the school excellence model. J. Educ. Adm. 41(4), 348–366 (2003)
Moro-Egido, A., Panades, Æ.J.: An analysis of student satisfaction: full-time vs. part-time students. Soc. Indic. Res. 96, 363–378 (2010)
Muraki, E.: A generalized partial credit model: application of an EM algorithm. Appl. Psychol. Meas. 16, 159–176 (1992)
Nale, R., Rauch, D., Wathen, S., Barr, P.: An exploratory look at the use of importance-performance analysis as a curricular assessment tool in a school of business. J. Workplace Learn. 12(4), 139–145 (2000)
Paletta, A.: Il governo dell’università. Tra competizione e accountability. Il Mulino, Bologna (2005)
Palihawadana, G.H.: Modeling module evolution in marketing education. Qual. Assur. Educ. 7(1), 41–46 (1999)
Petruzzellis, L., D’Uggento, A., Romanazzi, S.: Student satisfaction and quality of service in Italian universities. Manag. Serv. Qual. 16(4), 349–364 (2006)
Rebora, G.: La valutazione degli atenei: alla ricerca della qualità. Azienda Pubblica 16, 411–437 (2003)
Rebora, G., Turri, M.: Critical factors in the use of evaluation in Italian universities. High. Educ. 61, 531–544 (2011)
Rienzi, B., Sarmiento, A., McMillin, J.: Alumni perception of the impact of gender on their university experience. J. Coll. Stud. Dev. 34, 154–157 (1993)
Samejima, F.: Estimation of ability using a response pattern of graded scores. Psychom. Monogr. 17. (1969)
Schwarz, G.: Estimating the dimension of a model. Ann. Stat. 6, 461–464 (1978)
Sojkin, B., Bartkowiak, P.: Determinants of higher education choices and student satisfaction: the case of Poland. High. Educ. 63, 565–581 (2011)
Soutar, G.N., Turner, J.P.: Student preferences for university: a conjoint analysis. Int. J. Educ. Manag. 16(1), 40–45 (2002)
Vermunt, J.K.: Multilevel latent class models. Sociol. Methodol. 33, 213–239 (2003)
Vermunt, J.K.: Multilevel latent variable modeling: an application in education testing. Austrian J. Stat. 37, 285–299 (2008)
Vermunt, J.K., Magidson, J.: Latent GOLD 4.0 User’s Guide. Statistical Innovations Inc., Belmont (2005)
Voss, R., Gruber, T., Szmigin, I.: Service quality in higher education: the role of student expectations. J. Bus. Res. 60(9), 949–959 (2007)
Wignall, A.: How to fulfil those great expectations. guardian unlimited. http://education.guardian.co.uk/ (2007)
Acknowledgments
Authors acknowledge the financial support from the grant “Finite mixture and latent variable models for causal inference and analysis of socio-economic data” (FIRB—Futuro in ricerca) funded by the Italian Government (RBFR12SHVV).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bacci, S., Gnaldi, M. A classification of university courses based on students’ satisfaction: an application of a two-level mixture item response model. Qual Quant 49, 927–940 (2015). https://doi.org/10.1007/s11135-014-0101-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11135-014-0101-0