Skip to main content
Springer Nature Link
Log in

A new hybrid model for quality assessment of scientific conferences based on Rough BWM and SERVQUAL

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

Organizing scientific conferences requires the execution of a series of activities which aim to ensure quality in terms of published papers, completed reviews, information forwarded to participants on time, to putting together an exceptional event as a whole. Essentially, this is far from an easy task and requires the participation of a large number of people who will carry out organizational obligations daily, and often all day long. The quality, or rather satisfaction of the conference participants can be viewed through five aspects: Reliability, Responsiveness, Assurance, Empathy, and Tangibility–dimensions that comprise the SERVQUAL model. In this paper, a new hybrid model that uses the advantages of rough set theory, multi-criteria decision making, and quality assessment models has been developed. The proposed model uses the Rough BWM (Best–Worst Method) in order to determine the significance of five aspects, while the modified SERVQUAL model, based on 28 items, is used to determine expectations and observations. The model was applied for the evaluation of quality of the New Horizons Conference held on November 17–18, 2017, in Doboj. The conference was attended by authors from all six continents, representing a total of 58 different institutions. Therefore, it was necessary to fulfill the wishes and demands of numerous authors, which naturally differ due to the different geographical areas from which they hail. The total sample, on the basis of which the quality of the scientific conference was assessed, includes 104 authors who completed the questionnaire. A total of six hypotheses were set up, which were then tested using the Signum test.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
€32.70 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Austria)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  • Abari, A. A. F., Yarmohammadian, M. H., & Esteki, M. (2011). Assessment of quality of education a non-governmental university via SERVQUAL model. Procedia-Social and Behavioral Sciences, 15, 2299–2304.

    Article  Google Scholar 

  • Aboutorab, H., Saberi, M., Asadabadi, M. R., Hussain, O., & Chang, E. (2018). ZBWM: The Z-number extension of Best Worst Method and its application for supplier development. Expert Systems with Applications, 107, 115–125.

    Article  Google Scholar 

  • Akdere, M., Top, M., & Tekingündüz, S. (2018). Examining patient perceptions of service quality in Turkish hospitals: The SERVPERF model. Total Quality Management & Business Excellence, 1–11.

  • Akhlaghi, E., Amini, S., & Akhlaghi, H. (2012). Evaluating educational service quality in technical and vocational colleges using SERVQUAL model. Procedia-Social and Behavioral Sciences, 46, 5285–5289.

    Article  Google Scholar 

  • Al-Borie, H. M., & Sheikh Damanhouri, A. M. (2013). Patients’ satisfaction of service quality in Saudi hospitals: A SERVQUAL analysis. International Journal of Health Care Quality Assurance, 26(1), 20–30.

    Article  Google Scholar 

  • Altuntas, S., Dereli, T., & Yilmaz, M. K. (2012a). Multi-criteria decision making methods based weighted SERVQUAL scales to measure perceived service quality in hospitals: A case study from Turkey. Total Quality Management & Business Excellence, 23(11–12), 1379–1395.

    Article  Google Scholar 

  • Altuntas, S., Dereli, T., & Yilmaz, M. K. (2012b). Multi-criteria decision making methods based weighted SERVQUAL scales to measure perceived service quality in hospitals: A case study from Turkey. Total Quality Management & Business Excellence, 23(11–12), 1379–1395.

    Article  Google Scholar 

  • Apornak, A. (2017). Customer satisfaction measurement using SERVQUAL model, integration Kano and QFD approach in an educational institution. International Journal of Productivity and Quality Management, 21(1), 129–141.

    Article  Google Scholar 

  • Askarifar, K., Motaffef, Z., & Aazaami, S. (2018). An investment development framework in Iran’s seashores using TOPSIS and best-worst multi-criteria decision making methods. Decision Science Letters, 7(1), 55–64.

    Article  Google Scholar 

  • Badi, I., & Ballem, M. (2018). Supplier selection using the rough BWM-MAIRCA model: A case study in pharmaceutical supplying in Libya. Decision Making: Applications in Management and Engineering, 1(2), 16–33.

    Google Scholar 

  • Behdioğlu, S., Acar, E., & Burhan, H. A. (2019). Evaluating service quality by fuzzy SERVQUAL: A case study in a physiotherapy and rehabilitation hospital. Total Quality Management & Business Excellence, 30(3–4), 301–319.

    Article  Google Scholar 

  • Buttle, F. (1996). SERVQUAL: Review, critique, research agenda. European Journal of Marketing, 30(1), 8–32.

    Article  Google Scholar 

  • Carrasco, R. A., Sánchez-Fernández, J., Muñoz-Leiva, F., Blasco, M. F., & Herrera-Viedma, E. (2017). Evaluation of the hotels e-services quality under the user’s experience. Soft Computing, 21(4), 995–1011.

    Article  Google Scholar 

  • Cavana, R. Y., Corbett, L. M., & Lo, Y. L. (2007). Developing zones of tolerance for managing passenger rail service quality. International Journal of Quality & Reliability Management, 24(1), 7–31.

    Article  Google Scholar 

  • Chatzoglou, P., Chatzoudes, D., Vraimaki, E., & Leivaditou, E. (2014). Measuring citizen satisfaction using the SERVQUAL approach: The case of the ‘Hellenic post’. Procedia Economics and Finance, 9, 349–360.

    Article  Google Scholar 

  • Chou, C. C., Liu, L. J., Huang, S. F., Yih, J. M., & Han, T. C. (2011). An evaluation of airline service quality using the fuzzy weighted SERVQUAL method. Applied Soft Computing, 11(2), 2117–2128.

    Article  Google Scholar 

  • Clausen, H., & Wormell, I. (2001). A bibliometric analysis of IOLIM conferences 1977–1999. Journal of Information Science, 27(3), 157–169.

    Article  Google Scholar 

  • Cronin, J. J., Jr., & Taylor, S. A. (1992). Measuring service quality: A reexamination and extension. The Journal of Marketing, 56, 55–68.

    Article  Google Scholar 

  • Di Mauro, N., Basile, T. M., & Ferilli, S. (2005). Grape: An expert review assignment component for scientific conference management systems. In International conference on industrial, engineering and other applications of applied intelligent systems (pp. 789–798). Berlin: Springer.

  • Enayati, T., Modanloo, Y., Behnamfar, R., & Rezaei, A. (2013). Measuring service quality of Islamic Azad University of Mazandaran using SERVQUAL model. Iranian Journal of Management Studies, 6(1), 99–116.

    Google Scholar 

  • Fan, L. H., Gao, L., Liu, X., Zhao, S. H., Mu, H. T., Li, Z., et al. (2017). Patients’ perceptions of service quality in China: An investigation using the SERVQUAL model. PLoS ONE, 12(12), e0190123.

    Article  Google Scholar 

  • Gamble, M., & Goble, C. (2011). Quality, trust, and utility of scientific data on the web: Towards a joint model. In Proceedings of the 3rd international web science conference (p. 15). ACM.

  • Ghaffari, S., Arab, A., Nafari, J., & Manteghi, M. (2017). Investigation and evaluation of key success factors in technological innovation development based on BWM. Decision Science Letters, 6(3), 295–306.

    Article  Google Scholar 

  • Guo, S., & Zhao, H. (2017). Fuzzy best–worst multi-criteria decision-making method and its applications. Knowledge-Based Systems, 121, 23–31.

    Article  Google Scholar 

  • Gupta, H., & Barua, M. K. (2016). Identifying enablers of technological innovation for Indian MSMEs using best–worst multi criteria decision making method. Technological Forecasting and Social Change, 107, 69–79.

    Article  Google Scholar 

  • Hafezalkotob, A., & Hafezalkotob, A. (2017). A novel approach for combination of individual and group decisions based on fuzzy best–worst method. Applied Soft Computing., 59, 316–325.

    Article  MATH  Google Scholar 

  • Ingwersen, P., & Larsen, B. (2006). Using citations for ranking in digital libraries. In Proceedings of the 6th ACM/IEEE-CS joint conference on digital libraries (JCDL’06) (pp. 370–370). IEEE.

  • Kahnali, R. A., & Esmaeili, A. (2015). An integration of SERVQUAL dimensions and logistics service quality indicators (a case study). International Journal of Services and Operations Management, 21(3), 289–309.

    Article  Google Scholar 

  • Karavidić, Z., & Projović, D. (2018). A multi-criteria decision-making (MCDM) model in the security forces operations based on rough sets. Decision Making: Applications in Management and Engineering, 1(1), 97–120.

    Google Scholar 

  • Karunasena, G., Vijerathne, D., & Muthmala, H. (2018). Preliminary framework to manage tenant satisfaction in facilities management service encounters. Facilities, 36(3/4), 171–194.

    Article  Google Scholar 

  • Kilibarda, M., Nikolicic, S., & Andrejic, M. (2016). Measurement of logistics service quality in freight forwarding companies: a case study of the Serbian market. The International Journal of Logistics Management, 27(3), 770–794.

    Article  Google Scholar 

  • Kreiman, G., & Maunsell, J. (2011). Nine criteria for a measure of scientific output. Frontiers in computational neuroscience, 5, 48.

    Article  Google Scholar 

  • Kuhn, M., & Wattenhofer, R. (2008). The layered world of scientific conferences. In Asia-Pacific web conference (pp. 81–92). Berlin: Springer.

  • Lee, H., Lee, Y., & Yoo, D. (2000). The determinants of perceived service quality and its relationship with satisfaction. Journal of Services Marketing, 14(3), 217–231.

    Article  Google Scholar 

  • Long, S. (2016). The correlation research between express company service quality and undergraduate customer satisfaction degree based on SERVQUAL model. Korean Review of Corporation Management, 7(1), 1–23.

    Article  MathSciNet  Google Scholar 

  • Lupo, T. (2013). A fuzzy ServQual based method for reliable measurements of education quality in Italian higher education area. Expert Systems with Applications, 40(17), 7096–7110.

    Article  Google Scholar 

  • Martins, W. S., Gonçalves, M. A., Laender, A. H., & Ziviani, N. (2010). Assessing the quality of scientific conferences based on bibliographic citations. Scientometrics, 83(1), 133–155.

    Article  Google Scholar 

  • Miller, R. E., Hardgrave, B. C., & Jones, T. W. (2011). SERVQUAL dimensionality: An investigation of presentation order effect. International Journal of Services and Standards, 7(1), 1–17.

    Article  Google Scholar 

  • Mou, Q., Xu, Z., & Liao, H. (2016). An intuitionistic fuzzy multiplicative best–worst method for multi-criteria group decision making. Information Sciences, 374, 224–239.

    Article  Google Scholar 

  • Niedrich, R. W., Kiryanova, E., & Black, W. C. (2005). The dimensional stability of the standards used in the disconfirmation paradigm. Journal of Retailing, 81(1), 49–57.

    Article  Google Scholar 

  • Nikolić, Đ., Spasić, J., Živković, Ž., Đorđević, P., Mihajlović, I., & Kangas, J. (2015). SWOT-AHP model for prioritzation of strategies of the resort Stara Planina. Serbian Journal of Management, 10(2), 141–150.

    Article  Google Scholar 

  • Nunić, Z. B. (2018). Evaluation and selection of manufacturer PVC carpentry using FUCOM-MABAC model. Operational Research in Engineering Sciences: Theory and Applications, 1(1), 13–28.

    Google Scholar 

  • Pamučar, D., (2017). Interval rough DEMATEL technique for prioritizing hazmat routing criteria. In VI International symposium new horizons (pp. 561–570).

  • Pamučar, D., Gigović, L., Bajić, Z., & Janošević, M. (2017). Location selection for wind farms using GIS multi-criteria hybrid model: An approach based on fuzzy and rough numbers. Sustainability, 9(8), 1315.

    Article  Google Scholar 

  • Pamučar, D., Lukovac, V., Božanić, D., & Komazec, N. (2018a). Multi-criteria FUCOM-MAIRCA model for the evaluation of level crossings: Case study in the Republic of Serbia. Operational Research in Engineering Sciences: Theory and Applications, 1(1), 108–129.

    Google Scholar 

  • Pamučar, D., Petrović, I., & Ćirović, G. (2018b). Modification of the Best–Worst and MABAC methods: A novel approach based on interval-valued fuzzy-rough numbers. Expert Systems with Applications, 91, 89–106.

    Article  Google Scholar 

  • Pamučar, D., Stević, Ž., & Sremac, S. (2018c). A new model for determining weight coefficients of criteria in MCDM models: Full consistency method (FUCOM). Symmetry, 10(9), 393.

    Article  Google Scholar 

  • Parasuraman, A., Zeithaml, V. A., & Berry, L. L. (1985). A conceptual model of service quality and its implications for future research. Journal of Marketing, 49(Fall), 41–50.

    Article  Google Scholar 

  • Parasuraman, A., Zeithaml, V. A., & Berry, L. L. (1988). SERVQUAL: A multiple-item scale for measuring consumer perceptions of service quality. Journal of Retailing, 64(1), 12–40.

    Google Scholar 

  • Parasuraman, A., Zeithaml, V. A., & Berry, L. L. (1994). Reassessment of expectations as a comparison standard in measuring service quality: Implications for further research. Journal of Marketing, 58, 111–124.

    Article  Google Scholar 

  • Paryani, K., Masoudi, A., & Cudney, E. A. (2010). QFD application in the hospitality industry: A hotel case study. The Quality Management Journal, 17(1), 7.

    Article  Google Scholar 

  • Pesenhofer, A., Mayer, R., & Rauber, A. (2006). Improving scientific conferences by enhancing conference management systems with information mining capabilities. In 2006 1st international conference on digital information management (pp. 359–366). IEEE.

  • Prentkovskis, O., Erceg, Ž., Stević, Ž., Tanackov, I., Vasiljević, M., & Gavranović, M. (2018). A new methodology for improving service quality measurement: Delphi-FUCOM-SERVQUAL model. Symmetry, 10(12), 757.

    Article  Google Scholar 

  • Rezaei, J. (2015). Best–worst multi-criteria decision-making method. Omega, 53, 49–57.

    Article  Google Scholar 

  • Rezaei, J., Kothadiya, O., Tavasszy, L., & Kroesen, M. (2018). Quality assessment of airline baggage handling systems using SERVQUAL and BWM. Tourism Management, 66, 85–93.

    Article  Google Scholar 

  • Saeedpoor, M., Vafadarnikjoo, A., Mobin, M., & Rastegari, A. (2015). A servqual model approach integrated with fuzzy AHP and fuzzy TOPSIS methodologies to rank life insurance firms. In Proceedings of the international annual conference of the American society for engineering management (p. 1). American Society for Engineering Management (ASEM).

  • Salimi, N. (2017). Quality assessment of scientific outputs using the BWM. Scientometrics, 112(1), 195–213.

    Article  Google Scholar 

  • Salimi, N., & Rezaei, J. (2016). Measuring efficiency of university-industry Ph.D. projects using best worst method. Scientometrics, 109(3), 1911–1938.

    Article  Google Scholar 

  • Salimi, N., & Rezaei, J. (2018). Evaluating firms’ R&D performance using best worst method. Evaluation and Program Planning, 66, 147–155.

    Article  Google Scholar 

  • Savic, M., Nikolic, D., Mihajlovic, I., Zivkovic, Z., Bojanov, B., & Djordjevic, P. (2015). Multi-criteria decision support system for optimal blending process in zinc production. Mineral Processing and Extractive Metallurgy Review, 36(4), 267–280.

    Article  Google Scholar 

  • Song, W., Ming, X., Wu, Z., & Zhu, B. (2014). A rough TOPSIS approach for failure mode and effects analysis in uncertain environments. Quality and Reliability Engineering International, 30(4), 473–486.

    Article  Google Scholar 

  • Souto, M. A. M., Warpechowski, M., & De Oliveira, J. P. M. (2007). An ontological approach for the quality assessment of computer science conferences. In International conference on conceptual modeling (pp. 202–212). Berlin: Springer.

  • Stanujkić, D., & Karabašević, D. (2018). An extension of the WASPAS method for decision-making problems with intuitionistic fuzzy numbers: A case of website evaluation. Operational Research in Engineering Sciences: Theory and Applications, 1(1), 29–39.

    Google Scholar 

  • Stefano, N. M., Casarotto Filho, N., Barichello, R., & Sohn, A. P. (2015). A fuzzy SERVQUAL based method for evaluated of service quality in the hotel industry. Procedia CIRP, 30, 433–438.

    Article  Google Scholar 

  • Stević, Ž., Badi, I., Tanackov, I., Miličić, G. (2017a). Supplier selection in furniture production company using rough AHP and rough TOPSIS. In VI International symposium new horizons, Doboj (pp. 524–533).

  • Stević, Ž., Pamučar, D., Kazimieras Zavadskas, E., Ćirović, G., & Prentkovskis, O. (2017b). The selection of wagons for the internal transport of a logistics company: A novel approach based on rough BWM and rough SAW methods. Symmetry, 9(11), 264.

    Article  Google Scholar 

  • Stević, Ž., Pamučar, D., Vasiljević, M., Stojić, G., & Korica, S. (2017c). Novel integrated multi-criteria model for supplier selection: Case study construction company. Symmetry, 9(11), 279.

    Article  Google Scholar 

  • Stević, Ž., Tanackov, I., Vasiljević, M., Novarlić, B., & Stojić, G. (2016). An integrated fuzzy AHP and TOPSIS model for supplier evaluation. Serbian Journal of Management, 11(1), 15–27.

    Article  Google Scholar 

  • Stević, Ž., Tanackov, I., Vasiljević, M., Rikalović, A. (2017d), Supplier evaluation criteria: AHP rough approach. In XVII International scientific conference on industrial systems, Novi Sad (pp. 298–303).

  • Tekindal, M., Tekindal, M. A., & Yazicr, A. C. (2017). Evaluation of expected and perceived of quality of service with the SERVQUAL scale: The case of a private physical therapy and rehabilitation center. Biomedical Research, 28(2), 711–715.

    Google Scholar 

  • Torfi, F., Farahani, R. Z., & Rezapour, S. (2010). Fuzzy AHP to determine the relative weights of evaluation criteria and Fuzzy TOPSIS to rank the alternatives. Applied Soft Computing, 10(2), 520–528.

    Article  Google Scholar 

  • Tsaur, S. H., Chang, T. Y., & Yen, C. H. (2002). The evaluation of airline service quality by fuzzy MCDM. Tourism Management, 23(2), 107–115.

    Article  Google Scholar 

  • Vasiljević, M., Fazlollahtabar, H., Stević, Ž., & Vesković, S. (2018). A rough multicriteria approach for evaluation of supplier criteria in automotive industry. Decision Making: Applications in Management and Engineering, 1(1), 82–96.

    Google Scholar 

  • Vučković-Dekić, L. (2014). Nedostaci sadašnjeg sistema vrednovanja naučnika–kako ga usavršiti? Биoмeдицинcкa иcтpaживaњa, 5(2), 72–76.

    Google Scholar 

  • Wang, Y. L., Luor, T., Luarn, P., & Lu, H. P. (2015). Contribution and trend to quality research—a literature review of SERVQUAL model from 1998 to 2013. Informatica Economica, 19(1), 34.

    Article  Google Scholar 

  • Wang, R., Yan, Z., & Liu, K. (2010). An empirical study: Measuring the service quality of an e-learning system with the model of ZOT SERVQUAL. In 2010 International conference on E-business and E-government (ICEE) (pp. 5379–5382). IEEE.

  • Xuehua, J. (2018). SERVQUAL-model-based fuzzy evaluation of express service quality. International Journal of Transportation Engineering and Technology, 4(1), 20.

    Article  Google Scholar 

  • Yang, X. S., & Zhu, Y. Y. (2010, August). SERVQUAL-based evaluation study on the quality of community-based service provided by university-affiliated stadiums. In 2010 International conference on management and service science (MASS) (pp. 1–4). IEEE.

  • Yousapronpaiboon, K. (2014). SERVQUAL: Measuring higher education service quality in Thailand. Procedia-Social and Behavioral Sciences, 116, 1088–1095.

    Article  Google Scholar 

  • Zareinejad, M., Kaviani, M., Esfahani, M., & Masoule, F. (2014). Performance evaluation of services quality in higher education institutions using modified SERVQUAL approach with grey analytic hierarchy process (G-AHP) and multilevel grey evaluation. Decision Science Letters, 3(2), 143–156.

    Article  Google Scholar 

  • Zavadskas, E. K., Nunić, Z., Stjepanović, Ž., & Prentkovskis, O. (2018). A novel rough range of value method (R-ROV) for selecting automatically guided vehicles (AGVs). Studies in Informatics and Control, 27(4), 385–394.

    Article  Google Scholar 

  • Zhuang, Z., Elmacioglu, E., Lee, D., & Giles, C. L. (2007). Measuring conference quality by mining program committee characteristics. In Proceedings of the 7th ACM/IEEE-CS joint conference on Digital libraries (pp. 225–234). ACM.

Download references

Author information

Authors and Affiliations

  1. Faculty of Transport and Traffic Engineering Doboj, University of East Sarajevo, Vojvode Mišića 52, 7400, Doboj, Bosnia and Herzegovina

    Željko Stević, Irena Đalić, Zdravko Nunić & Marko Vasiljević

  2. Department of Logistics, University of Defence in Belgrade, Pavla Jurisica Sturma 33, 11000, Belgrade, Serbia

    Dragan Pamučar

  3. Faculty of Transport and Traffic Engineering, University of Belgrade, Vojvode Stepe 305, 11000, Belgrade, Serbia

    Slavko Vesković

  4. Faculty of Technical Sciences, University of Novi Sad, Trg Dositeja Obradovića 6, 21000, Novi Sad, Serbia

    Ilija Tanackov

Authors
  1. Željko Stević
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Irena Đalić
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dragan Pamučar
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zdravko Nunić
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Slavko Vesković
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Marko Vasiljević
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Ilija Tanackov
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Željko Stević.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Stević, Ž., Đalić, I., Pamučar, D. et al. A new hybrid model for quality assessment of scientific conferences based on Rough BWM and SERVQUAL. Scientometrics 119, 1–30 (2019). https://doi.org/10.1007/s11192-019-03032-z

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-019-03032-z

Keywords