Skip to main content
SpringerLink
Log in

Measuring Quality Orientation in Organisations: A Cognitive-Behavioural Approach

  • Conference paper
  • First Online:
Proceedings of the 12th International Conference on Measurement and Quality Control - Cyber Physical Issue (IMEKOTC14 2019)

Part of the book series: Lecture Notes in Mechanical Engineering ((LNME))

  • 861 Accesses

Abstract

This paper explores the application of a cognitive-behavioural approach for measuring quality orientation in organisations. It aims at providing a method for improving the alignment of an organisation’s strategy with its culture. The explored and presented approach is called Situational Judgment Test (SJT) and is based on the Critical Incident Technique (CIT), a method to gather information about reoccurring human-system problems and their causes. Critical incidents allow the systematic identification of behaviour that contribute to success or failure in specific situations. Thereby, they form a solid basis for performance appraisals as well as personnel development and selection procedures. We followed a deductive test development approach and conducted two studies with Subject Matter Experts (SMEs) to validate the developed items. The SMEs evaluated 40 situational descriptions with regard to their degree of realism as well as relevance and assigned each situation to one predefined variable related to quality orientation. Analysis of the data led to the exclusion of 14 items. The interrater agreement for the remaining 26 items is considered as fair and reflects the difficulty associated with construct-based SJT development. For future research, the combination of critical incidents with Virtual Reality (VR) as simulation method appears to be promising for increasing fidelity. The presented cognitive-behavioural approach provides a novel method for measuring and strengthening organisation-wide quality initiatives, going beyond the implementation of established quality tools and techniques.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    In the second study, one new item was added to the remaining 26 items to have at least 5 items per variable.

References

  • Aguinis, H., Henle, C.A., Ostroff, C.: Measurement in work and organizational psychology. In: Anderson, N., Ones, D.S., Sinangil, H.K., Viswesvaran, C. (eds.) Handbook of Industrial, Work and Organizational Psychology, Volume 1: Personnel Psychology, pp. 27–50 (2002)

    Google Scholar 

  • Aiken, L.R.: Psychological Testing and Assessment, 5th edn. Allyn and Bacon, Boston (1985)

    Google Scholar 

  • Anderson, N., Lievens, F., van Dam, K., Ryan, A.M.: Future perspectives on employee selection: key directions for future research and practice. Appl. Psychol. Int. Rev. 53(4), 487–501 (2004)

    Article  Google Scholar 

  • Becker, T.E.: Development and validation of a situational judgment test of employee integrity. Int. J. Sel. Assess. 13(3), 225–232 (2005)

    Article  Google Scholar 

  • Butterfield, L.D., Borgen, W.A., Amundson, N.E., Maglio, A.T.: Fifty years of the critical incident technique: 1954–2004 and beyond. Qual. Res. 5(4), 475–497 (2005)

    Article  Google Scholar 

  • Christian, M.S., Edwards, B.D., Bradley, J.C.: Situational judgment tests: constructs assessed and a meta-analysis of their criterion-related validities. Pers. Psychol. 63(1), 83–117 (2010)

    Article  Google Scholar 

  • Dahlgaard-Park, S.M., Chen, C., Jang, J., Dahlgaard, J.J.: Diagnosing and prognosticating the quality movement – a review on the 25 years quality literature (1987–2011). Total. Qual. Manag. Bus. Excel. 24(1–2), 1–18 (2013)

    Article  Google Scholar 

  • Flanagan, J.C.: The critical incident technique. Psychol. Bull. 51(4), 327–358 (1954)

    Article  Google Scholar 

  • Fotopoulos, C.B., Psomas, E.L.: The impact of “soft” and “hard” TQM elements on quality management results. Int. J. Qual. Reliab. Manag. 26(2), 150–163 (2009)

    Article  Google Scholar 

  • Heine, I.: Quality orientation in middle management - development and validation of a situational judgment test, Dissertation RWTH Aachen University, Apprimus Verlag (2016)

    Google Scholar 

  • Heine, I., Schmitt, R., Beaujean, P.: Critical incidents of quality orientation in lower and middle management. TQM J. 28(5), 734–744 (2016)

    Article  Google Scholar 

  • Hubley, A.M., Zumbo, B.D.: Psychometric characteristics of assessment procedures: an overview. In: Geisinger, K.F., Bracken, B.A. (eds.) APA Handbooks in Psychology. APA Handbook of Testing and Assessment in Psychology, pp. 3–19. American Psychological Association, Washington, DC (2013)

    Google Scholar 

  • Kline, P.: The Handbook of Psychological Testing, 2nd edn. Routledge, London, New York (2000)

    Google Scholar 

  • Landis, J.R., Koch, G.G.: The measurement of observer agreement for categorical data. Biometrics 33(1), 159–174 (1977)

    Article  Google Scholar 

  • Lauver, K.J., Kristof-Brown, A.: Distinguishing between employees’ perceptions of person-job and person-organization fit. J. Vocat. Behav. 59(3), 454–470 (2001)

    Article  Google Scholar 

  • Lievens, F., Peeters, H., Schollaert, E.: Situational judgment tests: a review of recent research. Pers. Rev. 37(4), 426–441 (2008)

    Article  Google Scholar 

  • Martin, J., Fellenz, M.R.: Organizational Behaviour and Management, 4th edn. Cengage Learning, Andover (2010)

    Google Scholar 

  • McDaniel, M.A., Nguyen, N.T.: Situational judgment tests: a review of practice and constructs assessed. Int. J. Sel. Assess. 9(1–2), 103–113 (2001)

    Google Scholar 

  • Motowidlo, S.J., Dunnette, M.D.: An alternative selection procedure: the low-fidelity simulation. J. Appl. Psychol. 75(6), 640–647 (1990)

    Article  Google Scholar 

  • Ployhart, R.E., MacKenzie, W.I.: Situational judgment tests: a critical review and agenda for the future. In: Zedeck, S. (ed.) APA Handbook of Industrial and Organizational Psychology, Volume 2: Selecting and Developing Members for the Organization, pp. 237–252. American Psychological Association, Washington, DC (2011)

    Google Scholar 

  • Ployhart, R.E., Ward, A.: Situational judgment measures. In: Geisinger, K.F., Bracken, B.A. (eds.) APA Handbooks in Psychology. APA Handbook of Testing and Assessment in Psychology, pp. 551–564. American Psychological Association, Washington, DC (2013)

    Google Scholar 

  • Schmidt, F.L., Hunter, J.E.: The validity and utility of selection methods in personnel psychology: practical and theoretical implications of 85 years of research findings. Psychol. Bull. 124(2), 262–274 (1998)

    Article  Google Scholar 

  • Schmitt, R., Pfeifer, T.: Quality Management: Strategies, Methods, Techniques (Qualitätsmanagement: Strategien - Methoden – Techniken), 5th edn. Carl Hanser Verlag, MĂĽnchen (2015)

    Book  Google Scholar 

  • Urbina, S.: Essentials of Psychological Testing. Essentials of behavioral science series. Wiley, Hoboken (2004)

    Google Scholar 

  • Weekley, J.A., Ployhart, R.E.: Situational Judgment Tests: Theory, Measurement, and Application. SIOP Organizational Frontiers Series. Lawrence Erlbaum Associates, Mahwah (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Laboratory for Machine Tools and Production Engineering, RWTH Aachen University, Campus-Boulevard 30, 52074, Aachen, Germany

    Ina Heine & Robert Schmitt

Authors
  1. Ina Heine
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Robert Schmitt
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ina Heine .

Editor information

Editors and Affiliations

  1. University of Belgrade, Belgrade, Serbia

    Vidosav D. Majstorovic

  2. TU Wien, Vienna, Austria

    Numan Durakbasa

Appendix

Appendix

figure afigure afigure afigure afigure afigure a

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Heine, I., Schmitt, R. (2019). Measuring Quality Orientation in Organisations: A Cognitive-Behavioural Approach. In: Majstorovic, V., Durakbasa, N. (eds) Proceedings of the 12th International Conference on Measurement and Quality Control - Cyber Physical Issue. IMEKOTC14 2019. Lecture Notes in Mechanical Engineering. Springer, Cham. https://doi.org/10.1007/978-3-030-18177-2_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-18177-2_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-18176-5

  • Online ISBN: 978-3-030-18177-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation