Skip to main content

How to Measure Contact Center Skills Using Multimedia Simulations

  • Chapter
  • First Online:
Simulations for Personnel Selection

Abstract

Connecting frequently and cost-effectively with current and prospective customers are strategic imperatives for many companies. Employees must possess a variety of KSAOs to navigate the fast-paced training, difficult customer interactions, and sophisticated technology that often characterize contact center work. Consequently, many companies have turned to multimedia contact center simulations to improve hiring and placement accuracy. Modern simulations allow candidates to play the part of a representative in a fictitious contact center, which gives a company insight into a candidate’s job-specific skills. This chapter reviews the evolution of contact center simulations, from their auspicious beginning to the central role they currently play helping the global contact center industry identify, hire, and place job candidates. Special attention is given to the design, production, and accompanying validation research underlying contact center simulations.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  • Anderson, N., Salgado, J. F., & Hulsheger, U. R. (2010). Applicant reactions in selection: Comprehensive meta-analysis into reaction generalization versus situational specificity. International Journal of Selection and Assessment, 18, 291–304.

    Google Scholar 

  • Bagnara, S. (2000). Towards telework in call centers. http://www.telework-mirti.org/bagnara.htm. Accessed 1 Feb 2013.

  • Bakker, A. B., Demerouti, E., & Schaufeli, W. B. (2003). Dual processes at work in a call centre: An application of the job demands—resources model. European Journal of Work and Organizational Psychology, 12, 393–417.

    Google Scholar 

  • Barak, A., & English, N. (2002). Prospects and limitations of psychological testing on the internet. Journal of Technology in Human Services, 19, 65–89.

    Google Scholar 

  • Barrick, M. R., Mount, M. K., & Judge, T. A. (2001). Personality and performance at the beginning of the new millennium: What do we know and where do we go next? International Journal of Selection and Assessment, 9(1/2), 9–29.

    Google Scholar 

  • Batt, R. (2002). Managing customer services: Human resources practices, quit rates, and sales growth. Academy of Management Journal, 3, 579–597.

    Google Scholar 

  • Batt, R., Doellgast, V., & Kwon, H. (2004). The U.S. call center industry 2004: National benchmarking report. Ithaca, NY: Global Call Center Network.

    Google Scholar 

  • Bobko, P., Roth, P. L., & Buster, M. A. (2005). Work sample selection tests and expected reduction in adverse impact: A cautionary note. International Journal of Selection and Assessment, 13, 1–10.

    Google Scholar 

  • Bray, D. W., & Grant, D. L. (1966). The assessment center in the measurement of potential for business management. Psychological Monographs: General and Applied, 80, 1–27.

    Google Scholar 

  • Burgess, J., & Connell, J. (2004). Emerging developments in call center research. Labor and Industry, 14(3),1–14.

    Google Scholar 

  • Callaghan, G., & Thompson, P. (2001). Edwards revisited: Technical control and call centers. Economic and Industrial Democracy, 22, 13–37.

    Google Scholar 

  • Callinan, M., & Robertson, I. T. (2000). Work sample testing. International Journal of Selection and Assessment, 8, 248–260.

    Google Scholar 

  • Cascio, W. F., & Phillips, N. F. (1979). Performance testing: A rose among thorns? Personnel Psychology, 32, 751–766.

    Google Scholar 

  • Chi, N., Grandey, A. A., Diamond, J. A., & Krimmel, K. R. (2011). Want a tip? Service performance as a function of emotion regulation and extraversion. Journal of Applied Psychology, 96, 1337–1346.

    Google Scholar 

  • Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334.

    Google Scholar 

  • Dunnette, M. D. (1966). Personnel Selection and Placement. Oxford: Wadsworth.

    Google Scholar 

  • Ellis, V., & Taylor, P. (2006). You don’t know what you’ve got till it’s gone: Recontextualising the origins, development and impact of the call centre. New Technology, Work and Employment, 21, 107–122.

    Google Scholar 

  • Equal Employment Opportunity Commission (1978). Uniform guidelines on employee selection procedures. Federal Register, 43, 38, 290–38, 315.

    Google Scholar 

  • Fluck, A., Pullen, D., & Harper, C. (2009). Case study of a computer based examination system. Australasian Journal of Educational Technology, 25, 509–523.

    Google Scholar 

  • Frisch, M. H. (1998). Designing the individual assessment process. In R. Jeanneret, & R. Silzer (Eds.), Individual psychological assessment (pp. 135–177). San Francisco, CA: Jossey-Bass.

    Google Scholar 

  • FurstPerson. (2006). CC Audition technical manual. Chicago: Author.

    Google Scholar 

  • FurstPerson. (2012). Pre-hire assessment completion rate report. Chicago: Author.

    Google Scholar 

  • Gael, S., & Grant, D. L. (1972). Employment test validation for minority and nonminority telephone company service representatives. Journal of Applied Psychology, 56, 135–139.

    Google Scholar 

  • Gael, S., Grant, D. L., & Ritchie, R. J. (1975). Employment test validation for minority and nonminority telephone operators. Journal of Applied Psychology, 60, 411–419.

    Google Scholar 

  • Garland, S. (2012). New online tests hold promise, perils. The Hechinger Report. http://hechingerreport.org/content/new-online-tests-hold-promise-perils_8885/. Accessed 1 Feb 2013.

  • Gaugler, B. B., Rosenthal, D. B., Thornton III, G. C., & Bentson, C. (1987). Meta-analysis of assessment center validity. Journal of Applied Psychology, 72, 493–511.

    Google Scholar 

  • Gilson, K. A., & Khandelwal, D. K. (2005). Getting more from call centers. The McKinsey Quarterly. Nov 22, 1–8.

    Google Scholar 

  • Goldberg, L. S., & Grandey, A. A. (2007). Display rules versus display autonomy: Emotion regulation, emotional exhaustion, and task performance in a call center simulation. Journal of Occupational Health Psychology, 12, 301–318.

    Google Scholar 

  • Guion, R. M. (1967). Personnel selection. In P. R. Farnsworth, O. McNemar, & Q. McNemar (Eds.), Annual review of psychology (pp. 191–216). Palo Alto, CA: Annual Reviews.

    Google Scholar 

  • Guion, R. M. (1998). Assessment, measurement, and prediction for personnel decisions. Mahwah, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Hattrup, K., & Schmitt, N. (1990). Prediction of trades apprentices’ performance on job sample criteria. Personnel Psychology, 43(3), 454–466.

    Google Scholar 

  • Hauptfleisch, S., & Uys, J. (2006). The experience of work in a call centre environment. SA Tydskrif vir Bedryfsielkunde, 32(2),23–30.

    Google Scholar 

  • Hausknecht, J. P., Day, D. V., & Thomas, S. C. (2004). Applicant reactions to selection procedures: An updated model and meta-analysis. Personnel Psychology, 57(3), 639–683.

    Google Scholar 

  • Hawkes, B. (2013). Simulation Technologies. In M. S. Fetzer, & K. A. Tuzinski (Eds.), Simulations for employee personnel selection. New York: Springer.

    Google Scholar 

  • Holland, B., & Lambert, D. (2008). Contact Center Job Analysis Survey. Chicago, IL: FurstPerson, Inc.

    Google Scholar 

  • Holland, B., & Lambert, D. (2011). CC Audition technical manual (2nd ed.). Chicago, IL: FurstPerson, Inc.

    Google Scholar 

  • Holman, D. J. (2002). Employee well-being in call centers. Human Resources Management Journal, 12, 35–50.

    Google Scholar 

  • Holman, D. J. (2003). Call centers. In D. J. Holman, T. D. Wall, C. W. Glegg, P. Sparrow, & A. Howard (Eds.), The new workplace: A guide to the human impact of modern working practices. Chichester, UK: Wiley.

    Google Scholar 

  • Holman, D. J., Chissick, C., & Totterdell, P. (2002). The effects of performance monitoring on emotional labor and well-being in call centers. Motivation and Emotion, 26, 57–81.

    Google Scholar 

  • Holman, D., Batt, R., & Holtgrewe, U. (2007). The global call center report: International perspectives on management and employment. Sheffield. UK: Global Call Center Network.

    Google Scholar 

  • Hunter, J. E. (1983). A causal analysis of cognitive ability, job knowledge, and job performance, and supervisory ratings. In R. Landy, S. Zedeck, & J. Cleveland (Eds.), Performance measurement and theory (pp. 257–266). NJ: Erlbaum.

    Google Scholar 

  • Hunter, J. E., & Hunter, R. F. (1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72–98.

    Google Scholar 

  • Jeanneret, R., & Silzer, R. (1998). An overview of individual psychological assessment. In Jeanneret, R., & Silzer, R. (Eds.), Individual psychological assessment (pp. 3–26). San Francisco, CA: Jossey-Bass.

    Google Scholar 

  • Knights, D., & McCabe, D. (1998). When ‘Life is but a Dream’: Obliterating politics through business process reengineering. Human Relations, 51, 761–798.

    Google Scholar 

  • Lievens, F., & De Soete, B. (2012). Simulations. In N. Schmitt (Ed.), The Oxford handbook of personnel assessment and selection (pp. 383–410). New York: Oxford UP.

    Google Scholar 

  • Loveman, G. W. (1998). Employee satisfaction, customer loyalty, and financial performance: An empirical examination of the service profit chain in retail banking. Journal of Service Research, 1(1), 18–31.

    Google Scholar 

  • McCulloch, M. C., & Turban, D. B. (2007). Using person-organization fit to select employees for high-turnover jobs. International Journal of Selection and Assessment, 15, 63–71.

    Google Scholar 

  • McDaniel, M. A., Morgeson, F. P., Finnegan, E. B., Campion, M. A., & Braverman, E. P. (2001). Use of situational judgment tests to predict job performance: A clarification of the literature. Journal of Applied Psychology, 86, 730–740.

    Google Scholar 

  • McDaniel, M. A., Whetzel, D. L., Schmidt, F. L., & Maurer, S. D. (1994). The validity of employment interviews: A comprehensive review and meta-analysis. Journal of Applied Psychology, 79(4), 599–616.

    Google Scholar 

  • Merchant, L. (1998). The 1998 international call centre benchmarking report. Author.

    Google Scholar 

  • Motowidlo, S. J., Dunnette, M. D., & Carter, G. W. (1990). An alternative selection procedure: The low-fidelity simulation. Journal of Applied Psychology, 75(6), 640–647.

    Google Scholar 

  • Murthy, N. N., Challagalla, G. N., Vincent, L. H., & Shervani, T. A. (2008). The impact of simulation training on call center agent performance: A field-based investigation. Management Science, 54, 384–399.

    Google Scholar 

  • Norling, P. (2001). Call centre companies and news patterns of organization. Economic and Industrial Democracy, 22, 155–168.

    Google Scholar 

  • Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.

    Google Scholar 

  • O’Leary, L. R. (1973). Fair employment, sound psychometric practice, and reality: A dilemma and partial solution. American Psychologist, 28, 147–150.

    Google Scholar 

  • Pearlman, K., Schmidt, F. L., & Hunter, J. E. (1980). Validity generalization results for tests used to predict job proficiency and training success in clerical occupations. Journal of Applied Psychology, 65(4), 373–406.

    Google Scholar 

  • Ployhart, R. E., & Holtz, B. C. (2008). The diversity-validity dilemma: Strategies for reducing racioethnic and sex sub-group differences and adverse impact in selection. Personnel Psychology, 61, 153–172.

    Google Scholar 

  • Ployhart, R. E., Schneider, B., & Schmitt, N. (2006). Staffing organizations: Contemporary practice and research. Mahwah, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Pulakos, E. D., & Schmitt, N. (1996). An evaluation of two strategies for reducing adverse impact and their effects on criterion-related validity. Human Performance, 9(3), 241–258.

    Google Scholar 

  • Reilly, R. R., & Warech, M. A. (1993). The validity and fairness of alternatives to cognitive ability tests. In L. Wing, & B. Gifford (Eds.), Policy issues in employment testing. Boston: Kluwer.

    Google Scholar 

  • Robertson, I. T., & Kandola, R. S. (1982). Work sample tests: Validity, adverse impact and application reaction. Journal of Occupational Psychology, 55, 171–183.

    Google Scholar 

  • Roth, P. L., Bobko, P., & McFarland, L. A. (2005). A meta-analysis of work sample test validity: Updating and integrating some classic literature. Personnel Psychology, 58, 1009–1037.

    Google Scholar 

  • Roth, P. L., Bobko, P., McFarland, L. A., & Buster, M. (2008). Work sample tests in personnel selection: A meta-analysis of black-white differences in overall and exercise scores. Personnel Psychology, 61, 637–661.

    Google Scholar 

  • Roth, P. L., Buster, M. A., & Barnes-Farrell, J. (2010). Work sample exams and gender adverse impact potential: The influence of self-concept, social skills, and written skills. International Journal of Selection and Assessment, 18, 117–130.

    Google Scholar 

  • Rothstein, H. R., Schmidt, F. L., Erwin, F. W., Owens, W. A., & Sparks, C. P. (1990). Biographical data in employment selection: Can validities be made generalizable? Journal of Applied Psychology, 75(2), 175–184.

    Google Scholar 

  • Rupp, D. E., & Spencer, S. (2006). When customers lash out: The effects of customer interactional justice on emotional labor and the mediating role of discrete emotions. Journal of Applied Psychology, 91, 971–978.

    Google Scholar 

  • Russell, B. (2008). Call centers: A decade of research. International Journal of Management Reviews, 10(3), 195–219.

    Google Scholar 

  • Sawyerr, O. O., Srinivas, S., & Wang, S. (2009). Call center employee personality factors and service performance. Journals of Services Marketing, 23, 301–317.

    Google Scholar 

  • Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262–274.

    Google Scholar 

  • Schmidt, F. L., Oh, I., & Le, H. (2006). Increasing the accuracy of corrections for range restriction: Implications for selection procedure validities and other research results. Personnel Psychology, 59, 281–305.

    Google Scholar 

  • Schmitt, N., & Mills, A. E. (2001). Traditional tests and job simulations: Minority and majority performance and test validities. Journal of Applied Psychology, 86(3), 451–458.

    Google Scholar 

  • Schmitt, N., Clause, C. S., & Pulakos, E. D. (1996). Subgroup differences associated with different measures of some common job-relevant constructs. In C. L. Cooper, & I. T. Robertson (Eds.), International review of industrial and organizational psychology Vol. 11. Chichester, UK: Wiley.

    Google Scholar 

  • Schmitt, N., Gooding, R. Z., Noe, R. A., & Kirsch, M. (1984). Meta-analyses of validity studies published between 1964 and 1982 and the investigation of study characteristics. Personnel Psychology, 37, 407–422.

    Google Scholar 

  • Society for Industrial and Organizational Psychology. (2003). Principles for the Validation and Use of Personnel Selection Procedures (4th ed.). Bowling Green, OH: Author.

    Google Scholar 

  • Sprigg, C. A., & Jackson, P. R. (2006). Call centers as lean service environments: Job-related strain and the mediating role of work design. Journal of Occupational Health Psychology, 11, 197–212.

    Google Scholar 

  • Sprigg, C. A., Stride, C. B., Wall, T. D., Holman, D. J., & Smith, P. R. (2007). Work characteristics, musculoskeletal disorders, and the mediating role of psychological strain: A study of call center employees. Journal of Applied Psychology, 92, 1456–1466.

    Google Scholar 

  • Taylor, P. D., & Bain, P. (2005). India calling to the far away towns: The call centre labor process and globalization. Work, Employment and Society, 19, 261–282.

    Google Scholar 

  • Taylor, P. D., Baldry, C., Bain, P., & Ellis, V. (2003). ‘A unique working environment’: Health, sickness and absence management in UK call centers. Work, Employment and Society, 17, 435–458.

    Google Scholar 

  • Terpstra, D. E., Mohamed, A., & Kethley, R. B. (1999). An analysis of federal court cases involving nine selection devices. International Journal of Selection and Assessment, 7, 26–34.

    Google Scholar 

  • Tippins, N. T., Beaty, J., Drasgow, F., Gibson, W. M., Pearlman, K., Segall, D. O., & Shepherd, W. (2006). Unproctored internet testing in employment settings. Personnel Psychology, 59, 189–225.

    Google Scholar 

  • U.S. Department of Commerce. (2011). Exploring the digital nation: Computer and internet use at home. Washington, DC: Author.

    Google Scholar 

  • U.S. Department of Labor, Employment and Training Administration. (2000). Testing and assessment: An employer ’s guide to good practices. Washington, DC: Author.

    Google Scholar 

  • van der Linden, D., te Nijenhuis, J., & Bakker, A. B. (2010). The General Factor of Personality: A meta-analysis of Big Five intercorrelations and a criterion-related validity study. Journal of Research in Personality, 44, 315–327.

    Google Scholar 

  • Van Gass, C. (2003, May 7). Call centre industry finds SA’s pulse. Africa News Service (online). http://allafrica.com/stories/200305070615.html. Accessed on 1 Feb 2013.

  • Vance, R. J., Coovert, M. D., MacCallum, R. C., & Hedge, J. W. (1989). Construct models of task performance. Journal of Applied Psychology, 74(3), 447–455.

    Google Scholar 

  • Wernimont, P. F., & Campbell, J. P. (1968). Signs, samples, and criteria. Journal of Applied Psychology, 52, 372–376.

    Google Scholar 

  • Wickham, M., & Collins, G. (2004). The call centre: A nursery for new forms of work organization? The Services Industry Journal, 24(1), 1–18.

    Google Scholar 

  • Zapf, D., Isic, A., Bechtoldt, M., & Blau, P. (2003). What is typical for call centre jobs? Job characteristics and service interactions in different call centers. European Journal of Work and Organizational Psychology, 12, 311–340.

    Google Scholar 

  • Zapf, D., Vogt, C., Seifert, C., Mertini, H., & Isic, A. (1999). Emotion work as a source of stress: The concept and development of an instrument. European Journal of Work and Organizational Psychology, 8, 370–400.

    Google Scholar 

  • Zyphur, M. J., Warren, C. R., Landis, R. W., & Thoresen, C. J. (2007). Self-regulation and performance in high-fidelity simulations: An extension of ego-depletion research. Human Performance, 20, 103–118.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Brent Holland .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this chapter

Cite this chapter

Holland, B., Lambert, D. (2013). How to Measure Contact Center Skills Using Multimedia Simulations. In: Fetzer, M., Tuzinski, K. (eds) Simulations for Personnel Selection. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-7681-8_7

Download citation

Publish with us

Policies and ethics