Advertisement

Response style behavior: question format dependent or personal style?

  • 625 Accesses

  • 25 Citations

Abstract

In survey research, acquiescence response style/set (ARS) and extreme response style/set (ERS) may distort the measurement of attitudes. How response bias is evoked is still subject of research. A key question is whether it may be evoked by external factors (e.g. test conditions or fatigue) or whether it could be the result of internal factors (e.g. personality or social characteristics). In the first part of this study we explore whether scale length—the manipulated test condition—influences the occurrence of ERS and/or ARS, by varying scale length from 5 till 11 categories. In pursuit of this we apply a latent class factor model that allows for diagnosing and correcting for ERS and ARS simultaneously. Results show that ERS occurs regardless of scale length. Furthermore, we find only weak evidence of ARS. In a second step we check whether ERS might reflect an internal personal style by (a) linking it to external measures of ERS, and by (b) correlating it with a personality profile and socio-demographic characteristics. Results show that ERS is reasonably stable over questionnaires and that it is associated with the selected personality profile and age.

This is a preview of subscription content, log in to check access.

Access options

Buy single article

Instant unlimited access to the full article PDF.

US$ 39.95

Price includes VAT for USA

Subscribe to journal

Immediate online access to all issues from 2019. Subscription will auto renew annually.

US$ 99

This is the net price. Taxes to be calculated in checkout.

References

  1. Austin E.J., Deary I.J. and Egan V. (2006). Individual differences in response scale use: mixed Rasch modelling of responses to NEO-FFI items. Pers. Individ. Differ. 40: 1235–1245

  2. Billiet J.B. and Davidov E. (2008). Testing the stability of an acquiescence style factor behind two interrelated substantive variables in a panel design. Sociol. Methods Res. 36: 542–562

  3. Billiet J.B. and McClendon M.J. (2000). Modelling acquiescence in measurement models for two balanced sets of items. Struct. Equ. Model. 7: 608–628

  4. Bogner F.X. and Wiseman M. (1999). Towards measuring adolescent environmental perception. Eur. Psychol. 4: 139–151

  5. Bolt D.M. and Johnson T.R. (2009). Addressing score bias and differential item functioning due to individual differences in response style. Appl. Psychol. Meas. 33: 335–352

  6. Chen C., Lee S.-y. and Stevenson H.W. (1995). Response style and cross-cultural comparisons of rating scales among East Asian and North American students. Psychol. Sci. 6: 170–175

  7. Cheung G.W. and Rensvold R.B. (2000). Assessing extreme and acquiescence response sets in cross-cultural research using structural equations modeling. J. Cross-Cult. Psychol. 31: 187–212

  8. Couch A. and Keniston K. (1960). Yeasayers and naysayers: agreeing response set as a personality variable. J. Abnorm. Soc. Psychol. 60: 151–174

  9. De Jong M.G., Steenkamp J.-B.E.M., Fox J.-P. and Baumgartner H. (2008). Using item response theory to measure extreme response style in marketing research: a global investigation. J. Mark. Res. 45: 104–115

  10. Diamantopoulos A., Reynolds N.L. and Simintiras A.C. (2006). The impact of response styles on the stability of cross-national comparisons. J. Bus. Res. 59: 925–935

  11. DiStefano C. and Motl R.W. (2009). Personality correlates of method effects due to negatively worded items on the Rosenberg self-esteem scale. Pers. Individ. Differ. 46: 309–313

  12. Dolcinar S. and Grün B. (2007). Analytical robustness in cross-cultural comparisons. Int. J. Cult Tour. Hosp. Res. 1: 140–160

  13. Dolcinar S. and Grün B. (2009). Response style contamination of student evaluation data. J. Mark. Educ. 31: 160–172

  14. Gibbons J.L., Zellner J.A. and Rudek D.J. (1999). Effects of language and meaningfulness on the use of extreme response style by Spanish-English bilinguals. Cross-Cult. Res. 33: 369–381

  15. Greenleaf E.A. (1992). Measuring extreme response style. Public Opin. Q. 56: 328–351

  16. Hamilton D.L. (1968). Personality attributes associated with extreme response style. Psychol. Bull. 69: 192–203

  17. Harzing A.-W. (2006). Response styles in cross-national survey research: a 26-country study. Int. J. Cross-Cult. Manag. 6: 243–266

  18. Heide M. and Grønhaug K. (1992). The impact of response styles in surveys: a simulation study. J. Mark. Res. Soc. 34: 215–230

  19. Hui C.H. and Triandis H.C. (1989). Effects of culture and response format on extreme response style. J. Cross-Cult. Psychol. 20: 296–309

  20. Hurley J.R. (1998). Timidity as a response style to psychological questionnaires. J. Psychol. 132: 202–210

  21. Institute of Social and Political Opinion Research (ISPO): 1995 general election study Belgium-Flanders. http://www.data-archive.ac.uk/findingData (1997). Accessed 1 Oct 2009

  22. International Social Survey Programme (ISSP): family and gender roles III. http://www.issp.org/data.shtml (2002). Accessed 1 Oct 2009

  23. Johnson T.R., Kulesa P., Cho Y.I. and Shavitt S. (2005). The relation between culture and response styles: evidence from 19 countries. J. Cross-Cult. Psychol. 36: 264–277

  24. Kieruj, N.D., Moors, G.: Variations in response style behavior by response scale format in attitude research. Int. J. Public Opin. Res. http://ijpor.oxfordjournals.org/content/early/2010/07/23/ijpor.edq001.full.pdf+html (2010). Accessed 31 Aug 2010

  25. Knowles E.S. and Nathan K.T. (1997). Acquiescent responding in self-reports: cognitive style or social concern?. J. Res. Pers. 31: 293–301

  26. Koson D., Kitchen C., Kochen M. and Stodolosky D. (1970). Psychological testing by computer: effect on response bias. Educ. Psychol. Meas. 30: 808–810

  27. Krosnick J.A. (1991). Response strategies for coping with the cognitive demands of attitude measures in surveys. Appl. Cogn. Psychol. 5: 213–236

  28. Lewis N. and Taylor J. (1955). Anxiety and extreme response preferences. Edu. Psychol. Meas. 15: 111–116

  29. Marín G., Gamba R.J. and Marín B. (1992). Extreme response style and acquiescence among Hispanics. J. Cross-Cult. Psychol. 23: 498–509

  30. Meisenberg G. and Williams A. (2008). Are acquiescent and extreme response styles related to low intelligence and education?. Pers. Individ. Differ. 44: 1539–1550

  31. Moors G. (2003). Diagnosing response style behaviour by means of a latent class factor approach. Socio-demographic correlates of gender role attitudes and perceptions of ethnic discrimination re-examined. Qual. Quant. 37: 277–302

  32. Morren, M.: The survey response: a mixed method study of cross-cultural differences in responding to attitude statements (Doctoral dissertation). Tilburg University, Tilburg, The Netherlands (2011)

  33. Naemi, B.D.: Measuring and predicting extreme response style: a latent class approach. http://scholarship.rice.edu/bitstream/handle/1911/17901/1435749.PDF?sequence=1 (2006). Accessed 31 Aug 2010

  34. Naemi B.D., Beal D.J. and Payne S.C. (2009). Personality predictors of extreme response style. J. Pers. 77: 261–286

  35. Pedersen D.M. (1967). Acquiescence and social desirability response sets and some personality correlates. Edu. Psychol. Meas. 27: 691–697

  36. Rorer L.G. (1965). The great response-style myth. Psychol. Bull. 63: 129–156

  37. Shulman A. (1973). A comparison of two scales on extremity bias. Public Opin. Q. 37: 407–412

  38. Smith P.B. (2004). Acquiescent response bias as an aspect of cultural communication style. J. Cross-Cult. Psychol. 35: 50–61

  39. Thompson S.C.G. and Barton M. (1994). Ecocentric and anthropocentric attitudes toward the environment. J. Environ. Psychol. 14: 149–157

  40. Van Herk H., Poortinga Y.H. and Verhallen T.M.M. (2004). Response styles in rating scales: evidence of method bias in data from six EU countries. J. Cross-Cult. Psychol. 35: 346–360

  41. Van Rosmalen J., Van Herk H. and Groenen P.J.F. (2007). Identifying unknown response styles: a latent class bilinear multinomial logit model. J. Mark. Res. 47: 157–172

Download references

Author information

Correspondence to Natalia D. Kieruj.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Kieruj, N.D., Moors, G. Response style behavior: question format dependent or personal style?. Qual Quant 47, 193–211 (2013). https://doi.org/10.1007/s11135-011-9511-4

Download citation

Keywords

  • Extreme response style
  • Acquiescence response style
  • Attitude measurement
  • Personality
  • Format effects
  • Latent class factor analysis