Nonresponse in Employee Attitude Surveys: A Group-Level Analysis
- First Online:
- 1.4k Downloads
Given the common practice of using employee attitude surveys as a group-level intervention, this study used a group-level approach to examine the relationship between group satisfaction and group nonresponse.
Samples from four large organizations enabled job satisfaction scores to be aggregated to the work group level and correlated with group-level response rates. Additional regression analysis was conducted to control for a number of confounding variables at the group level.
Aggregate job satisfaction showed significant associations with group-level response rates across each of the samples examined. Work groups with higher aggregate job satisfaction had significantly higher response rates. Regression analyses showed that, in addition to job satisfaction, work group size, heterogeneity in tenure, and heterogeneity in gender composition all had significant effects on response rates.
Social influence processes may operate at the group level to increase homogeneity of job-relevant attitudes and similarity in survey response behavior. Future research should be designed to investigate the effects of group-level variables on nonresponse.
The current study adds to the literature by demonstrating that work group variables may play an important role in explaining nonresponse in employee attitude surveys. Because the processes underlying survey response are likely to be different at different levels of analysis, the investigation of nonresponse as a group-level phenomenon creates new opportunities for research and practice.
KeywordsSurvey nonresponse Organizational survey Group level Job satisfaction Organizational attitudes Survey feedback
- Blau, P. M. (1977). Inequality and heterogeneity: A primitive theory of social structure. New York: Free Press.Google Scholar
- Bliese, P. D. (2000). Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 349–381). San Francisco: Jossey-Bass.Google Scholar
- Bliese, P. D., & Halverson, R. R. (1998). Group size and measures of group-level properties: An examination of eta-squared and ICC values. Journal of Management, 24, 157–172.Google Scholar
- Bosnjak, M., & Batinic, B. (2002). Understanding the willingness to participate in online surveys—The case of e-mail questionnaires. In B. Batinic, U. Reips, & M. Bosnjak (Eds.), Online social sciences (pp. 81–92). Seattle, WA: Hogrefe & Huber.Google Scholar
- Burke, W. W. (2006). Organizational survey as leverage for organization development and change. In A. I. Kraut (Ed.), Organizational surveys: Tools for assessment and change (pp. 131–149). San Francisco: Jossey-Bass.Google Scholar
- Burke, W. W., Coruzzi, C. A., & Church, A. H. (1996). The organizational survey as an intervention for change. In A. I. Kraut (Ed.), Organizational surveys: Tools for assessment and change (pp. 41–66). San Francisco: Jossey-Bass.Google Scholar
- Church, A. H., & Oliver, D. H. (2006). The importance of taking action, not just sharing survey feedback. In A. I. Kraut (Ed.), Getting action from organizational surveys: New concepts, technologies, and applications (pp. 33–52). San Francisco: Jossey-Bass.Google Scholar
- Church, A. H., & Waclawski, J. (1998). Designing and using organizational surveys. Aldershot: Gower.Google Scholar
- Cialdini, R. B., & Trost, M. R. (1998). Social influence: Social norms, conformity, and compliance. In D. Gilbert, S. Fiske, & G. Lindzey (Eds.), The handbook of social psychology (4th ed., Vol. 2, pp. 151–192). New York: McGraw-Hill.Google Scholar
- Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences. Mahwah, NJ: Lawrence Erlbaum.Google Scholar
- Dillman, D. A. (2000). Mail and internet surveys: The tailored design method. New York: Wiley.Google Scholar
- Edwards, J. E., Thomas, M. D., Rosenfeld, O., & Booth-Kewley, S. (1997). How to conduct organizational surveys. A step-by-step guide. London: Sage.Google Scholar
- Falletta, S. V., & Combs, W. (2002). Surveys as a tool for organization development and change. In J. Waclawski & A. H. Church (Eds.), Organization development: A data-driven approach to organizational change (pp. 78–102). San Francisco: Jossey-Bass.Google Scholar
- Folkman, J. (1998). Employee surveys that make a difference. Provo, UT: Executive Excellence.Google Scholar
- French, W., & Bell, C. (1999). Organization development: Behavioural science interventions for organization improvement. New Jersey: Prentice Hall.Google Scholar
- Glick, W. H. (1985). Conceptualizing and measuring organizational and psychological climate: Pitfalls in multilevel research. Academy of Management Review, 10, 601–616.Google Scholar
- Harter, J. K., & Schmidt, F. L. (2006). Connecting employee satisfaction to business unit performance. In A. I. Kraut (Ed.), Getting action from organizational surveys: New concepts, technologies, and applications (pp. 102–130). San Francisco: Jossey-Bass.Google Scholar
- Hinrichs, J. R. (1996). Feedback, action planning, and follow-through. In A. I. Kraut (Ed.), Organizational surveys: Tools for assessment and change (pp. 255–278). San Francisco: Jossey-Bass.Google Scholar
- Hogg, M. A., & Abrams, D. (1988). Social identifications: A social psychology of intergroup relations and group processes. London: Routledge.Google Scholar
- Jackson, S. E. (1992). Team composition in organizational settings: Issues in managing an increasingly diverse work force. In S. Worchel, W. Wood, & J. A. Simpson (Eds.), Group process and productivity (pp. 138–173). Newbury Park: Sage.Google Scholar
- Klein, K. J., Dansereau, F., & Hall, R. I. (1994). Levels issues in theory development, data collection, and analysis. Academy of Management Review, 19, 195–229.Google Scholar
- Kraut, A. (2006). Getting action from organizational surveys: New concepts, technologies and applications. San Francisco: Jossey Bass.Google Scholar
- Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.Google Scholar
- McConnell, J. H. (2003). How to design, implement, and interpret an employee survey. New York: Amacom.Google Scholar
- McDaniel, S., Madden, C. S., & Verille, P. (1987). Do topic differences affect survey nonresponse? Journal of the Market Research Society, 29, 55–67.Google Scholar
- Mueller, K., Hattrup, K., & Straatmann, T. (2011). Globally surveying in English: Investigation of the measurement equivalence of a job satisfaction measure across bilingual and native English speakers. Journal of Occupational and Organizational Psychology, 84, 618–624.Google Scholar
- Nadler, D. A. (1977). Feedback and organization development: Using data-based methods in organization development. Reading, MA: Addison-Wesley.Google Scholar
- Nesterkin, D. A., & Ganster, D. C. (2012). The effects of nonresponse rates on group-level correlations. Journal of Management. doi:10.1177/0149206311433853.
- Newman, J. E. (1975). Understanding the organizational structure—Job attitude relationship through perceptions of the work environment. Organizational Behavior and Human Decision Processes, 14, 371–397.Google Scholar
- Organ, D. W., Podsakoff, P. M., & MacKenzie, S. B. (2006). Organizational citizenship behavior: Its nature, antecedents and consequences. Thousand Oaks, CA: Sage.Google Scholar
- Rogelberg, S. G. (Ed.). (2002). Handbook of research methods in industrial and organizational psychology. London: Blackwell.Google Scholar
- Rogelberg, S. G. (2006). Understanding nonresponse and facilitating response to organizational surveys. In A. I. Kraut (Ed.), Getting action from organizational surveys: New concepts, technologies, and applications (pp. 312–325). San Francisco: Jossey-Bass.Google Scholar
- Schiemann, W., & Morgan, B. (2006). Strategic surveys: Linking people to business strategy. In A. Kraut (Ed.), Getting action from organizational surveys: New concepts, technologies, and applications (pp. 76–100). San Francisco: Jossey-Bass.Google Scholar
- Smith, P. B. (2003). Meeting the challenge of cultural difference. In D. Tjosvold & K. Leung (Eds.), Cross-cultural management: Foundation and future (pp. 59–73). Aldershot: Ashgate.Google Scholar
- Smith, P. C., Kendall, L. M., & Hulin, C. L. (1985). The job descriptive index (rev. ed.). Bowling Green, OH: Department of Psychology, Bowling Green State University.Google Scholar
- Spitzmueller, C., & Glenn, D. M. (2006). Nonresponse in employee surveys—A review and directions for future work. In M. Braun (Ed.), Survey methodology (pp. 139–162). Mannheim: ZUMA Press.Google Scholar
- Tajfel, H., & Turner, J. C. (1979). An integrative theory of intergroup conflict. In W. G. Austin & S. Worchel (Eds.), The social psychology of intergroup relations (pp. 33–47). Monterey, CA: Brooks/Cole.Google Scholar
- Turner, J. C. (1982). Towards a cognitive redefinition of the social group. In H. Tajfel (Ed.), Social identity and intergroup relations (pp. 15–40). Cambridge: Cambridge University Press.Google Scholar
- Whelan, T. J. (2008). Antecedents of anonymity perceptions in web-based surveys. Paper presented at the 23rd Annual Meeting of the Society for Industrial and Organizational Psychology, San Francisco, CA.Google Scholar
- Williams, R. (2007). Achieving leadership results through employee surveys. Delta, BC, Canada: TWI Surveys.Google Scholar