Scale development research in nonprofit management & marketing: a content analysis and recommendation for best practices

Original Article

Abstract

The authors report a content analysis on scale development studies in nonprofit management and marketing. The authors analyze and discuss characteristics of the procedures used in these studies with respect to construct conceptualization, the relationship between construct and measurement model, item generation and refinement, sampling, analysis, and reporting. A variety of practices in this body of research were at variance with the current scale development literature. The authors include recommendations for best practices in further research.

Keywords

Scale development Nonprofit management Nonprofit marketing EFA CFA 

References

  1. Anderson JC, Gerbing DW (1984) The effects of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis. Psychometrika 49(2):155–173CrossRefGoogle Scholar
  2. Anderson JC, Gerbing DW (1991) Predicting the performance of measures in a confirmatory factor analysis with a pretest assessment of their substantive validity. J Appl Psychol 76(5):732–740CrossRefGoogle Scholar
  3. Arnett DB, German SD, Hunt SD (2003) The identity salience model of relationship marketing success: the case of nonprofit marketing. J Mark 67(2):89–105CrossRefGoogle Scholar
  4. Bagozzi RP, Yi Y (2012) Specification, evaluation, and interpretation of structural equation models. J Acad Mark Sci 40(1):8–34CrossRefGoogle Scholar
  5. Bales K (1996) Measuring the propensity to volunteer. Soc Policy Adm 30(3):206–226CrossRefGoogle Scholar
  6. Bearden WO, Netemeyer RG, Haws KL (2011) Handbook of marketing scales: multi-item measures for marketing and consumer behavior research, 3rd edn. Sage, Thousand OaksGoogle Scholar
  7. Bekkers R (2010) Journals in philanthropic studies. (Unpublished report, available by contacting author at r.bekkers@vu.nl)Google Scholar
  8. Bennett R, Gabriel H (2003) Image and reputational characteristics of UK charitable organizations: an empirical study. Corp Reput Rev 6(3):276–289CrossRefGoogle Scholar
  9. Bonner PG, George WR (1988) An image scale for nonprofit voluntary organizations. Nonprofit Volunt Sect Q 17(3–4):70–80CrossRefGoogle Scholar
  10. Bruner GC (ed) (2009) Marketing scales handbook: a compilation of multi-item measures for consumer behavior & advertising research (Vol 5). GCBII Productions, CarbondaleGoogle Scholar
  11. Chin WW (1998) Issues and opinion on structural equation modeling. MIS Q 22(1):vii–xviGoogle Scholar
  12. Churchill GA (1979) A paradigm for developing better measures of marketing constructs. J Mark Res 16(1):64–73CrossRefGoogle Scholar
  13. Clark L, Watson D (1995) Constructing validity: basic issues in objective scale development. Psychol Assess 7(3):309–319CrossRefGoogle Scholar
  14. Clary EG, Snyder M, Ridge RD, Copeland J, Stukas AA, Haugen J, Miene P (1998) Understanding and assessing the motivations of volunteers: a functional approach. J Personal Soc Psychol 74(6):1516–1530CrossRefGoogle Scholar
  15. Cnaan RA, Goldberg-Glen RS (1991) Measuring motivation to volunteer in human services. J Appl Behav Sci 27(3):269–284CrossRefGoogle Scholar
  16. Coltman T, Devinney TM, Midgley DF, Venaik S (2008) Formative versus reflective measurement models: two applications of formative measurement. J Bus Res 61(12):1250–1262CrossRefGoogle Scholar
  17. Coryn CLS, Schröter DC, Hanssen CE (2009) Adding a time-series design element to the success case method to improve methodological rigor an application for nonprofit program evaluation. Am J Eval 30(1):80–92CrossRefGoogle Scholar
  18. de Chernatony L, Riley FDO (1998) Defining a“ brand”: beyond the literature with experts’ interpretations. J Mark Manag 14(5):417–443CrossRefGoogle Scholar
  19. Deshpandé R, Farley JU (1998) Measuring market orientation: generalization and synthesis. J Mark-Focus Manag 2(3):213–232Google Scholar
  20. DeVellis RF (2012) Scale development: theory and applications, 3rd edn. Sage, Thousand OaksGoogle Scholar
  21. Diamantopoulos A (2005) The C-OAR-SE procedure for scale development in marketing: a comment. Int J Res Mark 22(1):1–9CrossRefGoogle Scholar
  22. Diamantopoulos A, Siguaw JA (2006) Formative versus reflective indicators in organizational measure development: a comparison and empirical illustration. Br J Manag 17(4):263–282CrossRefGoogle Scholar
  23. Diamantopoulos A, Winklhofer HM (2001) Index construction with formative indicators: an alternative to scale development. J Mark Res 38(2):269–277CrossRefGoogle Scholar
  24. Diamantopoulos A, Riefler P, Roth KP (2008) Advancing formative measurement models. J Bus Res 61(12):1203–1218CrossRefGoogle Scholar
  25. Dillon WR, Kumar A, Mulani N (1987) Offending estimates in covariance structure analysis: comments on the causes of and solutions to Heywood cases. Psychol Bull 101(1):126–135CrossRefGoogle Scholar
  26. Donaldson LP, Shields J (2009) Development of the policy advocacy behavior scale: initial reliability and validity. Res Soc Work Pract 19(1):83–92CrossRefGoogle Scholar
  27. Duarte PO, Alves HB, Raposo MB (2010) Understanding university image: a structural equation model approach. Int Rev Publ Nonprofit Mark 7(1):21–36CrossRefGoogle Scholar
  28. Ewing MT, Napoli J (2005) Developing and validating a multidimensional nonprofit brand orientation scale. J Bus Res 58(6):841–853CrossRefGoogle Scholar
  29. Farrell AM, Rudd JM (2009). Factor analysis and discriminant validity: a brief review of some practical issues. Paper presented at the Australian & New Zealand Marketing Academy (ANZMAC) Conference 2009, Melbourne, Australia. Retrieved from http://www.duplication.net.au/ANZMAC09/papers/ANZMAC2009-389.pdf
  30. Farrell AM, Souchon AL, Durden GR (2003) The service leadership scale: A substantive validity test. Paper presented at the Australian & New Zealand Marketing Academy (ANZMAC) Conference 2003, Adelaide, Australia. Retrieved from http://eprints.aston.ac.uk/2917/1/service_leadership_farrell.pdf
  31. Fornell C, Larcker DF (1981) Evaluating structural equation models with unobservable variables and measurement error. J Mark Res 18(1):39–50CrossRefGoogle Scholar
  32. Frans DJ (1993) A scale for measuring social worker empowerment. Res Soc Work Pract 3(3):312–328CrossRefGoogle Scholar
  33. Gallagher K, Weinberg CB (1991) Coping with success: new challenges for nonprofit marketing. Sloan Manag Rev 33(1):27–42Google Scholar
  34. Hair J, Anderson R, Tatham R, Black W (2009) Multivariate data analysis, 7th edn. Prentice-Hall, Upper Saddle RiverGoogle Scholar
  35. Hair JF, Ringle CM, Sarstedt M (2011) PLS-SEM: indeed a silver bullet. J Mark Theory Pract 19(2):139–152CrossRefGoogle Scholar
  36. Hardesty DM, Bearden WO (2004) The use of expert judges in scale development. J Bus Res 57(2):98–107CrossRefGoogle Scholar
  37. Haynes SN, Richard D, Kubany ES (1995) Content validity in psychological assessment: a functional approach to concepts and methods. Psychol Assess 7(3):238–247CrossRefGoogle Scholar
  38. Haynes SN, Nelson K, Blaine DD (1999) Psychometric issues in assessment research. In: Kendall PC, Butler JN, Hombeck G (eds) Handbook of research methods in clinical psychology. Wiley, New York, pp 125–154Google Scholar
  39. Helm S (2007) Social entrepreneurship: defining the nonprofit behavior and creating an instrument for measurement. (Unpublished doctoral dissertation). University of Missouri-Kansas City, School of Public Affairs and Administration in EconomicsGoogle Scholar
  40. Helmig B, Thaler J (2010) Nonprofit marketing. In: Taylor R (ed) Third sector research. Springer, New York, pp 151–169CrossRefGoogle Scholar
  41. Hinkin TR (1995) A review of scale development practices in the study of organizations. J Manag 21(5):967–988CrossRefGoogle Scholar
  42. Holden RR, Jackson DN (1979) Item subtlety and face validity in personality assessment. J Consult Clin Psychol 47(3):459–468CrossRefGoogle Scholar
  43. Holland TP (1991) Self–assessment by nonprofit boards. Nonprofit Manag Leadersh 2(1):25–36CrossRefGoogle Scholar
  44. Homburg C, Pflesser C (2000) A multiple-layer model of market-oriented organizational culture: measurement issues and performance outcomes. J Mark Res 37(4):449–462CrossRefGoogle Scholar
  45. Hsieh J, Curtis KP, Smith AW (2008) Implications of stakeholder concept and market orientation in the U.S. nonprofit arts context. Int Rev Publ Nonprofit Mark 5(1):1–13CrossRefGoogle Scholar
  46. Hunt SD (1976) The nature and scope of marketing. J Mark 40(3):17–28CrossRefGoogle Scholar
  47. Inglis S, Cleave S (2006) A scale to assess board member motivations in nonprofit organizations. Nonprofit Manag Leadersh 17(1):83–101CrossRefGoogle Scholar
  48. Jackson DL (2001) Sample size and number of parameter estimates in maximum likelihood confirmatory factor analysis: a Monte Carlo investigation. Struct Equ Model 8(2):205–223CrossRefGoogle Scholar
  49. Jackson DL, Gillaspy JA Jr, Purc-Stephenson R (2009) Reporting practices in confirmatory factor analysis: an overview and some recommendations. Psychol Methods 14(1):6–23CrossRefGoogle Scholar
  50. Jarvis CB, MacKenzie SB, Podsakoff PM (2003) A critical review of construct indicators and measurement model misspecification in marketing and consumer research. J Consum Res 30(2):199–218CrossRefGoogle Scholar
  51. Johnson JW, Rapp A (2010) A more comprehensive understanding and measure of customer helping behavior. J Bus Res 63(8):787–792CrossRefGoogle Scholar
  52. Kang GD (2004) SOC* QUAL: The development of a scale to measure a societal dimension. Dissertation, University of IllinoisGoogle Scholar
  53. Kline RB (2011) Principles and practice of structural equation modeling, 3rd edn. Guilford, New YorkGoogle Scholar
  54. Kohli AK, Jaworski BJ (1990) Market orientation: the construct, research propositions, and managerial implications. J Mark 54(2):1–18CrossRefGoogle Scholar
  55. Lee Z, Sargeant A (2011) Dealing with social desirability bias: an application to charitable giving. Eur J Mark 45(5):703–719CrossRefGoogle Scholar
  56. Leslie DR, Holzhalb CM, Holland TP (1998) Measuring staff empowerment: development of a worker empowerment scale. Res Soc Work Pract 8(2):212–222CrossRefGoogle Scholar
  57. Liao MN, Foreman S, Sargeant A (2001) Market versus societal orientation in the nonprofit context. Int J Nonprofit Volunt Sect Mark 6(3):254–268CrossRefGoogle Scholar
  58. MacKenzie SB (2003) The dangers of poor construct conceptualization. J Acad Mark Sci 31(3):323–326CrossRefGoogle Scholar
  59. MacKenzie SB, Podsakoff PM, Jarvis CB (2005) The problem of measurement model misspecification in behavioral and organizational research and some recommended solutions. J Appl Psychol 90(4):710–730CrossRefGoogle Scholar
  60. Mottner S, Ford JB (2005) Measuring nonprofit marketing strategy performance: the case of museum stores. J Bus Res 58(6):829–840CrossRefGoogle Scholar
  61. Mottner S, Ford JB (2008) Internal competition in a nonprofit museum context: development of a scale. Int J Nonprofit Volunt Sect Mark 13(2):177–190CrossRefGoogle Scholar
  62. Mulyanegara R (2010) Market orientation and brand orientation from customer perspective: an empirical examination in the non-profit sector. Int J Bus Manag 5(7):14–23Google Scholar
  63. Murray P, Carter L (2005) Improving marketing intelligence through learning systems and knowledge communities in not-for-profit workplaces. J Work Learn 17(7):421–435CrossRefGoogle Scholar
  64. Netemeyer R, Bearden W, Sharma S (2003) Scaling procedures: issues and applications. Sage, Thousand OaksGoogle Scholar
  65. Nunnally J, Bernstein IH (1994) Psychometric theory, 3rd edn. McGraw-Hill, New YorkGoogle Scholar
  66. Perreault WD, Leigh LE (1989) Reliability of nominal data based on qualitative judgments. J Mark Res 26(May):135–148CrossRefGoogle Scholar
  67. Petter S, Straub D, Rai A (2007) Specifying formative constructs in information systems research. MIS Q 31(4):623–656Google Scholar
  68. Ping RA (2004) On assuring valid measures for theoretical models using survey data. J Bus Res 57(2):125–141CrossRefGoogle Scholar
  69. Poole DL, Nelson J, Carnahan S, Chepenik NG, Tubiak C (2000) Evaluating performance measurement systems in nonprofit agencies: the program accountability quality scale (PAQS). Am J Eval 21(1):15–26Google Scholar
  70. Raykov T (1997) Estimation of composite reliability for congeneric measures. Appl Psychol Meas 21(2):173–184CrossRefGoogle Scholar
  71. Rojas MC, Camarero MC (2006) Experience and satisfaction of visitors to museums and cultural exhibitions. Int Rev Publ Nonprofit Mark 3(1):49–65Google Scholar
  72. Rosas SR, Camphausen LC (2007) The use of concept mapping for scale development and validation in evaluation. Eval Prog Plan 30(2):125–135CrossRefGoogle Scholar
  73. Rossiter JR (2002) The C-OAR-SE procedure for scale development in marketing. Int J Res Mark 19(4):305–335CrossRefGoogle Scholar
  74. Rossiter JR (2011) Marketing measurement revolution: the C-OAR-SE method and why it must replace psychometrics. Eur J Mark 45(11/12):1561–1588CrossRefGoogle Scholar
  75. Sargeant A, Ford JB, West DC (2006) Perceptual determinants of nonprofit giving behavior. J Bus Res 59(2):155–165CrossRefGoogle Scholar
  76. Sargeant A, Ford J, Hudson J (2008) Charity brand personality: the relationship with giving behavior. Nonprofit Volunt Sec Q 37(3):468–491Google Scholar
  77. Sarstedt M, Schloderer MP (2010) Developing a measurement approach for reputation of non-profit organizations. Int J Nonprofit Volunt Sect Mark 15(3):276–299Google Scholar
  78. Schondel C (1989) The development of multiple scales to measure volunteers’ attitudes towards AIDS and towards volunteer motivation. (Unpublished doctoral dissertation). The Ohio State University, College of Social Work, Columbus, OHGoogle Scholar
  79. Schreiber JB, Nora A, Stage FK, Barlow EA, King J (2006) Reporting structural equation modeling and confirmatory factor analysis results: a review. J Educ Res 99(6):323–338CrossRefGoogle Scholar
  80. Schwab DP (1980) Construct validity in organization behavior. In: Staw BM, Cummings LL (eds) Research in organizational behavior (vol. 2). JAI, Greenwich, pp 3–43Google Scholar
  81. Sheppard R (2011) The evolution and conceptualization of market orientation: what managers ought to know. J Manag Policy Pract 12(6):30–45Google Scholar
  82. Siu NYM, Wilson RMS (1998) Modeling market orientation: an application in the education sector. J Mark Manag 14(4):293–323CrossRefGoogle Scholar
  83. Stenner AJ, Smith M, Burdick DS (1983) Toward a theory of construct definition. J Educ Meas 20(4):305–316CrossRefGoogle Scholar
  84. Vaughan L, Shiu E (2001) ARCHSECRET: a multi–item scale to measure service quality within the voluntary sector. Int J Nonprofit Volunt Sect Mark 6(2):131–144CrossRefGoogle Scholar
  85. Venable BT, Rose GM, Bush VD, Gilbert FW (2005) The role of brand personality in charitable giving: an assessment and validation. J Acad Mark Sci 33(3):295–312CrossRefGoogle Scholar
  86. Voeth DM, Herbst U (2008) The concept of brand personality as an instrument for advanced non-profit branding—an empirical analysis. J Nonprofit Publ Sector Mark 19(1):71–97CrossRefGoogle Scholar
  87. Webb DJ, Green CL, Brashear TG (2000) Development and validation of scales to measure attitudes influencing monetary donations to charitable organizations. J Acad Mark Sci 28(2):299–309CrossRefGoogle Scholar
  88. Whitman JR (2009) Measuring social values in philanthropic foundations. Nonprofit Manag Leadersh 19(3):305–325CrossRefGoogle Scholar
  89. Word, J. (forthcoming). The new public service? Applying the public service motivation model to nonprofit employees. Public Personnel Management.Google Scholar
  90. Worthington RL, Whittaker TA (2006) Scale development research. Couns Psychol 34(6):806–838CrossRefGoogle Scholar
  91. Zaghloul AA, Hayajneh YA, AlMarzouki A (2010) Factor analysis for an institutional image instrument. Int Rev Publ Nonprofit Mark 7(2):157–166CrossRefGoogle Scholar
  92. Zaichkowsky JL (1985) Measuring the involvement construct. J Consum Res 12(3):341–352CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  1. 1.University of LethbridgeLethbridgeCanada
  2. 2.University of Beira InteriorCovilhãPortugal

Personalised recommendations