Skip to main content
SpringerLink
Log in

Scale development research in nonprofit management & marketing: a content analysis and recommendation for best practices

  • Original Article
  • Published:
International Review on Public and Nonprofit Marketing Aims and scope Submit manuscript

Abstract

The authors report a content analysis on scale development studies in nonprofit management and marketing. The authors analyze and discuss characteristics of the procedures used in these studies with respect to construct conceptualization, the relationship between construct and measurement model, item generation and refinement, sampling, analysis, and reporting. A variety of practices in this body of research were at variance with the current scale development literature. The authors include recommendations for best practices in further research.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Notes

  1. The type of SEM to use (CB or PLS) requires a discussion that is beyond the scope of our work. The interested reader is referred to Hair et al. (2011).

References

  • Anderson JC, Gerbing DW (1984) The effects of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis. Psychometrika 49(2):155–173

    Article  Google Scholar 

  • Anderson JC, Gerbing DW (1991) Predicting the performance of measures in a confirmatory factor analysis with a pretest assessment of their substantive validity. J Appl Psychol 76(5):732–740

    Article  Google Scholar 

  • Arnett DB, German SD, Hunt SD (2003) The identity salience model of relationship marketing success: the case of nonprofit marketing. J Mark 67(2):89–105

    Article  Google Scholar 

  • Bagozzi RP, Yi Y (2012) Specification, evaluation, and interpretation of structural equation models. J Acad Mark Sci 40(1):8–34

    Article  Google Scholar 

  • Bales K (1996) Measuring the propensity to volunteer. Soc Policy Adm 30(3):206–226

    Article  Google Scholar 

  • Bearden WO, Netemeyer RG, Haws KL (2011) Handbook of marketing scales: multi-item measures for marketing and consumer behavior research, 3rd edn. Sage, Thousand Oaks

    Google Scholar 

  • Bekkers R (2010) Journals in philanthropic studies. (Unpublished report, available by contacting author at r.bekkers@vu.nl)

  • Bennett R, Gabriel H (2003) Image and reputational characteristics of UK charitable organizations: an empirical study. Corp Reput Rev 6(3):276–289

    Article  Google Scholar 

  • Bonner PG, George WR (1988) An image scale for nonprofit voluntary organizations. Nonprofit Volunt Sect Q 17(3–4):70–80

    Article  Google Scholar 

  • Bruner GC (ed) (2009) Marketing scales handbook: a compilation of multi-item measures for consumer behavior & advertising research (Vol 5). GCBII Productions, Carbondale

    Google Scholar 

  • Chin WW (1998) Issues and opinion on structural equation modeling. MIS Q 22(1):vii–xvi

    Google Scholar 

  • Churchill GA (1979) A paradigm for developing better measures of marketing constructs. J Mark Res 16(1):64–73

    Article  Google Scholar 

  • Clark L, Watson D (1995) Constructing validity: basic issues in objective scale development. Psychol Assess 7(3):309–319

    Article  Google Scholar 

  • Clary EG, Snyder M, Ridge RD, Copeland J, Stukas AA, Haugen J, Miene P (1998) Understanding and assessing the motivations of volunteers: a functional approach. J Personal Soc Psychol 74(6):1516–1530

    Article  Google Scholar 

  • Cnaan RA, Goldberg-Glen RS (1991) Measuring motivation to volunteer in human services. J Appl Behav Sci 27(3):269–284

    Article  Google Scholar 

  • Coltman T, Devinney TM, Midgley DF, Venaik S (2008) Formative versus reflective measurement models: two applications of formative measurement. J Bus Res 61(12):1250–1262

    Article  Google Scholar 

  • Coryn CLS, Schröter DC, Hanssen CE (2009) Adding a time-series design element to the success case method to improve methodological rigor an application for nonprofit program evaluation. Am J Eval 30(1):80–92

    Article  Google Scholar 

  • de Chernatony L, Riley FDO (1998) Defining a“ brand”: beyond the literature with experts’ interpretations. J Mark Manag 14(5):417–443

    Article  Google Scholar 

  • Deshpandé R, Farley JU (1998) Measuring market orientation: generalization and synthesis. J Mark-Focus Manag 2(3):213–232

    Google Scholar 

  • DeVellis RF (2012) Scale development: theory and applications, 3rd edn. Sage, Thousand Oaks

    Google Scholar 

  • Diamantopoulos A (2005) The C-OAR-SE procedure for scale development in marketing: a comment. Int J Res Mark 22(1):1–9

    Article  Google Scholar 

  • Diamantopoulos A, Siguaw JA (2006) Formative versus reflective indicators in organizational measure development: a comparison and empirical illustration. Br J Manag 17(4):263–282

    Article  Google Scholar 

  • Diamantopoulos A, Winklhofer HM (2001) Index construction with formative indicators: an alternative to scale development. J Mark Res 38(2):269–277

    Article  Google Scholar 

  • Diamantopoulos A, Riefler P, Roth KP (2008) Advancing formative measurement models. J Bus Res 61(12):1203–1218

    Article  Google Scholar 

  • Dillon WR, Kumar A, Mulani N (1987) Offending estimates in covariance structure analysis: comments on the causes of and solutions to Heywood cases. Psychol Bull 101(1):126–135

    Article  Google Scholar 

  • Donaldson LP, Shields J (2009) Development of the policy advocacy behavior scale: initial reliability and validity. Res Soc Work Pract 19(1):83–92

    Article  Google Scholar 

  • Duarte PO, Alves HB, Raposo MB (2010) Understanding university image: a structural equation model approach. Int Rev Publ Nonprofit Mark 7(1):21–36

    Article  Google Scholar 

  • Ewing MT, Napoli J (2005) Developing and validating a multidimensional nonprofit brand orientation scale. J Bus Res 58(6):841–853

    Article  Google Scholar 

  • Farrell AM, Rudd JM (2009). Factor analysis and discriminant validity: a brief review of some practical issues. Paper presented at the Australian & New Zealand Marketing Academy (ANZMAC) Conference 2009, Melbourne, Australia. Retrieved from http://www.duplication.net.au/ANZMAC09/papers/ANZMAC2009-389.pdf

  • Farrell AM, Souchon AL, Durden GR (2003) The service leadership scale: A substantive validity test. Paper presented at the Australian & New Zealand Marketing Academy (ANZMAC) Conference 2003, Adelaide, Australia. Retrieved from http://eprints.aston.ac.uk/2917/1/service_leadership_farrell.pdf

  • Fornell C, Larcker DF (1981) Evaluating structural equation models with unobservable variables and measurement error. J Mark Res 18(1):39–50

    Article  Google Scholar 

  • Frans DJ (1993) A scale for measuring social worker empowerment. Res Soc Work Pract 3(3):312–328

    Article  Google Scholar 

  • Gallagher K, Weinberg CB (1991) Coping with success: new challenges for nonprofit marketing. Sloan Manag Rev 33(1):27–42

    Google Scholar 

  • Hair J, Anderson R, Tatham R, Black W (2009) Multivariate data analysis, 7th edn. Prentice-Hall, Upper Saddle River

    Google Scholar 

  • Hair JF, Ringle CM, Sarstedt M (2011) PLS-SEM: indeed a silver bullet. J Mark Theory Pract 19(2):139–152

    Article  Google Scholar 

  • Hardesty DM, Bearden WO (2004) The use of expert judges in scale development. J Bus Res 57(2):98–107

    Article  Google Scholar 

  • Haynes SN, Richard D, Kubany ES (1995) Content validity in psychological assessment: a functional approach to concepts and methods. Psychol Assess 7(3):238–247

    Article  Google Scholar 

  • Haynes SN, Nelson K, Blaine DD (1999) Psychometric issues in assessment research. In: Kendall PC, Butler JN, Hombeck G (eds) Handbook of research methods in clinical psychology. Wiley, New York, pp 125–154

    Google Scholar 

  • Helm S (2007) Social entrepreneurship: defining the nonprofit behavior and creating an instrument for measurement. (Unpublished doctoral dissertation). University of Missouri-Kansas City, School of Public Affairs and Administration in Economics

  • Helmig B, Thaler J (2010) Nonprofit marketing. In: Taylor R (ed) Third sector research. Springer, New York, pp 151–169

    Chapter  Google Scholar 

  • Hinkin TR (1995) A review of scale development practices in the study of organizations. J Manag 21(5):967–988

    Article  Google Scholar 

  • Holden RR, Jackson DN (1979) Item subtlety and face validity in personality assessment. J Consult Clin Psychol 47(3):459–468

    Article  Google Scholar 

  • Holland TP (1991) Self–assessment by nonprofit boards. Nonprofit Manag Leadersh 2(1):25–36

    Article  Google Scholar 

  • Homburg C, Pflesser C (2000) A multiple-layer model of market-oriented organizational culture: measurement issues and performance outcomes. J Mark Res 37(4):449–462

    Article  Google Scholar 

  • Hsieh J, Curtis KP, Smith AW (2008) Implications of stakeholder concept and market orientation in the U.S. nonprofit arts context. Int Rev Publ Nonprofit Mark 5(1):1–13

    Article  Google Scholar 

  • Hunt SD (1976) The nature and scope of marketing. J Mark 40(3):17–28

    Article  Google Scholar 

  • Inglis S, Cleave S (2006) A scale to assess board member motivations in nonprofit organizations. Nonprofit Manag Leadersh 17(1):83–101

    Article  Google Scholar 

  • Jackson DL (2001) Sample size and number of parameter estimates in maximum likelihood confirmatory factor analysis: a Monte Carlo investigation. Struct Equ Model 8(2):205–223

    Article  Google Scholar 

  • Jackson DL, Gillaspy JA Jr, Purc-Stephenson R (2009) Reporting practices in confirmatory factor analysis: an overview and some recommendations. Psychol Methods 14(1):6–23

    Article  Google Scholar 

  • Jarvis CB, MacKenzie SB, Podsakoff PM (2003) A critical review of construct indicators and measurement model misspecification in marketing and consumer research. J Consum Res 30(2):199–218

    Article  Google Scholar 

  • Johnson JW, Rapp A (2010) A more comprehensive understanding and measure of customer helping behavior. J Bus Res 63(8):787–792

    Article  Google Scholar 

  • Kang GD (2004) SOC* QUAL: The development of a scale to measure a societal dimension. Dissertation, University of Illinois

  • Kline RB (2011) Principles and practice of structural equation modeling, 3rd edn. Guilford, New York

    Google Scholar 

  • Kohli AK, Jaworski BJ (1990) Market orientation: the construct, research propositions, and managerial implications. J Mark 54(2):1–18

    Article  Google Scholar 

  • Lee Z, Sargeant A (2011) Dealing with social desirability bias: an application to charitable giving. Eur J Mark 45(5):703–719

    Article  Google Scholar 

  • Leslie DR, Holzhalb CM, Holland TP (1998) Measuring staff empowerment: development of a worker empowerment scale. Res Soc Work Pract 8(2):212–222

    Article  Google Scholar 

  • Liao MN, Foreman S, Sargeant A (2001) Market versus societal orientation in the nonprofit context. Int J Nonprofit Volunt Sect Mark 6(3):254–268

    Article  Google Scholar 

  • MacKenzie SB (2003) The dangers of poor construct conceptualization. J Acad Mark Sci 31(3):323–326

    Article  Google Scholar 

  • MacKenzie SB, Podsakoff PM, Jarvis CB (2005) The problem of measurement model misspecification in behavioral and organizational research and some recommended solutions. J Appl Psychol 90(4):710–730

    Article  Google Scholar 

  • Mottner S, Ford JB (2005) Measuring nonprofit marketing strategy performance: the case of museum stores. J Bus Res 58(6):829–840

    Article  Google Scholar 

  • Mottner S, Ford JB (2008) Internal competition in a nonprofit museum context: development of a scale. Int J Nonprofit Volunt Sect Mark 13(2):177–190

    Article  Google Scholar 

  • Mulyanegara R (2010) Market orientation and brand orientation from customer perspective: an empirical examination in the non-profit sector. Int J Bus Manag 5(7):14–23

    Google Scholar 

  • Murray P, Carter L (2005) Improving marketing intelligence through learning systems and knowledge communities in not-for-profit workplaces. J Work Learn 17(7):421–435

    Article  Google Scholar 

  • Netemeyer R, Bearden W, Sharma S (2003) Scaling procedures: issues and applications. Sage, Thousand Oaks

    Google Scholar 

  • Nunnally J, Bernstein IH (1994) Psychometric theory, 3rd edn. McGraw-Hill, New York

    Google Scholar 

  • Perreault WD, Leigh LE (1989) Reliability of nominal data based on qualitative judgments. J Mark Res 26(May):135–148

    Article  Google Scholar 

  • Petter S, Straub D, Rai A (2007) Specifying formative constructs in information systems research. MIS Q 31(4):623–656

    Google Scholar 

  • Ping RA (2004) On assuring valid measures for theoretical models using survey data. J Bus Res 57(2):125–141

    Article  Google Scholar 

  • Poole DL, Nelson J, Carnahan S, Chepenik NG, Tubiak C (2000) Evaluating performance measurement systems in nonprofit agencies: the program accountability quality scale (PAQS). Am J Eval 21(1):15–26

    Google Scholar 

  • Raykov T (1997) Estimation of composite reliability for congeneric measures. Appl Psychol Meas 21(2):173–184

    Article  Google Scholar 

  • Rojas MC, Camarero MC (2006) Experience and satisfaction of visitors to museums and cultural exhibitions. Int Rev Publ Nonprofit Mark 3(1):49–65

    Google Scholar 

  • Rosas SR, Camphausen LC (2007) The use of concept mapping for scale development and validation in evaluation. Eval Prog Plan 30(2):125–135

    Article  Google Scholar 

  • Rossiter JR (2002) The C-OAR-SE procedure for scale development in marketing. Int J Res Mark 19(4):305–335

    Article  Google Scholar 

  • Rossiter JR (2011) Marketing measurement revolution: the C-OAR-SE method and why it must replace psychometrics. Eur J Mark 45(11/12):1561–1588

    Article  Google Scholar 

  • Sargeant A, Ford JB, West DC (2006) Perceptual determinants of nonprofit giving behavior. J Bus Res 59(2):155–165

    Article  Google Scholar 

  • Sargeant A, Ford J, Hudson J (2008) Charity brand personality: the relationship with giving behavior. Nonprofit Volunt Sec Q 37(3):468–491

    Google Scholar 

  • Sarstedt M, Schloderer MP (2010) Developing a measurement approach for reputation of non-profit organizations. Int J Nonprofit Volunt Sect Mark 15(3):276–299

    Google Scholar 

  • Schondel C (1989) The development of multiple scales to measure volunteers’ attitudes towards AIDS and towards volunteer motivation. (Unpublished doctoral dissertation). The Ohio State University, College of Social Work, Columbus, OH

  • Schreiber JB, Nora A, Stage FK, Barlow EA, King J (2006) Reporting structural equation modeling and confirmatory factor analysis results: a review. J Educ Res 99(6):323–338

    Article  Google Scholar 

  • Schwab DP (1980) Construct validity in organization behavior. In: Staw BM, Cummings LL (eds) Research in organizational behavior (vol. 2). JAI, Greenwich, pp 3–43

    Google Scholar 

  • Sheppard R (2011) The evolution and conceptualization of market orientation: what managers ought to know. J Manag Policy Pract 12(6):30–45

    Google Scholar 

  • Siu NYM, Wilson RMS (1998) Modeling market orientation: an application in the education sector. J Mark Manag 14(4):293–323

    Article  Google Scholar 

  • Stenner AJ, Smith M, Burdick DS (1983) Toward a theory of construct definition. J Educ Meas 20(4):305–316

    Article  Google Scholar 

  • Vaughan L, Shiu E (2001) ARCHSECRET: a multi–item scale to measure service quality within the voluntary sector. Int J Nonprofit Volunt Sect Mark 6(2):131–144

    Article  Google Scholar 

  • Venable BT, Rose GM, Bush VD, Gilbert FW (2005) The role of brand personality in charitable giving: an assessment and validation. J Acad Mark Sci 33(3):295–312

    Article  Google Scholar 

  • Voeth DM, Herbst U (2008) The concept of brand personality as an instrument for advanced non-profit branding—an empirical analysis. J Nonprofit Publ Sector Mark 19(1):71–97

    Article  Google Scholar 

  • Webb DJ, Green CL, Brashear TG (2000) Development and validation of scales to measure attitudes influencing monetary donations to charitable organizations. J Acad Mark Sci 28(2):299–309

    Article  Google Scholar 

  • Whitman JR (2009) Measuring social values in philanthropic foundations. Nonprofit Manag Leadersh 19(3):305–325

    Article  Google Scholar 

  • Word, J. (forthcoming). The new public service? Applying the public service motivation model to nonprofit employees. Public Personnel Management.

  • Worthington RL, Whittaker TA (2006) Scale development research. Couns Psychol 34(6):806–838

    Article  Google Scholar 

  • Zaghloul AA, Hayajneh YA, AlMarzouki A (2010) Factor analysis for an institutional image instrument. Int Rev Publ Nonprofit Mark 7(2):157–166

    Article  Google Scholar 

  • Zaichkowsky JL (1985) Measuring the involvement construct. J Consum Res 12(3):341–352

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Lethbridge, Lethbridge, Canada

    Walter Wymer

  2. University of Beira Interior, Covilhã, Portugal

    Helena Maria Baptista Alves

Authors
  1. Walter Wymer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Helena Maria Baptista Alves
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Walter Wymer.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wymer, W., Alves, H.M.B. Scale development research in nonprofit management & marketing: a content analysis and recommendation for best practices. Int Rev Public Nonprofit Mark 10, 65–86 (2013). https://doi.org/10.1007/s12208-012-0093-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12208-012-0093-1

Keywords

Search

Navigation