A Psychometric Evaluation of the Intention Scale for Providers-Direct Items

  • Albert C. MahEmail author
  • Kaitlin A. Hill
  • David C. Cicero
  • Brad J. Nakamura


This study examined the psychometric properties of the Intention Scale for Providers-Direct Items (ISP-D; 16 items), a questionnaire for assessing therapists’ evidence-based practice attitudes, subjective norms, perceived behavioral control, and behavioral intentions. Participants were community mental health providers from the State of Hawaii. A confirmatory factor analysis provided support for a revised 14-item ISP-D measure that fits the data reasonably well. Subscales of this revised ISP-D demonstrated acceptable to good internal consistency, with the exception of the Perceived Behavioral Control subscale. The majority of convergent validity correlation patterns between the ISP-D and related constructs were significant and in predicted directions.


Implementation Evidence-based practice Therapist survey Theory of planned behavior Factor analysis 


Compliance with Ethical Standards

Conflict of Interest

The authors declare that they have no conflict of interest.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.

Informed Consent

Informed consent was obtained from all individual participants included in the study.


  1. 1.
    Shafran R, Clark DM, Fairburn CG, et al. Mind the gap: Improving the dissemination of CBT. Behaviour Research and Therapy. 2009; 47(11): 902-909.PubMedCrossRefGoogle Scholar
  2. 2.
    Walrath CM, Sheehan AK, Holden EW, et al. Evidence-based treatments in the field: A brief report on provider knowledge, implementation, and practice. The Journal of Behavioral Health Services & Research. 2006; 33(2): 244-253.CrossRefGoogle Scholar
  3. 3.
    Fixsen DL, Naoom SF, Blasé KA, et al. Implementation research: A synthesis of the literature (FMHI Publication No. 231). Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, National Implementation Research Network, 2005.Google Scholar
  4. 4.
    Hoagwood K, Olin SS. The NIMH blueprint for change report: Research priorities in child and adolescent mental health. Journal of the American Academy of Child & Adolescent Psychiatry. 2002; 41(7): 760-767.CrossRefGoogle Scholar
  5. 5.
    Southam-Gerow MA, Rodríguez A, Chorpita BF, et al. Dissemination and implementation of evidence based treatments for youth: Challenges and recommendations. Professional Psychology: Research and Practice. 2012; 43(5): 527.CrossRefGoogle Scholar
  6. 6.
    Lewis CC, Weiner BJ, Stanick C, et al. Advancing implementation science through measure development and evaluation: a study protocol. Implementation Science. 2015; 10(1): 1.CrossRefGoogle Scholar
  7. 7.
    Beidas RS, Kendall PC. Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science and Practice. 2010; 17(1): 1-30.Google Scholar
  8. 8.
    Jensen-Doss A, Hawley KM. Understanding clinicians’ diagnostic practices: Attitudes toward the utility of diagnosis and standardized diagnostic tools. Administration and Policy in Mental Health and Mental Health Services Research. 2011; 38(6): 476-485.PubMedCrossRefGoogle Scholar
  9. 9.
    Lewis CC, Fischer S, Weiner BJ, et al. Outcomes for implementation science: an enhanced systematic review of instruments using evidence-based rating criteria. Implementation Science. 2015; 10(1): 1.CrossRefGoogle Scholar
  10. 10.
    Nelson TD, Steele RG. Predictors of practitioner self-reported use of evidence-based practices: Practitioner training, clinical setting, and attitudes toward research. Administration and Policy in Mental Health and Mental Health Services Research. 2007; 34(4): 319-330.PubMedCrossRefGoogle Scholar
  11. 11.
    Martinez RG, Lewis CC, Weiner BJ. Instrumentation issues in implementation science. Implementation Science. 2014; 9(1): 118.PubMedCrossRefGoogle Scholar
  12. 12.
    Ajzen I. The theory of planned behavior. Organizational Behavior and Human Decision Processes. 1991; 50(2): 179-211.CrossRefGoogle Scholar
  13. 13.
    Albarracin D, Johnson BT, Fishbein M, et al. Theories of reasoned action and planned behavior as models of condom use: A meta-analysis. Psychological Bulletin. 2001; 127: 142-161.PubMedPubMedCentralCrossRefGoogle Scholar
  14. 14.
    Godin G, Kok G. The theory of planned behavior: A review of its applications to health-related behaviors. American Journal of Health Promotion. 1996;11: 87-98.PubMedCrossRefGoogle Scholar
  15. 15.
    Limbert C, Lamb R. Doctors’ use of clinical guidelines: Two applications of the Theory of Planned Behaviour. Psychology, Health & Medicine. 2002; 7: 301-310.CrossRefGoogle Scholar
  16. 16.
    Ajzen I. The theory of planned behaviour: Reactions and reflections. Psychology and Health. 2011; 26(9): 1113-1127.PubMedCrossRefGoogle Scholar
  17. 17.
    Armitage CJ, Conner M. Efficacy of the theory of planned behavior: A meta-analytic review. British Journal of Social Psychology. 2001; 40: 471-499.PubMedCrossRefPubMedCentralGoogle Scholar
  18. 18.
    Sheeran P, Orbell S. Do intentions predict condom use? Meta-analysis and examination of six moderator variables. British Journal of Social Psychology. 1998; 37: 231–250.PubMedCrossRefGoogle Scholar
  19. 19.
    Ajzen I, Cote NG. Attitudes and the prediction of behavior. In: WD Crano, R Prislin. Attitudes and Attitude Change. New York, NY: Psychology Press, 2008, pp. 289-311.Google Scholar
  20. 20.
    Casper ES. The theory of planned behavior applied to continuing education for mental health professionals. Psychiatric Services. 2007; 58(10): 1324-1329.PubMedCrossRefGoogle Scholar
  21. 21.
    Kelly PJ, Deane FP, Lovett MJ. Using the theory of planned behavior to examine residential substance abuse workers intention to use evidence-based practices. Psychology of Addictive Behaviors. 2012; 26(3): 661-664.PubMedCrossRefGoogle Scholar
  22. 22.
    Klaybor GR. An application of the Theory of Planned Behavior on clinical social workers’ utilization of the DSM-IV: An exploratory study. Dissertation Abstracts International Section A: Humanities and Social Sciences. 1998; 59(7-A): 2720. (UMI No. AAM9841117).Google Scholar
  23. 23.
    Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: The Evidence-Based Practice Attitude Scale (EBPAS). Mental Health Services Research. 2004; 6(2): 61-74.PubMedPubMedCentralCrossRefGoogle Scholar
  24. 24.
    Aarons GA, Glisson C, Hoagwood K, et al. Psychometric properties and U.S. national norms of the Evidence-Based Practice Attitude Scale (EBPAS). Psychological Assessment. 2010; 22(2): 356-365.PubMedCrossRefGoogle Scholar
  25. 25.
    Burgess AM, Chang J, Nakamura BJ, et al. Evidence based practice implementation within a theory of planned behavior framework. Journal of Behavioral Health Services & Research. 2017; 44(4): 647-665.CrossRefGoogle Scholar
  26. 26.
    Haynes SN, Richard D, Kubany ES. Content validity in psychological assessment: A functional approach to concepts and methods. Psychological Assessment. 1995; 7(3): 238.CrossRefGoogle Scholar
  27. 27.
    Ajzen I. Frequently Asked Questions. Available online at Accessed on May 21, 2015.
  28. 28.
    Higa-McMillan CK, Nakamura BJ, Morris A, et al. Predictors of use of evidence-based practices for children and adolescents in usual care. Administration and Policy in Mental Health and Mental Health Services Research. 2015; 42(4): 373-383.PubMedCrossRefGoogle Scholar
  29. 29.
    Izmirian SC, Nakamura BJ. Knowledge, attitudes, social desirability, and organizational characteristics in youth mental health services. The Journal of Behavioral Health Services & Research. 2016; 43(4): 630-647.CrossRefGoogle Scholar
  30. 30.
    Lim A, Nakamura BJ, Higa-McMillan CK, et al. Effects of workshop trainings on evidence-based practice knowledge and attitudes among youth community mental health providers. Behaviour Research and Therapy. 2012; 50(6): 397-406.PubMedCrossRefGoogle Scholar
  31. 31.
    Nakamura BJ, Higa-McMillan CK, Okamura KH, et al. Knowledge of and attitudes towards evidence-based practices in community child mental health practitioners. Administration and Policy in Mental Health and Mental Health Services Research. 2011; 38(4): 287-300.PubMedCrossRefGoogle Scholar
  32. 32.
    Bollen KA, Liang J. Some properties of Hoelter’s CN. Sociological Methods and Research. 1988; 16: 492-503.CrossRefGoogle Scholar
  33. 33.
    Breckler SJ. Applications of covariance structure modeling in psychology: Cause for concern? Psychological Bulletin. 1990; 107(2): 260-273.PubMedCrossRefGoogle Scholar
  34. 34.
    Bentler PM, Chou CP. Practical issues in structural modeling. Sociological Methods and Research. 1987; 16(1): 78-117.CrossRefGoogle Scholar
  35. 35.
    Faul, F, Erdfelder E, Buchner A, et al. Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behavior Research Methods. 2009; 41: 1149-1160.PubMedCrossRefGoogle Scholar
  36. 36.
    Green SB, Salkind NJ. Using SPSS for Windows and Macintosh: Analyzing and understanding data. Prentice Hall Press, 2010.Google Scholar
  37. 37.
    Muthén LK, Muthén BO. Mplus (version 8) [computer software]. Los Angeles, CA: Muthén & Muthén, 2017.Google Scholar
  38. 38.
    Rhemtulla M, Brosseau-Liard PÉ, Savalei V. When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods. 2012; 17: 354–373.PubMedCrossRefGoogle Scholar
  39. 39.
    Bentler PM. Comparative fit indexes in structural models. Psychological Bulletin. 1990; 107 (2): 238-46.PubMedCrossRefGoogle Scholar
  40. 40.
    Steiger JH. Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research. 1990; 25(2): 173-180.PubMedCrossRefGoogle Scholar
  41. 41.
    Tucker LR, Lewis C. A reliability coefficient for maximum likelihood factor analysis. Psychometrika. 1973; 38: 1-10.CrossRefGoogle Scholar
  42. 42.
    Dunn G, Everitt BS, Pickles A. Modelling Covariances and Latent Variables Using EQS. CRC Press, 1993.Google Scholar
  43. 43.
    Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal. 1999; 6(1): 1-55.CrossRefGoogle Scholar
  44. 44.
    Browne M, Cudeck R. Alternative ways of assessing model fit. In Bollen KA, Long JS (Eds). Testing Structural Equation Models. Newbury Park, CA: Sage, 1993, pp. 136-159.Google Scholar
  45. 45.
    Singh R. Does my structural model represent the real phenomenon?: a review of the appropriate use of Structural Equation Modelling (SEM) model fit indices. The Marketing Review. 2009; 9(3): 199-212.CrossRefGoogle Scholar
  46. 46.
    Jöreskog KG, Sörbom D. LISREL 8: Structural Equation Modeling with the SIMPLIS Command Language. Scientific Software International, 1993.Google Scholar
  47. 47.
    George D, Mallery P. IBM SPSS Statistics 21 Step by Step: A Simple Guide and Reference, 2013.Google Scholar
  48. 48.
    Perkins MB, Jensen PS, Jaccard J, et al. Applying theory-driven approaches to understanding and modifying clinicians’ behavior: what do we know?. Psychiatric Services. 2007; 58(3): 342-348.PubMedCrossRefGoogle Scholar
  49. 49.
    Nelson TD, Steele RG. Influences on practitioner treatment selection: Best research evidence and other considerations. The Journal of Behavioral Health Services & Research. 2008; 35(2): 170-178.CrossRefGoogle Scholar
  50. 50.
    Kline R. Principles and Practice of Structural Equation Modeling (3rd ed.). New York, NY: Guilford Press, 2011.Google Scholar
  51. 51.
    Kenny DA. Correlation and causality. New York, NY: Wiley-Interscience, 1979.Google Scholar
  52. 52.
    Ajzen I. Constructing a TPB Questionnaire: Conceptual and Methodological Considerations. Available online at Accessed on May 21, 2005.

Copyright information

© National Council for Behavioral Health 2019

Authors and Affiliations

  1. 1.Psychology DepartmentUniversity of Hawai’i at MānoaHonoluluUSA
  2. 2.Psychology DepartmentUniversity of North TexasDentonUSA

Personalised recommendations