Advertisement

Measures for Predictors of Innovation Adoption

  • Ka Ho Brian ChorEmail author
  • Jennifer P. Wisdom
  • Su-Chin Serene Olin
  • Kimberly E. Hoagwood
  • Sarah M. Horwitz
Original Paper

Abstract

Building on a narrative synthesis of adoption theories by Wisdom et al. (2013), this review identifies 118 measures associated with the 27 adoption predictors in the synthesis. The distribution of measures is uneven across the predictors and predictors vary in modifiability. Multiple dimensions and definitions of predictors further complicate measurement efforts. For state policymakers and researchers, more effective and integrated measurement can advance the adoption of complex innovations such as evidence-based practices.

Keywords

Measure Adoption Evidence-based treatments and practices Organization Innovation 

Notes

Acknowledgments

This study was funded by the National Institute of Mental Health (P30 MH090322: Advanced Center for State Research to Scale up EBPs for Children, PI: Hoagwood).

References

  1. Aarons, G. A. (2006). Transformational and transactional leadership: Association with attitudes toward evidence-based practice. Psychiatric Services, 57(8), 1162–1169. doi: 10.1176/appi.ps.57.8.1162.PubMedCentralCrossRefPubMedGoogle Scholar
  2. Aarons, G. A., Hurlburt, M., & Horwitz, S. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23. doi: 10.1007/s10488-010-0327-7.PubMedCentralCrossRefPubMedGoogle Scholar
  3. Aarons, G. A., & Sawitzky, A. C. (2006). Organizational culture and climate and mental health provider attitudes toward evidence-based practice. Psychological Services, 3(1), 61–72. doi: 10.1037/1541-1559.3.1.61.PubMedCentralCrossRefPubMedGoogle Scholar
  4. Aarons, G. A., Wells, R. S., Zagursky, K., Fettes, D. L., & Palinkas, L. A. (2009). Implementing evidence-based practice in community mental health agencies: A multiple stakeholder analysis. American Journal of Public Health, 99(11), 2087–2095. doi: 10.2105/ajph.2009.161711.PubMedCentralCrossRefPubMedGoogle Scholar
  5. Bartholomew, N. G., Joe, G. W., Rowan-Szal, G. A., & Simpson, D. D. (2007). Counselor assessments of training and adoption barriers. Journal of Substance Abuse Treatment, 33(2), 193–199. doi: 10.1016/j.jsat.2007.01.005.PubMedCentralCrossRefPubMedGoogle Scholar
  6. Bass, B. M., Avolio, B. J., & Atwater, L. (1996). The transformational and transactional leadership of men and women. Applied Psychology, 45(1), 5–34. doi: 10.1111/j.1464-0597.1996.tb00847.x.CrossRefGoogle Scholar
  7. Burns, L. R., & Wholey, D. R. (1993). Adoption and abandonment of matrix management programs: Effects of organizational characteristics and interorganizational networks. Academy of Management Journal, 36(1), 106–138.CrossRefPubMedGoogle Scholar
  8. Chamberlain, P., Brown, C. H., & Saldana, L. (2011). Observational measure of implementation progress in community based settings: The Stages of implementation completion (SIC). Implementation Science,. doi: 10.1186/1748-5908-6-116.Google Scholar
  9. Chaudoir, S. R., Dugan, A. G., & Barr, C. H. (2013). Measuring factors affecting implementation of health innovations: A systematic review of structural, organizational, provider, patient, and innovation level measures. Implementation Science, 8(1), 22. doi: 10.1186/1748-5908-8-22.PubMedCentralCrossRefPubMedGoogle Scholar
  10. Cheung, D., Hattie, J., & Ng, D. (2001). Reexamining the stages of concern questionnaire: A test of alternative models. The Journal of Educational Research, 94(4), 226–236.CrossRefGoogle Scholar
  11. Cohen, W. M., & Levinthal, D. A. (1990). Absorptive capacity—A new perspective on learning and innovation. Administrative Science Quarterly, 35(1), 128–152.CrossRefGoogle Scholar
  12. Comer, J. S., & Barlow, D. H. (2013). The occasional case against broad dissemination and implementation: Retaining a role for specialty care in the delivery of psychological treatments. American Psychologist,. doi: 10.1037/a0033582.PubMedCentralPubMedGoogle Scholar
  13. Cooke, R. A., & Lafferty, J. C. (1994). Organizational culture inventory. Plymouth: Human Synergistics International.Google Scholar
  14. Damanpour, F., & Schneider, M. (2009). Characteristics of innovation and innovation adoption in public organizations: Assessing the role of managers. Journal of Public Administration Research and Theory, 19(3), 495–522. doi: 10.1093/jopart/mun021.CrossRefGoogle Scholar
  15. Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science,. doi: 10.1186/1748-5908-4-50.PubMedCentralPubMedGoogle Scholar
  16. Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. Management Information Systems Quarterly, 13(3), 319–340.CrossRefGoogle Scholar
  17. Dirksen, C. D., Ament, A. H., & Go, P. M. N. (1996). Diffusion of six surgical endoscopic procedures in the Netherlands. Stimulating and restraining factors. Health Policy, 37(2), 91–104. doi: 10.1016/s0168-8510(96)90054-8.CrossRefPubMedGoogle Scholar
  18. Ducharme, L. J., Knudsen, H. K., Roman, P. M., & Johnson, J. A. (2007). Innovation adoption in substance abuse treatment: Exposure, trialability, and the clinical trials network. Journal of Substance Abuse Treatment, 32(4), 321–329. doi: 10.1016/j.jsat.2006.05.021.PubMedCentralCrossRefPubMedGoogle Scholar
  19. Edwards, J. R., Knight, D. K., Broome, K. M., & Flynn, P. M. (2010). The development and validation of a transformational leadership survey for substance use treatment programs. Substance Use and Misuse, 45(9), 1279–1302. doi: 10.3109/10826081003682834.PubMedCentralCrossRefPubMedGoogle Scholar
  20. Feldstein, A. C., & Glasgow, R. E. (2008). A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Joint Commission Journal on Quality and Patient Safety, 34(4), 228–243.PubMedGoogle Scholar
  21. Finnerty, M., Leckman-Westin, E., Kealey, E., Wisdom, J. P., Olin, S., Horwitz, S., & Hoagwood, K. (2012). Impact of state incentives on mental health agency decisions to participate in a large state CQI initiative. Paper presented at the 5th Annual NIH Conference on the Science of Dissemination and Implementation, Bethesda, MD.Google Scholar
  22. Finnerty, M., Rapp, C., Bond, G., Lynde, D., Ganju, V., & Goldman, H. (2009). The state health authority yardstick (SHAY). Community Mental Health Journal, 45(3), 228–236. doi: 10.1007/s10597-009-9181-z.CrossRefPubMedGoogle Scholar
  23. Fitzgerald, L., Ferlie, E., Wood, M., & Hawkins, C. (2002). Interlocking interactions, the diffusion of innovations in health care. Human Relations, 55(12), 1429–1449. doi: 10.1177/001872602128782213.CrossRefGoogle Scholar
  24. Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network.Google Scholar
  25. Flynn, P. M., Broome, K. M., Beaston-Blaakman, A., Knight, D. K., Horgan, C. M., & Shepard, D. S. (2009). Treatment Cost Analysis Tool (TCAT) for estimating costs of outpatient treatment services. Drug and Alcohol Dependence, 100(1–2), 47–53. doi: 10.1016/j.drugalcdep.2008.08.015.PubMedCentralCrossRefPubMedGoogle Scholar
  26. Fujimoto, K., Valente, T. W., & Pentz, M. A. (2009). Network structural influences on the adoption of evidence-based prevention in communities. Journal of Community Psychology, 37(7), 830–845. doi: 10.1002/Jcop.20333.CrossRefGoogle Scholar
  27. Ganju, V. (2003). Implementation of evidence-based practices in state mental health systems: Implications for research and effectiveness studies. Schizophrenia Bulletin, 29(1), 125–131.CrossRefPubMedGoogle Scholar
  28. Gatignon, H., & Robertson, T. S. (1989). Technology diffusion: An empirical test of competitive effects. The Journal of Marketing, 53(1), 35–49.CrossRefGoogle Scholar
  29. Gioia, D., & Dziadosz, G. (2008). Adoption of evidence-based practices in community mental health: A mixed-method study of practitioner experience. Community Mental Health Journal, 44(5), 347–357. doi: 10.1007/s10597-008-9136-9.CrossRefPubMedGoogle Scholar
  30. Glisson, C., Landsverk, J., Schoenwald, S., Kelleher, K., Hoagwood, K. E., Mayberg, S., et al. (2008). Assessing the organizational social context (OSC) of mental health services: Implications for research and practice. Administration and Policy in Mental Health, 35(1–2), 98–113. doi: 10.1007/s10488-007-0148-5.CrossRefPubMedGoogle Scholar
  31. Glisson, C., & Schoenwald, S. K. (2005). The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Ment Health Serv Res, 7(4), 243–259. doi: 10.1007/s11020-005-7456-1.CrossRefPubMedGoogle Scholar
  32. Haug, N. A., Shopshire, M., Tajima, B., Gruber, V., & Guydish, J. (2008). Adoption of evidence-based practices among substance abuse treatment providers. Journal of Drug Education, 38(2), 181–192. doi: 10.2190/De.38.2.F.PubMedCentralCrossRefPubMedGoogle Scholar
  33. Holt, D. T., Armenakis, A. A., Feild, H. S., & Harris, S. G. (2007). Readiness for organizational change: The systematic development of a scale. Journal of Applied Behavioral Science, 43(2), 232–255. doi: 10.1177/0021886306295295.Google Scholar
  34. Igbaria, M. (1993). User acceptance of microcomputer technology: An empirical test. Omega, 21(1), 73–90. doi: 10.1016/0305-0483(93)90040-r.CrossRefGoogle Scholar
  35. Ingersoll, G. L., Kirsch, J. C., Merk, S. E., & Lightfoot, J. (2000). Relationship of organizational culture and readiness for change to employee commitment to the organization. Journal of Nursing Administration, 30(1), 11–20.CrossRefPubMedGoogle Scholar
  36. Judge, T. A., Thoresen, C. J., Pucik, V., & Welbourne, T. M. (1999). Managerial coping with organizational change: A dispositional perspective. Journal of Applied Psychology, 84(1), 107–122. doi: 10.1037/0021-9010.84.1.107.CrossRefGoogle Scholar
  37. Knudsen, H. K., & Abraham, A. J. (2012). Perceptions of the state policy environment and adoption of medications in the treatment of substance use disorders. Psychiatric Services, 63(1), 19–25.PubMedCentralCrossRefPubMedGoogle Scholar
  38. Knudsen, H. K., & Roman, P. M. (2004). Modeling the use of innovations in private treatment organizations: The role of absorptive capacity. Journal of Substance Abuse Treatment, 26(1), 51–59. doi: 10.1016/s0740-5472(03)00158-2.CrossRefGoogle Scholar
  39. Kraut, R. E., Rice, R. E., Cool, C., & Fish, R. S. (1998). Varieties of social influence: The role of utility and norms in the success of a new communication medium. Organization Science, 9(4), 437–453.CrossRefGoogle Scholar
  40. Lehman, W. E. K., Simpson, D. D., Knight, D. K., & Flynn, P. M. (2011). Integration of treatment innovation planning and implementation: Strategic process models and organizational challenges. Psychology of Addictive Behaviors, 25(2), 252–261. doi: 10.1037/a0022682.PubMedCentralCrossRefPubMedGoogle Scholar
  41. Leonard-Barton, D., & Deschamps, I. (1988). Managerial influence in the implementation of new technology. Management Science, 34(10), 1252–1265.CrossRefGoogle Scholar
  42. Lind, M. R., & Zmud, R. W. (1991). The influence of a convergence in understanding between technology providers and users on information technology innovativeness. Organization Science, 2(2), 195–217.CrossRefGoogle Scholar
  43. McConnell, K. J., Hoffman, K. A., Quanbeck, A., & McCarty, D. (2009). Management practices in substance abuse treatment programs. Journal of Substance Abuse Treatment, 37(1), 79–89. doi: 10.1016/j.jsat.2008.11.002.PubMedCentralCrossRefPubMedGoogle Scholar
  44. McHugh, R. K., Otto, M. W., Barlow, D. H., Gorman, J. M., Shear, M. K., & Woods, S. W. (2007). Cost-efficacy of individual and combined treatments for panic disorder. Journal of Clinical Psychiatry, 68(7), 1038–1044.CrossRefPubMedGoogle Scholar
  45. Meyer, A. D., & Goes, J. B. (1988). Organizational assimilation of innovations - A multilevel contextual analysis. Academy of Management Journal, 31(4), 897–923.CrossRefGoogle Scholar
  46. Miller, R. L. (2001). Innovation in HIV prevention: Organizational and intervention characteristics affecting program adoption. American Journal of Community Psychology, 29(4), 621–647.CrossRefPubMedGoogle Scholar
  47. Moos, R. H. (1981). Work Environment Scale manual. Palo Alto: Consulting Psychologists Press.Google Scholar
  48. Moos, R. H., & Moos, B. S. (1998). The staff workplace and the quality and outcome of substance abuse treatment. Journal of Studies on Alcohol, 59(1), 43–51.CrossRefPubMedGoogle Scholar
  49. National Cancer Institute. (2013). Grid-enabled measure database. Measures. https://www.gem-beta.org/public/Home.aspx?cat=0. Retrieved January 3, 2014.
  50. O’Reilly, C. A., Chatman, J., & Caldwell, D. F. (1991). People and organizational culture: A profile comparison approach to assessing person-organization fit. Academy of Management Journal, 34(3), 487–516. doi: 10.2307/256404.CrossRefGoogle Scholar
  51. Panzano, P. C., & Roth, D. (2006). The decision to adopt evidence-based and other innovative mental health practices: Risky business? Psychiatric Services, 57(8), 1153–1161. doi: 10.1176/appi.ps.57.8.1153.CrossRefPubMedGoogle Scholar
  52. Patient Protection and Affordable Care Act of 2010, Pub. L. No. 111-148, 124 Stat. 119–1205. (2010).Google Scholar
  53. Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005). Realist review: A new method of systematic review designed for complex policy interventions. Journal of Health Services Research and Policy, 10(Suppl 1), 21–34. doi: 10.1258/1355819054308530.CrossRefPubMedGoogle Scholar
  54. Peltier, J. W., Schibrowsky, J. A., & Zhao, Y. S. (2009). Understanding the antecedents to the adoption of CRM technology by small retailers entrepreneurs vs owner-managers. International Small Business Journal, 27(3), 307–336. doi: 10.1177/0266242609102276.CrossRefGoogle Scholar
  55. Proctor, E. K., & Brownson, R. C. (2012). Measurment issues in dissemination and implementation research. In R. C. Brownson, G. A. Colditz, & E. K. Proctor (Eds.), Dissemination and implementation research in health: Translating science to practice (pp. 261–280). New York: Oxford University Press.CrossRefGoogle Scholar
  56. Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., et al. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38(2), 65–76. doi: 10.1007/s10488-010-0319-7.PubMedCentralCrossRefPubMedGoogle Scholar
  57. Rauktis, M. E., McCarthy, S., Krackhardt, D., & Cahalane, H. (2010). Innovation in child welfare: The adoption and implementation of Family Group Decision Making in Pennsylvania. Children and Youth Services Review, 32(5), 732–739. doi: 10.1016/j.childyouth.2010.01.010.CrossRefGoogle Scholar
  58. Ravichandran, T. (2000). Swiftness and intensity of administrative innovation adoption: An empirical study of TQM in information systems. Decision Sciences, 31(3), 691–724. doi: 10.1111/j.1540-5915.2000.tb00939.x.CrossRefGoogle Scholar
  59. Richardson, J. W. (2011). Technology adoption in Cambodia: Measuring factors impacting adoption rates. Journal of International Development, 23(5), 697–710. doi: 10.1002/Jid.1661.CrossRefGoogle Scholar
  60. Ritzwoller, D. P., Sukhanova, A., Gaglio, B., & Glasgow, R. E. (2009). Costing behavioral interventions: A practical guide to enhance translation. Annals of Behavioral Medicine, 37(2), 218–227. doi: 10.1007/s12160-009-9088-5.CrossRefPubMedGoogle Scholar
  61. Saldana, L., Chamberlain, P., Bradford, W. D., Campbell, M., & Landsverk, J. (2013). The cost of implementing new strategies (COINS): A method for mapping implementation resources using the Stages of Implementation Completion. Children and Youth Services Review. doi: 10.1016/j.childyouth.2013.10.006.
  62. Savicki, V., & Cooley, E. (1987). The relationship of work environment and client contact to burnout in mental health professionals. Journal of Counseling & Development, 65(5), 249.CrossRefGoogle Scholar
  63. Schoenwald, S. K., & Hoagwood, K. (2001). Effectiveness, transportability, and dissemination of interventions: what matters when? Psychiatric Services, 52(9), 1190–1197.CrossRefPubMedGoogle Scholar
  64. Schoenwald, S. K., Sheidow, A. J., Letourneau, E. J., & Liao, J. G. (2003). Transportability of multisystemic therapy: Evidence for multilevel influences. Mental Health Services Research, 5(4), 223–239. doi: 10.1023/a:1026229102151.CrossRefPubMedGoogle Scholar
  65. Seattle Implementation Research Collaborative. (2013). Instrument Review Project: A comprehensive review of dissemination and implementation science instruments. http://www.seattleimplementation.org/sirc-projects/sirc-instrument-project/. Retrieved January 3, 2014.
  66. Shortell, S. M., Marsteller, J. A., Lin, M., Pearson, M. L., Wu, S.-Y., Mendel, P., et al. (2004). The role of perceived team effectiveness in improving chronic illness care. Medical Care, 42(11), 1040–1048.CrossRefPubMedGoogle Scholar
  67. Sieveking, N., Bellet, W., & Marston, R. C. (1993). Employees’ views of their work experience in private hospital. Health Services Management Research, 6(2), 129–138.PubMedGoogle Scholar
  68. Simpson, D. D., Joe, G. W., & Rowan-Szal, G. A. (2007). Linking the elements of change: Program and client responses to innovation. Journal of Substance Abuse Treatment, 33(2), 201–209. doi: 10.1016/j.jsat.2006.12.022.PubMedCentralCrossRefPubMedGoogle Scholar
  69. Stamatakis, K., Norton, W., Stirman, S., Melvin, C., & Brownson, R. (2013). Developing the next generation of dissemination and implementation researchers: Insights from initial trainees. Implementation Science, 8(29). doi: 10.1186/1748-5908-8-29.
  70. Steckler, A., Goodman, R. M., McLeroy, K. R., Davis, S., & Koch, G. (1992). Measuring the diffusion of innovative health promotion programs. American Journal of Health Promotion, 6(3), 214–224.CrossRefPubMedGoogle Scholar
  71. Stevenson, K., & Baker, R. (2005). Investigating organisational culture in primary care. Quality in Primary Care, 13(4), 191–200.Google Scholar
  72. Talukder, M., & Quazi, A. (2011). The impact of social influence on individuals’ adoption of innovation. Journal of Organizational Computing and Electronic Commerce, 21(2), 111–135. doi: 10.1080/10919392.2011.564483.CrossRefGoogle Scholar
  73. Thompson, R. L., Higgins, C. A., & Howell, J. M. (1991). Personal computing: Toward a conceptual model of utilization. Management Information Systems Quarterly, 15(1), 125–143.CrossRefGoogle Scholar
  74. Valente, T. W. (1996). Social network thresholds in the diffusion of innovations. Social Networks, 18(1), 69–89. doi: 10.1016/0378-8733(95)00256-1.CrossRefGoogle Scholar
  75. Valente, T. W. (2005). Network models and methods for studying the diffusion of innovations. In P. J. Carrington, J. Scott, & S. Wasserman (Eds.), Models and methods in social network analysis. Cambridge: Cambridge University Press.Google Scholar
  76. Venkatesh, V., & Davis, F. D. (2000). A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management Science, 46(2), 186–204.CrossRefGoogle Scholar
  77. Wisdom, J. P., Chor, K. H. B., Hoagwood, K. E., & Horwitz, S. M. (2013). Innovation adoption: A review of theories and constructs. Administration and Policy in Mental Health and Mental Health Services Research,. doi: 10.1007/s10488-013-0486-4. (Advance online publication).PubMedCentralPubMedGoogle Scholar
  78. Yetton, P., Sharma, R., & Southon, G. (1999). Successful IS innovation: The contingent contributions of innovation characteristics and implementation process. Journal of Information Technology, 14(1), 53–68. doi: 10.1080/026839699344746.CrossRefGoogle Scholar
  79. Zahra, S. A., & George, G. (2002). Absorptive capacity: A review, reconceptualization, and extension. Academy of Management Review, 27(2), 185–203. doi: 10.5465/amr.2002.6587995.Google Scholar

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  • Ka Ho Brian Chor
    • 1
    Email author
  • Jennifer P. Wisdom
    • 2
  • Su-Chin Serene Olin
    • 1
  • Kimberly E. Hoagwood
    • 1
  • Sarah M. Horwitz
    • 1
  1. 1.Center for Mental Health Implementation and Dissemination Science in States for Children, Adolescents, and Families (IDEAS Center), Department of Child and Adolescent Psychiatry, New York University Child Study CenterNew York University School of MedicineNew YorkUSA
  2. 2.George Washington UniversityWashingtonUSA

Personalised recommendations