Skip to main content

Advertisement

Log in

Knowledge, Attitudes, Social Desirability, and Organizational Characteristics in Youth Mental Health Services

  • Published:
The Journal of Behavioral Health Services & Research Aims and scope Submit manuscript

Abstract

This project investigated the extent to which knowledge of evidence-based practices (EBPs) and organizational characteristics predicted attitudes toward EBPs, while controlling for social desirability and organization membership. Participants were 167 public sector youth practitioners. Hierarchical multiple regression analyses were conducted to determine which factors significantly predicted EBP attitudes. Findings suggested that social desirability, organization membership, and various organizational characteristics predicted EBP attitudes. Results are discussed as they relate to the importance of including social desirability in future research and identifying different factors that influence EBP attitudes across various organizations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Notes

  1. From this point forward, EBP-related constructs will refer to evidence-based treatment practices, rather than evidence-based assessment strategies.

  2. In Hawaii’s public sector system, therapists are not required to have a license if they are supervised by a licensed mental health professional. In addition, the difference between licensed and unlicensed therapists on EBP attitudes was not significant (F(1, 164) = 2.216, p = 0.139).

  3. A multilevel regression analysis was considered but decided against. While the participants were part of the same larger organizations that set the guidelines for which they work (e.g., CAMHD and DOE), they each came from various agencies or schools nested within those departments. The sample size of each agency or school was between 1 and 15, which is too small to conduct a multilevel model.

  4. The use of the word “predictor” was chosen due to the conventional use of this term in multiple regression analyses. It should be noted that the use of “predictor” refers to the independent variables of this cross-sectional study.

  5. A moderation analysis was conducted by creating interaction terms between the dummy coded variable of organization membership and the predictor variables. Each interaction was checked one by one and found to be non-significant in predicting the dependent variable. Thus, none of the interaction terms were retained in the main analyses.

  6. Supplemental analyses were conducted with the original MPAS instead of the Aggregated EBP Attitudes score. A majority of the findings were maintained (i.e., variables that significantly predicted positive EBP attitudes included organizational membership and stress and the variables that approached significance included social desirability and cohesion).

References

  1. Children’s health topics: Behavioral and mental health. American Academy of Pediatrics. Available online at http://www.aap.org/healthtopics/behavmenthlth.cfm. Accessed 2011.

  2. Chorpita BF, Daleiden EL, Weisz JR. Identifying and selecting the common elements of evidence-based interventions: A distillation and matching model. Mental Health Services Research. 2005; 7: 5–20. doi: 10.1007/s11020-005-1962-6.

    Article  PubMed  Google Scholar 

  3. Lonigan CJ, Elbert JC, Johnson S. Empirically supported psychosocial interventions for children: An overview. Journal of Clinical Child and Adolescent Psychology. 1998; 27: 138–145. doi:10.1207/s15374424jccp2702_1.

    Article  CAS  Google Scholar 

  4. Silverman WK, Hinshaw SP. The second special issue on evidence-based psychosocial treatments for children and adolescents: A 10-year update. Journal of Clinical Child and Adolescent Psychology. 2008; 37(1): 1–7. doi:10.1080/15374410701817725

    Article  Google Scholar 

  5. Weisz JR, Hawley KM, Doss AJ. Empirically tested psychotherapies for youth internalizing and externalizing problems and disorders. Child and Adolescent Psychiatric Clinics of North America. Special Issue: Evidence-Based Practice, Part I: Research Update. 2004; 13(4): 729–815. doi:10.1016/j.chc.2004.05.006.

    Google Scholar 

  6. Damschroder L, Aron D, Keith R, et al. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation Science. 2009; 4(50): 1–15. doi:10.1186/1748-5908-4-50.

    Google Scholar 

  7. Fixsen DL, Naoom SF, Blase KA, et al. Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Research Institute, The National Implementation Research Network; 2005.

    Google Scholar 

  8. Ajzen I. The theory of planned behavior. Organizational Behavior and Human Decision Processes. 1991; 50: 179–211. doi: 10.1016/0749-5978(91)90020-T.

    Article  Google Scholar 

  9. Cote F, Gagnon J, Houme PK, et al. Using the Theory of Planned Behaviour to predict nurses’ intention to integrate research evidence into clinical decision-making. Journal of Advanced Nursing. 2012; 68(10): 2289–2298. doi: 10.1111/j.1365-2648.2011.05922.x

    Article  PubMed  Google Scholar 

  10. Kelly PJ, Deane FP, Lovett MJ. Using the theory of planned behavior to examine residential substance abuse workers intention to use evidence-based practices. Psychology of Addictive Behaviors. 2012; 26(3): 661–664. doi: 10.1037/a0027887.

    Article  PubMed  Google Scholar 

  11. Walker A, Watson M, Grimshaw J, et al. Applying the theory of planned behaviour to pharmacists’ beliefs and intentions about the treatment of vaginal candidiasis with non-prescription medicines. Family Practice. 2004; 21: 670–676. doi: 10.1093/fampra/cmh615.

    Article  PubMed  Google Scholar 

  12. Rogers EM. Diffusion of Innovations. 5th ed. New York, NY: Free Press; 2004.

    Google Scholar 

  13. Lim A, Nakamura BJ, Higa-McMillan C, et al. Effects of workshop trainings on evidence-based practice knowledge and attitudes among youth community mental health providers. Behaviour Research and Therapy. 2012; 50: 397–406. doi: 10.1016/j.brat.2012.03.008.

    Article  PubMed  Google Scholar 

  14. Nakamura BJ, Higa-McMillan C, Okamura K, et al. Knowledge of and attitudes towards evidence-based practices in community child mental health practitioners. Administration and Policy in Mental Health and Mental Health Services Research. 2011; 38(4): 287–300. doi: 10.1007/s10488-011-0351-2.

    Article  PubMed  Google Scholar 

  15. Jensen-Doss A, Hawley KM. Understanding barriers to evidence-based assessment: Clinician attitudes toward standardized assessment tools. Journal of Clinical Child and Adolescent Psychology. 2010; 39(6): 885–896. doi: 10.1080/15374416.2010.517169.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Jensen-Doss A, Hawley KM. Understanding clinicians’ diagnostic practices: Attitudes toward the utility of diagnosis and standardized diagnostic tools. Administration and Policy in Mental Health and Mental Health Services Research. 2011; 38: 476–487. doi: 10.1007/s10488-011-0334-3.

    Article  PubMed  Google Scholar 

  17. Becker EM, Smith AM, Jensen-Doss A. Who’s using treatment manuals? A national survey of practicing therapists. Behaviour Research and Therapy. 2013; 51: 706–710. doi: 10.1016/j.brat.2013.07.008.

    Article  PubMed  Google Scholar 

  18. Kolko D, Cohen JA, Mannarino AP, et al. Community treatment of child sexual abuse: A survey of practitioners in the National Child Traumatic Stress Network. Administration and Policy in Mental Health and Mental Health Services Research. 2009; 36(1): 37–49. doi: 10.1007/s10488-008-0180-0.

    Article  PubMed  Google Scholar 

  19. Beidas RS, Kendall PC. Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science and Practice. 2010; 17(1): 1–30. doi: 10.1111/j.1468-2850.2009.01187.x.

    Google Scholar 

  20. Stumpf RE, Higa-McMillan CK, Chorpita BF. Implementation of evidence-based services for youth: Assessing provider knowledge. Behavior Modification. 2009; 33: 4865. doi:10.1177/0145445508322625.

    Article  PubMed  Google Scholar 

  21. Melas CD, Zampetakis LA, Dimopoulou A, et al. Evaluating the properties of the Evidence-Based Practice Attitude Scale (EBPAS) in health care. Psychological Assessment. 2012; 24(4): 867–876. doi: 10.1037/a0027445.

    Article  PubMed  Google Scholar 

  22. Hartzler B, Baer JS, Dunn C, et al. What is seen through the looking glass: The impact of training on practitioner self-rating of motivational interviewing skills. Behavioural and Cognitive Psychotherapy. 2007; 35(4): 431–445. doi: 10.1017/S1352465807003712.

    Article  Google Scholar 

  23. Manuel JK, Hagedorn HJ, Finney JW. Implementing evidence-based psychosocial treatment in specialty substance use disorder care. Psychology of Addictive Behaviors. 2011; 25(2): 225–237. doi: 10.1037/a0022398.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Crowne DP, Marlowe D. A new scale of social desirability independent of psychopathology. Journal of Consulting Psychology. 1960; 24: 349–354. doi: 10.1037/h0047358

    Article  CAS  PubMed  Google Scholar 

  25. Croucher SM, Kassing JW, Diers-Lawson AR. Accuracy, coherence, and discrepancy in self- and other-reports: moving toward an interactive perspective of organization dissent. Management Communication Quarterly. 2013; 27: 425–442. doi: 10.1177/0893318913476142.

    Article  Google Scholar 

  26. Edwards AL. The relationship between the judged desirability of a trait and the probability that the trait will be endorsed. The Journal of Applied Psychology. 1953; 37(2): 90–93. doi: 10.1037/h0058073.

    Article  Google Scholar 

  27. Pedregon CA, Farley RL, Davis A, et al. Social Desirability, personality questionnaires, and the “better than average” effect. Personality and Individual Difference. 2012; 52: 213–217. doi: 10.1016/j.paid.2011.10.022.

    Article  Google Scholar 

  28. Kowalska J., Winnicka J. Attitudes of undergraduate students towards persons with disabilities; the role of the need for social approval. Polish Psychological Bulletin. 2013; 44(1): 40–49. doi: 10.2478/ppb-2013-0005.

    Article  Google Scholar 

  29. Fu W, Deshpande SP, Zhao X. The impact of ethical behavior and facets of job satisfaction on organizational commitment of Chinese Employees. Journal of Business Ethics. 2011; 104: 537–543. doi: 10.1007/s10551-011-0928-4.

    Article  Google Scholar 

  30. Carels RA, Cacciapaglis HM, Rydin S, et al. Can social desirability interfere with success in a behavioral weight loss program? Psychology and Health. 2006; 21(1): 65–78. doi: 10.1080/14768320500102277.

    Article  Google Scholar 

  31. Aarons GA, Glisson C, Green PD, et al. The organizational social context of mental health services and clinician attitudes toward evidence-based practice: A United States national study. Implementation Science. 2012; 7(56): 1–28. doi: 10.1186/1748-5908-7-56.

    Google Scholar 

  32. Aarons GA, Sawitzky AC. Organizational culture and climate and mental health provider attitudes toward evidence-based practice. Psychological Services. 2006; 3(1): 61–72. doi: 10.1037/1541-1559.3.1.61.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Aarons GA, Sommerfeld DH. Leadership, innovation climate, and attitudes toward evidence-based practice during a statewide implementation. Journal of the American Academy of Child and Adolescent Psychiatry. 2012; 51(4): 423–431. doi: 10.1016/j.jaac.2012.01.018.

    Article  PubMed  Google Scholar 

  34. Glisson C, Green P, Williams NJ. Assessing the organizational social context (OSC) of child welfare systems: Implications for research and practice. Child Abuse & Neglect. 2012; 36: 621– 632. doi: 10.1016/j.chiabu.2012.06.002.

    Article  Google Scholar 

  35. Glisson C, Williams NJ, Green P, et al. The organizational social context of mental health medicaid waiver programs with family support services: Implications for research and practice. Administration and Policy in Mental Health and Mental Health Services. 2013; 41(1): 32–42. doi: 10.1007/s10488-013-0517-1.

    Article  Google Scholar 

  36. Aarons GA, Sommerfeld DH, Walrath-Greene CM. Evidence-based practice implementation: The impact of public versus private sector organization type on organizational support, provider attitudes, and adoption of evidence-based practice. Implementation Science. 2009; 4(83): 1–13. doi:10.1186/1748-5908-4-83.

    Google Scholar 

  37. Sinkowitz-Cochran RL, Burkitt KH, Cuerdon T, et al. The associations between organizational culture and knowledge, attitudes, and practices in a multicenter Veterans Affairs quality improvement initiative to prevent methicillin-resistant Staphylococcus aureus. American Journal of Infection Control. 2012; 40: 138–143. doi:10.1016/j.ajic.2011.04.332.

    Article  PubMed  Google Scholar 

  38. Glisson C. The organizational context of children’s mental health services. Clinical Child and Family Psychology Review. 2002; 5(4): 233–253. doi: 10.1023/A:1020972906177.

    Article  PubMed  Google Scholar 

  39. Wisdom JP, Chor KHB, Hoagwood KE, et al. Innovation adoption: A review of theories and constructs. Administration and Policy in Mental Health and Mental Health Related Services. 2014; 41: 480–502. doi: 10.1007/s10488-013-0486-4.

    Article  Google Scholar 

  40. Frambach RT, Schillewaert N. Organizational innovation adoption: A multi-level framework of determinants and opportunities for future research. Journal of Business Research. 2002; 55(2): 163–176. doi:10.1016/S0148-2963(00)00152-1.

    Article  Google Scholar 

  41. State of Hawaii Department of Education Office of Curriculum, Instruction and Student Support and Department of Health Child & Adolescent Mental Health Division. Interagency Performance Standards and Practice Guidelines. State of Hawaii Publication No. 06–310, Honolulu, HI: Hawaii State Department of Health, 2006.

  42. Nakamura BJ, Selbo-Bruns A, Okamura K, et al. Developing a systematic evaluation approach for training programs within a train-the-trainer model for youth cognitive behavior therapy. Behavior Research and Therapy. 2014; 53: 10–19. doi: 10.1016/j.brat.2013.12.001.

    Article  Google Scholar 

  43. Ebesutani C, Bernstein A, Nakamura B, et al. A psychometric analysis of the revised child anxiety and depression scale – parent version in a clinical sample. Journal of Abnormal Child Psychology. 2010; 38(2): 249–260. doi: 10.1007/s10802-009-9363-8.

    Article  PubMed  Google Scholar 

  44. Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: The Evidence-Based Practice Attitude Scale (EBPAS). Mental Health Services Research. 2004; 6: 61–74. doi:10.1023/B:MHSR.0000024351.12294.65.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Aarons GA, Glisson C, Hoagwood K, et al. Psychometric properties and U.S. National norms of the Evidence-Based Practice Attitude Scale (EBPAS). Psychological Assessment. 2010; 22(2): 356–365. doi: 10.1037/a0019188.

    Article  PubMed  Google Scholar 

  46. Chorpita BF, Daleiden E. Evidence-based services committee - Biennial report – Effective psychological interventions for youth with behavioral and emotional needs. Honolulu, HI: Hawaii Department of Health Child and Adolescent Mental Health Division; 2009.

    Google Scholar 

  47. Okamura KH, Nakamura BJ, Mueller C, et al. An exploratory factor analysis of the knowledge of evidence-based services questionnaire. Journal of Behavioral Health Services & Research. 2014; 1–18. doi:10.1007/s11414-013-9384-5.

  48. Weist M, Lever N, Stephan S, et al. Formative evaluation of a framework for high quality, evidence-based services in school mental health. School Mental Health. 2009; 1(4): 196–211. doi: 10.1007/s12310-009-9018-5.

    Article  Google Scholar 

  49. Reynolds WM. Development of reliable and valid short forms of the Marlowe-Crowne Social Desirability Scale. Journal of Clinical Psychology. 1982; 38: 119 –125. doi: 10.1002/1097-4679(198201)38:1<119::AID-JCLP2270380118>3.0.CO;2-I.

    Article  Google Scholar 

  50. Borntrager CF, Chorpita BF, Higa-McMillan CK, et al. Provider attitudes toward evidence-based practices: Are the concerns with the evidence or with the manuals? Psychiatric Services. 2009; 60: 677–681. doi: 10.1176/appi.ps.60.5.677.

    Article  PubMed  Google Scholar 

  51. Haynes SN, Yoshioka DT. Clinical assessment applications of ambulatory biosensors. Psychological Assessment. 2007; 19(1): 44–57. doi: 10.1037/1040-3590.19.1.44.

    Article  PubMed  Google Scholar 

  52. Keaweaimoku Kaholokula J, Haynes SN, Grandinetti A, et al. Biological, psychosocial, and sociodemographic variables associated with depressive symptoms in persons with Type 2 Diabetes. Journal of Behavioral Medicine. 2003; 26(5): 435–458. doi: 10.1023/A:1025772001665.

    Article  PubMed  Google Scholar 

  53. Haynes SN, Smith G, Hunsley JR. Scientific Foundations of Clinical Assessment. New York, NY: Taylor and Francis/Routledge; 2011.

    Google Scholar 

  54. Lehman WEK, Greener JM, Simpson D. Assessing organizational readiness for change. Journal of Substance Abuse Treatment. 2002; 22: 197209. doi: 10.1016/S0740-5472(02)00233-7.

    Article  PubMed  Google Scholar 

  55. Henggeler SW, Chapman JE, Rowland MD, et al. Statewide adoption and initial implementation of contingency management for substance-abusing adolescents. Journal of Consulting and Clinical Psychology. 2008; 76(4): 556–567. doi: 10.1037/0022-006X.76.4.556.

    Article  PubMed  PubMed Central  Google Scholar 

  56. Henggeler SW, Chapman JE, Rowland MD, et al. If you build it, they will come: Statewide practitioner interest in contingency management for youths. Journal of Substance Abuse Treatment. 2007; 32: 121131. doi:10.1016/j.jsat.2006.07.006.

    Article  PubMed  Google Scholar 

  57. Saldana L, Chapman JE, Henggeler SW, et al. The organizational readiness for change scale in adolescent programs: Criterion validity. Journal of Substance Abuse Treatment. 2007; 33: 159 – 169. doi:10.1016/j.jsat.2006.12.029.

    Article  PubMed  PubMed Central  Google Scholar 

  58. Barwick MA, Peters J, Boydell K. Getting to uptake: Do communities of practice support the implementation of evidence-based practice? Journal of the Canadian Academy of Children and Adolescent Psychiatry. 2009; 18(1): 16–29.

    Google Scholar 

  59. Hamilton AB, Cohen AN, Young AS. Organizational readiness in specialty mental health care. Journal of General Internal Medicine. 2009; 25(Suppl 1): 27–31. doi: 10.1007/s11606-009-1133-3.

    Google Scholar 

  60. Schurer J, Kohl PL, Bellamy JL. Organizational context and readiness for change: A study of community-based parenting programs in one Midwestern city. Administration in Social Work. 2010; 34: 178–195. doi:10.1080/03643101003609487.

    Article  Google Scholar 

  61. Simpson DD. Organizational readiness for stage-based dynamics of innovation implementation. Research on Social Work Practice. 2009; 19(5): 541–551. doi: 10.1177/1049731509335589.

    Article  Google Scholar 

  62. Beidas RS, Mychailyszyn MP, Edmunds JM, et al. Training school mental health providers to delivers cognitive-behavioral therapy. School Mental Health. 2012; 1: 1–12. doi: 10.1007/s12310-012-9074-0.

    Google Scholar 

  63. Statistical Package for the Social Sciences, Inc. S.P.S.S. 15.0 base user's guide. Prentice Hall; 2006.

  64. Little RJA, Rubin DB. Statistical Analysis with Missing Data. New York, NY: John Wiley & Sons; 1987.

    Google Scholar 

  65. Shapiro SS, Wilk MB. An analysis of variance test for normality (complete samples). Biometrika. 1965; 52: 591611. doi: 10.1093/biomet/52.3-4.591.

    Article  Google Scholar 

  66. Tabachnick BG, Fidell LS. Using Multivariate Statistics. 5th ed. Upper Saddle River, NJ: Allyn & Bacon; 2007.

    Google Scholar 

  67. Faul F, Erdfelder E, Lang A, et al. G*Power 3. Heinrich Heine Universitat Dusseldorf. Available online at http://www.psycho.uni-duesseldorf.de/abteilungen/aap/gpower3/. Accessed September, 16, 2013.

  68. Green SB, Salkind NJ. Using SPSS for Windows and Macintosh: Analyzing and understanding data. 4th ed. NJ: Pearson Education, Inc.; 2005.

    Google Scholar 

  69. Brown CE, Wickline MA, Ecoff L, et al. Nursing practice, knowledge, attitudes and perceived barriers to evidence-based practice at an academic medical center. Journal of Advanced Nursing. 2008; 65(2): 371–381. doi: 10.1111/j.1365-2648.2008.04878.x.

    Article  PubMed  Google Scholar 

  70. Chau JPC, Lopez V, Thompson DR. A survey of Hong Kong nurses' perceptions of barriers to and facilitators of research utilization. Research in Nursing & Health. 2008; 31(6): 640–649. doi: 10.1002/nur.20289.

    Article  Google Scholar 

  71. Cummings GG, Estabrooks CA, Midodzi WK, et al. Influence of organizational characteristics and context on research utilization. Nursing Research. 2007; 54(4s): s24-s39. doi: 10.1097/01.NNR.0000280629.63654.95.

    Article  Google Scholar 

  72. Egerod I, Hansen GM. Evidence-based practice among Danish cardiac nurses: A national survey. Journal of Advanced Nursing. 2004; 51(5): 465 – 473. doi: 10.1111/j.1365-2648.2005.03525.x.

    Article  Google Scholar 

  73. Estrada N. Exploring perceptions of a learning organization by RNs and relationship to EBP beliefs and implementation in the acute care setting. Worldviews on Evidence-Based Nursing. 2009; 6(4): 200–209. doi: 10.1111/j.1741-6787.2009.00161.x.

    Article  PubMed  Google Scholar 

  74. Beidas RS, Marcus S, Aarons GA, et al. Predictors of community therapists’ use of therapy techniques in a large public mental health system. Journal of the American Medical Association Pediatrics. 2015; E1 – E9. doi: 10.1001/jamapediatrics.2014.3736.

  75. Henggeler SW, Borduin CM. Family therapy and beyond: A multisystemic approach to treating the behavior problems of children and adolescents. Pacific Grove, CA: Brooks/Cole; 1990.

    Google Scholar 

  76. Alexander JF, & Parsons, B. V. Short-term behavioral intervention with delinquent families: Impact on family process and recidivism. Journal of Abnormal Psychology. 1973; 81(3): 219– 225. doi:10.1037/h0034537.

    Article  CAS  PubMed  Google Scholar 

  77. Child and Adolescent Mental Health Division. Instructions and codebook for provider monthly summaries. Honolulu, HI: Hawaii Department of Health Child and Adolescent Mental Health Division; 2003.

  78. Higa-McMillan CK, Powell CKK, Daleiden EL, et al. Pursuing an evidence-based culture through contextualized feedback: Aligning youth outcome and practices. Professional Psychology: Research and Practice. 2011; 42(2): 137–144. doi: 10.1037/a0022139.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sonia C. Izmirian MA.

Ethics declarations

Conflict of interest

The authors have no conflicts of interest to report.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Izmirian, S.C., Nakamura, B.J. Knowledge, Attitudes, Social Desirability, and Organizational Characteristics in Youth Mental Health Services. J Behav Health Serv Res 43, 630–647 (2016). https://doi.org/10.1007/s11414-015-9491-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11414-015-9491-6

Keywords

Navigation