Development and Validation of a Japanese Fidelity Scale for Supported Employment

  • Natsuki Sasaki
  • Sosei Yamaguchi
  • Michiyo Shimodaira
  • Sayaka Sato
  • Ayano Taneda
  • Koji Yoshida
  • Junichiro Ito
Original Article
  • 66 Downloads

Abstract

The Individual Placement and Support (IPS) model of supported employment is an evidence based practice. Although several agencies have been trying to implement the IPS-model since 2005 in Japan, there was no tool to assess the quality. This study developed a Japanese version of the 25-item Individualized Supported Employment Fidelity Scale (J-ISEF), a new Japanese fidelity tool for supported employment based on the IPS model. A working group consisting of researchers and practitioners was formed to develop J-ISEF based on IPS-25. Some experts of the group visited the community agencies in Vermont before the development process. Twenty-six eligible agencies were identified using snowball sampling, and 14 agencies of them agreed and participated at T1. We conducted three cross-sectional surveys (T1, T2 and T3), using the new scale. The first evaluation period (T1) was between September 2013 and February 2014, the second (T2) between September 2014 and February 2015, and the third (T3) between October 2015 and February 2016. High inter-rater reliability (ICC = 0.98 for the entire scale) was confirmed from T1 data. The total score and the service subscale total were positively correlated with employment rate (P < 0.05). A new fidelity scale, J-ISEF, is developed as a quality assessment tool for evidence-based supported employment programs in Japan. The evidence for its inter-rater reliability and criterion-related validity is promising.

Keywords

Individual placement and support Supported employment Fidelity scale Development 

Abbreviations

ICC

Intra-class correlation

IPS

Individual placement and support

JiSEF

Japanese version of the individualized supported employment fidelity scale

RCT

Randomized controlled trial

Notes

Funding

This study was funded by the Ministry of Health, Labour and Welfare in Japan (H23-001: A study on the model construction and the evaluation of community psychiatry to promote community lives, H26-002: A study on facilitating employment for people with mental illness, and H28-001: Policy research for improving the quality of community life of people with mental disorders), JSPS KAKENHI (Grant-in-Aid for Young Scientists [B], 16K21661: Development of Japanese version of IPS/Supported Employment Fidelity Scale and evaluation system). The funding sources had no involvement in decisions regarding study design, data collection, analysis, interpretation of data, or writing of the report.

Compliance with Ethical Standards

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the ethical committee of the National Center of Neurology and Psychiatry and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed Consent

Informed consent was obtained from all agencies included in the study.

Supplementary material

10488_2017_825_MOESM1_ESM.docx (50 kb)
Supplementary material 1 (DOCX 50 KB)
10488_2017_825_MOESM2_ESM.docx (22 kb)
Supplementary material 2 (DOCX 21 KB)
10488_2017_825_MOESM3_ESM.docx (23 kb)
Supplementary material 3 (DOCX 22 KB)

References

  1. Aizawa, K., & Hisanaga, F. (2012). Employment Support Services in Japan. International Journal of Mental Health, 41, 48–60.CrossRefGoogle Scholar
  2. Anzai, N., Yoneda, S., Kumagai, N., Nakamura, Y., Ikebuchi, E., & Liberman, R. P. (2002). Training persons with schizophrenia in illness self-management: A randomized controlled trial in Japan. Psychiatric Services, 53, 545–547.CrossRefPubMedGoogle Scholar
  3. Becker, D. R, Drake, R. E. (2003). A working life for people with severe mental illness. New York: Oxford University Press.CrossRefGoogle Scholar
  4. Bond, G. R., Becker, D. R., & Drake, R. E. (1997). A fidelity scale for the Individual Placement and Support model of supported employment. Rehabilitation Counseling Bulletin, 40, 265–284.Google Scholar
  5. Bond, G. R., Drake, R. E., & Becker, D. R. (2008). An update on randomized controlled trials of evidence-based supported employment. Psychiatric Rehabilitation Journal, 31, 280–290.CrossRefPubMedGoogle Scholar
  6. Bond, G. R., Drake, R. E., & Becker, D. R. (2012a). Generalizability of the Individual Placement and Support (IPS) model of supported employment outside the US. World Psychiatry, 11, 32–39.CrossRefPubMedPubMedCentralGoogle Scholar
  7. Bond, G. R., Johnson-Kwochka, A. V., Becker, D. R., Drake, R. E., & Greene, M. A. (2017). Sustaining and expanding evidence-based supported employment: The role of state leaders participating in a learning community. Administration and Policy in Mental Health, 44, 320–330.CrossRefPubMedGoogle Scholar
  8. Bond, G. R., Peterson, A. E., Becker, D. R., & Drake, R. E. (2012b). Validation of the revised Individual Placement and Support Fidelity scale (IPS-25). Psychiatric Services, 63, 758–763.CrossRefPubMedGoogle Scholar
  9. Drake, R. E., & Becker, D. R. (1996). The Individual Placement and Support model of supported employment. Psychiatric Services, 47, 473–475.CrossRefPubMedGoogle Scholar
  10. Hasegawa, T. (2010). Japan’s employment measures for persons with disabilities: Centered on quota system of act on employment promotion of persons with disabilities. Japan Labor Review, 7, 26–42.Google Scholar
  11. IPS Employment Center. (2016). Resources/programs: IPS fidelity. IPS Center, Rockville. https://www.ipsworks.org/resources/programs/program-implementation-and-fidelity/.
  12. Ito, J. (2011). The development and the evaluation of community care model for mental health. National Center of Neurology and Psychiatry (NCNP), Tokyo. http://www.ncnp.go.jp/nimh/fukki/documents/2011c01.pdf.
  13. Ito, N. (2011). New functions and facts under the Support for Continuous Employment (Type A) scheme: Results from a nationwide survey. Japanese Journal on the Issues of Persons with Disabilties, 39, 68–77. (Japanese).Google Scholar
  14. Johnson-Kwochka, A., Bond, G. R., Becker, D. R., Drake, R. E., & Greene, M. A. (2017). Prevalence and quality of Individual Placement and Support (IPS) supported employment in the United States. Administration and Policy in Mental Health, 44, 311–319.CrossRefPubMedGoogle Scholar
  15. Kim, S. J., Bond, G. R., Becker, D. R., Swanson, S., J, & Langfitt-Reese, S. (2015). Predictive validity of the Individual Placement and Support fidelity scale (IPS-25): A replication study. Journal of Vocational Rehabilitation, 43, 209–216.CrossRefGoogle Scholar
  16. Kinoshita, Y., Furukawa, T. A., Kinoshita, K., Honyashiki, M., Omori, I. M., Marshall, M., et al. (2013). Supported employment for adults with severe mental illness. Cochrane Database of Systematic Reviews, 9, CD008297.Google Scholar
  17. Kurachi, N. (2015). The employment of people with mental disabilities in Japan: The current situation and future prospects. Japan Labor Review, 12, 38–55.Google Scholar
  18. Lockett, H., Waghorn, G., Kydd, R., & Chant, D., (2016). Predictive validity of evidence-based practices in supported employment: A systematic review and meta-analysis. Mental Health Review Journal, 21(4):261–281.  http://dx.doi.org/10.1108/MHRJ-12-2015-0040 CrossRefGoogle Scholar
  19. Matamura, A. (2013). Law for employment promotion of persons with disabilities: To be reviewed. Hiratsuka: Policy Research & Development Center at Inclusion Japan.Google Scholar
  20. Ministry of Health, Labour and Welfare. (2013). Comprehensive Services and Supports for Persons with Disabilities Act. http://www.mhlw.go.jp/seisakunitsuite/bunya/hukushi_kaigo/shougaishahukushi/sougoushien/dl/sougoushien-02.pdf.
  21. Ministry of Health, Labour and Welfare. (2016). Act on Employment Promotion for Persons with Disabilities. http://www.mhlw.go.jp/file/06-Seisakujouhou-11600000-Shokugyouanteikyoku/0000121388.pdf.
  22. Modini, M., Tan, L., Brinchmann, B., Wang, M. J., Killackey, E., Glozier, N., Mykletun, A., & Harvey, S. B. (2016). Supported employment for people with severe mental illness: Systematic review and meta-analysis of the international evidence. British Journal of Psychiatry, 209, 14–22.CrossRefPubMedGoogle Scholar
  23. Noel, V. A., Bond, G. R., Drake, R. E., et al. (2017). Barriers and facilitators to sustainment of an evidence-based supported employment program. Administration and Policy in Mental Health, 44, 331–338.CrossRefPubMedGoogle Scholar
  24. Nonaka, T., & Hirasawa, E. (2012). A community mental health support system for people with mental illness in Japan. International Journal of Mental Health, 41, 19–28.CrossRefGoogle Scholar
  25. Oka, M., Otsuka, K., Yokoyama, N., Mintz, J., Hoshino, K., Niwa, S., & Liberman, R. P. (2004). An evaluation of a hybrid occupational therapy and supported employment program in Japan for persons with schizophrenia. American Journal of Occupational Therapy, 58, 466–475.CrossRefPubMedGoogle Scholar
  26. Oshima, I., Sono, T., Bond, G. R., Nishio, M., & Ito, J. (2014). A randomized controlled trial of Individual Placement and Support in Japan. Psychiatric Rehabilitation Journal, 37, 137–143.CrossRefPubMedGoogle Scholar
  27. Setoya, Y. (2012). Overview of the Japanese mental health system. International Journal of Mental Health, 41, 3–18.CrossRefGoogle Scholar
  28. Statistic, & Bureau, M.o.I.A.a.C. (2015). Labour survey.Google Scholar
  29. Waghorn, G., Childs, S., Hampton, E., Gladman, B., Greaves, A., & Bowman, D. (2012). Enhancing community mental health services through formal partnerships with supported employment services. American Journal of Psychiatric Rehabilitation, 15(2), 157–180.CrossRefGoogle Scholar
  30. Waghorn, G., Collister, L., Killackey, E., & Sherring, J. (2007). Challenges to the implementation of evidence-based employment services in Australia. Journal of Vocational Rehabilitation, 27, 29–37.Google Scholar
  31. Waghorn, G., & Hielscher, E. (2015). The availability of evidence-based supported employment for Australian adults with severe and persistent mental illness. Australian Occupational Therapy Journal, 62(2), 141–144.CrossRefPubMedGoogle Scholar
  32. Yamaguchi, S., Sato, S., Horio, N., Yoshida, K., Shimodaira, M., Taneda, A. et al. (2016). Cost-effectiveness of cognitive remediation and supported employment for people with mental illness: A randomized controlled trial. Psychological Medicine. doi:  10.1017/S0033291716002063.PubMedGoogle Scholar
  33. Yamamoto, Y., Yamamoto, M., & Fujita-Sano, M. (2015). Study of vocational transition support for university students with disabilities. Bulletin of General Health Research, 31, 71–78. (Japanese).Google Scholar
  34. Yoda, T. (2010). Japanese support system for competitive employment of persons with disabilities. Japan Labor Review, 7, 54–72.Google Scholar
  35. Yoshida, K., & Ito, J. (2012). Recovery-oriented community-based mental health service in Japan. International Journal of Mental Health, 41, 29–37.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2017

Authors and Affiliations

  • Natsuki Sasaki
    • 1
  • Sosei Yamaguchi
    • 1
  • Michiyo Shimodaira
    • 2
    • 3
  • Sayaka Sato
    • 1
  • Ayano Taneda
    • 1
  • Koji Yoshida
    • 4
  • Junichiro Ito
    • 1
    • 3
  1. 1.Department of Psychiatric Rehabilitation, National Institute of Mental HealthNational Center of Neurology and Psychiatry (NCNP)KodairaJapan
  2. 2.Department of Mental Health, School of MedicineThe University of TokyoTokyoJapan
  3. 3.Mental Health Clinic Si Puo FareIchikawaJapan
  4. 4.Department of Social Welfare, Faculty of Human and Social SciencesShowa Women’s UniversityTokyoJapan

Personalised recommendations