Skip to main content

Advertisement

Log in

The interactive symptoms assessment: I.S.A. – development and validation using a knowledge translation-integrated model

  • Published:
Current Psychology Aims and scope Submit manuscript

Abstract

A Knowledge Translation Integrated (KTI) model was used to validate the Interactive Symptom Assessment (ISA). The aim of KTI methodology is to engage key potential knowledge-users at all stages of measure design and research, with the aim of enhancing the credibility, acceptability, feasibility, and sustainability of the measure. The ISA is an interactive video-based measure of mental health and well-being functioning across a wide variety of internalizing and externalizing domains for children ages 6 to 12. Through the current study, the measure was found to demonstrate credibility, as measured by face validity, content validity, and Cronbach’s internal consistency reliability (.88 long form, .83 short form; children ages 6 to 12). Further, the ISA demonstrated good criterion-related validity, as scores on this measure were significantly associated self-esteem and mental health. Children and mental health practitioners perceived the wording and design of the measure to be acceptable. Further, with regard to sustainability and feasibility, knowledge-users reported satisfaction with the questionnaire and mental health practitioners indicated the ISA might be useful in their clinical practices. However, participants in this study recommended that a short form of the ISA, as well as brief screening measures, be created so that the measure would be more feasible to use when repeated administration is required. Therefore, validity and reliability findings for both the ISA short and long form, as well as for brief screening measures of depressive, anxiety, and behavioral symptoms, are reported.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

References

  • American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author.

    Book  Google Scholar 

  • American Psychological Association. (1985). Standards for educational and psychological testing. Washington: Author.

    Google Scholar 

  • Amsden, J., & VanWynsberghe, R. (2005). Community mapping as a research tool with youth. Action Research, 3, 353–377. https://doi.org/10.1177/1476750305058487.

    Article  Google Scholar 

  • Angold, A., & Costello, J. (2000). The child and adolescent psychiatric assessment (CAPA). The Journal of the American Academy of Child and Adolescent Psychiatry, 39, 39–48 Retrieved from https://journals-scholarsportal-info.proxy.bib.uottawa.ca/pdf/08908567/v39i0001/39_tcaapa.xml.

    Article  Google Scholar 

  • Anthoine, E., Moret, L., Regnault, A., Sebille, V., & Hardouin, J. B. (2014). How many individuals are used to validate a scale? A review of publications on patient reported outcomes measures. Health and Quality of Life Outcomes, 12, 176. https://doi.org/10.1186/s12955-014-0176-2.

    Article  PubMed  Google Scholar 

  • Armstrong, L. L. (2009). A utilization-focused approach to evaluating a “youth-friendly” mental health program: The youth net/Réseau ado story. Vulnerable Children and Youth Studies, 4, 361–369. https://doi.org/10.1080/17450120902923213.

    Article  Google Scholar 

  • Armstrong, L.L., Desson, S., St. John, E., & Watt, E. (2018). The D.R.E.A.M. Program: Developing Resilience through Emotions, Attitudes, & Meaning (Gifted Edition) – A Second Wave Positive Psychology Approach. Counselling Psychology Quarterly, online first. https://doi.org/10.1080/09515070.2018.1559798

  • Armstrong, L.L., Watt, E., St. John, & Desson (2019). The Child Identity and Purpose Questionnaire – Interactive: Development and Validation of the Revised, Video-Based Version. The Humanistic Psychologist, online first. https://doi.org/10.1037/hum0000147

  • Beidas, R. S., Stewart, R., Walsh, L., Lucas, S., Downey, M. M., Jackson, K., Fernandez, T., & Mandell, D. S. (2016). Free brief, and validated: Standardized instrument for low-resource mental health settings. Cognitive Behavioural Practice, 22, 5–19. https://doi.org/10.1016/j.cbpra.2014.02.002.

    Article  Google Scholar 

  • Benson, T., Sladen, J., Liles, A., & Potts, H.W.W. (2019). Personal wellbeing score (PWS)—A short version of ONS4: Development and validation in social prescribing. British Medical Journal, online first. https://doi.org/10.1136/bmjoq-2018-000394.

  • Bergeron, L., Berthiaume, C., St. Georges, M., Piché, G., & Smolla, N. (2013). Reliability, validity and clinical use of the Dominic interactive: A DSM-based self-report screen for school-aged children. The Canadian Journal of Psychiatry / La Revue canadienne de psychiatrie, 58, 466–475. https://doi.org/10.1177/070674371305800805.

    Article  Google Scholar 

  • Boat, T. F., & Wu, J. T. (2015). Committee to evaluate the supplemental security income DISAbility program for children with mental disorders. Mental disorders and dISAbilities among low-income children. Washington (DC): National Academies Press.

    Google Scholar 

  • Bouwmans, C., De Jong, K., Timman, R., Zijlstra-Vlasveld, M., Van der Feltz-Cornelis, C., Tan Swan, S., & Hakkaart-van Roijen, L. (2013). Feasibility, reliability and validity of a questionnaire on healthcare consumption and productivity loss in patients with a psychiatric disorder (TiC-P). BMC Health Services Research, 2, 213–217. https://doi.org/10.1186/1472-6963-13-217.

    Article  Google Scholar 

  • Bowen, S., & Graham, I. D. (2013). Integrated knowledge translation. In S. Straus, J. Tetroe, & I. D. Graham (Eds.), Knowledge translation in health care: Moving from evidence to practice (2nd ed., pp. 14–21). Toronto: John Wiley & Sons.

    Chapter  Google Scholar 

  • Brancato, G., Macchia, S., Murgia, M., Signore, M., Simeoni, G., Blanke, K., Hoffmeyer-Zlotnik, J. (2006). Handbook of recommended practices for questionnaire development and testing in the European statistical system. European Statistical System.

  • Cadman, D., Boyle, M., Szatmari, P., & Offord, D. R. (1987). Chronic illness, disability, and mental and social well-being: Findings of the Ontario child health study. Pediatrics, 79, 805–813 Retrieved from https://www.istat.it/it/files/2013/12/Handbook_questionnaire_development_2006.pdf.

    Article  Google Scholar 

  • Canadian Mental Health Association. (2018). Mental illnesses in children and youth. Retrieved from https://www.cmha.ca

  • Cohen, S. R., Mount, B. M., Strobel, M. G., & Bui, F. (1995). The McGill quality of life questionnaire: A measure of quality of life appropriate for people with advanced disease. A preliminary study of validity and acceptability. Palliative Medicine, 9, 207–219. https://doi.org/10.1177/026921639500900306.

    Article  PubMed  Google Scholar 

  • Commissioner for Children and Young People. (2016). Involving children and young people: Participation guidelines. Western Australia: Author Retrieved from: https://www.ccyp.wa.gov.au/media/1463/report-our-children-cant-wait-december-2015.pdf.

    Google Scholar 

  • Conners, C. K. (2015). Conners (3rd ed.). North Tonawanda: Multi-Health Systems.

    Google Scholar 

  • Cusack, C., Cohen, B., Mignone, J., Chartier, M. J., & Lutfiyya, Z. (2018). Participatory action as a research method with public health nurses. Journal of Advanced Nursing, 74, 1544–1553. https://doi.org/10.1111/jan.13555.

    Article  PubMed  Google Scholar 

  • Davidson, S., & Manion, I. (1996). Facing the challenge: Mental health and illness in Canadian youth. Psychology, Health & Medicine, 1, 41–56. https://doi.org/10.1080/13548509608400005.

    Article  Google Scholar 

  • Davidson-Hunt, I. J., & O’Flaherty, R. M. (2007). Researchers, indigenous peoples, and place-based learning communities. Society & Natural Resources, 20, 291–305. https://doi.org/10.1080/08941920601161312.

    Article  Google Scholar 

  • Deighton, J., Courdace, T., Fonagy, P., Brown, J., Patalay, P., & Wolpert, W. (2014). Measuring mental health and well-being outcomes for children and adolescents to inform practice and policy: A review of child self-report measures. Child and Adolescent Psychiatry and Mental Health, 8, 1–14. https://doi.org/10.1186/1753-2000-8-14.

    Article  Google Scholar 

  • Dolan, P., & Metcalfe, R. (2012). Measuring subjective wellbeing: Recommendations on measures for use by national governments. Journal of Social Policy, 41, 409–427. https://doi.org/10.1017/S004727941100833.

    Article  Google Scholar 

  • Elsley, S., & McMellon, C. (2010). Checking it out: A consultation with children and young people on a draft framework for children and young people’s mental health indicators. Glasgow: NHS Health Scotland.

    Google Scholar 

  • Garson, D. G. (2008). Factor Analysis: Statnotes. Retrieved from http://www2.chass.ncsu.edu/garson/pa765/factor.htm.

  • Goodman, R., Ford, T., Simmons, H., Gatward, R., & Meltzer, H. (2000). Using the strengths and difficulties questionnaire (SDQ) to screen for child psychiatric disorders in a community sample. British Journal of Psychiatric, 177, 534–539. https://doi.org/10.1192/bjp.177.6534.

    Article  Google Scholar 

  • Graham, I. D., Logan, J., Harrison, M. B., Straus, S. E., Tetroe, J., Caswell, W., & Robinson, N. (2006). Lost in knowledge translation: Time for a map? Journal of Continuing Education Health in the Health Professions, 26, 13–24. https://doi.org/10.1002/chp.47.

    Article  Google Scholar 

  • Harcourt, D., Perry, B., & Waller, T. (Eds.). (2011). Researching young children’s perspectives: Debating the ethics and dilemmas of educational research with children. New York: Routledge.

    Google Scholar 

  • Harter, S. (2012). Self-perception profile for children. Denver: University of Denver.

    Book  Google Scholar 

  • Hunsley, J., & Mash, E. J. (2008). Developing criteria for evidence-based assessment : An introduction to assessments that works. In J. Hunsley & E. J. Mash (Eds.), A guide to assessments that work (pp. 3–14). New York: Oxford University Press.

    Chapter  Google Scholar 

  • International Organization for Standardization (2017). Sustainability. Retrieved https://www.iso.org

  • Joint Committee on Standards for Educational Evaluation. (1981). Standards for evaluations of educational programs, projects, and materials. New York: Mc-Graw Hill Company.

  • Judd, J., Frankish, J., & Moulton, G. (2001). Setting standards in the evaluation of community-based health promotion programmes— A unifying approach. Oxford Journals Medicine & Health Promotion International, 16, 367–380. https://doi.org/10.1093/heapro/16.4.367.

    Article  Google Scholar 

  • MacDonald, C. (2012). Understanding participatory action research: A qualitative research methodology option. Canadian Journal of Action Research, 13, 34–50 Retrieved from http://cjar.nipissingu.ca/index.php/cjar/article/view/37/33.

    Google Scholar 

  • Mental Health Commission of Canada. (2018). Changing directions, changing lives: The mental health strategy for Canada. Calgary: Author.

    Google Scholar 

  • Muris, P., Meesters, C., & van den Berg, F. (2003). The Strengths and Difficulties Questionnaire (SDQ)—Further evidence for its reliability and validity in a community sample of Dutch children and adolescents. European Child and Adolescent Psychiatry, 12, 1–8. https://doi.org/10.1007/s00787-003-0298-2.

  • National Alliance on Mental Illness. (2019). Mental Health By The Numbers. Retrieved from https://www.nami.org/learn-more/mental-health-by-the-numbers.

  • NICE Clinical Guidelines. (2005). Depression in children and young people: Identification and management in primary, community and secondary care, No. 28. National Collaborating Centre for Mental Health (UK). Leicester (UK): British Psychological Society. ISBN-10: 1–85433–424-7.

  • Perou, R., Bitsko, R. H., Blumberg, S. J., Pastor, P., Ghandour, R. M., Gfroerer, J. C., Hedden, S. L., Crosby, A. E., Visser, S. N., & Schieve, L. A. (2013). Mental health surveillance among children—United States, 2005–2011. Morbidity and Mortality Weekly Report, 62, 1–35 Retrieved from https://www.ncbi.nlm.nih.gov/pubmed/23677130.

    Google Scholar 

  • Riley, A. (2004). Evidence that school-age children can self-report on their health. Ambulatory Pediatrics, 4, 371–376. https://doi.org/10.1367/A03-178R.1.

    Article  PubMed  Google Scholar 

  • Robins, R. W., Hendin, H. M., & Trzesniewski, K. H. (2001). Measuring global self-esteem: Construct validation of a single-item measure and the Rosenberg self-esteem scale. Personality and Social Psychology Bulletin, 27, 151–161. https://doi.org/10.1177/0146167201272002.

    Article  Google Scholar 

  • Rockhill, C., Kodish, I., DiBattisto, C., Macias, M., Varley, C., & Ryan, S. (2010). Anxiety disorders in children and adolescents. Current Problems in Pediatric and Adolescent Health Care, 40, 66–99. https://doi.org/10.1016/j.cppeds.2010.02.002.

    Article  PubMed  Google Scholar 

  • Rutter, M. (1967). A children’s behaviour questionnaire for completion by teachers: Preliminary findings. Journal of Child Psychology and Psychiatry, 8, 1–11. https://doi.org/10.1111/j.1469-7610.1967.tb02175.x.

    Article  PubMed  Google Scholar 

  • Shucksmith, J., Spratt, J., Philip, K., & McNaughton, R. (2009). A critical review of the literature on children and young people' s views of the factors that influence their mental health. Glasgow: NHS Health Scotland.

    Google Scholar 

  • Soreni, N., Streiner, D., McCabe, R., Bullard, C., Swinson, R., Greco, A., Pires, P., & Szatmari, P. (2014). Dimensions of perfectionism in children and adolescents with obsessive-compulsive disorder. Journal of the Canadian Academy of Child and Adolescent Psychiatry, 23, 136–143 Retrieved from https://web-b-ebscohost-com.proxy.bib.uottawa.ca/ehost/pdfviewer/pdfviewer?vid=1&sid=6238c20c-3d18-4bcf-87f9-1e12e47dad29%40sessionmgr103.

    PubMed  PubMed Central  Google Scholar 

  • Stewart-Brown, S., & Janmohamed, K. (2008). Warwick-Edinburgh Mental Well-being Scale ( WEMWBS). User Guide Version 1. Warwick and Edinburgh: University of Warwick and NHS Health Scotland.

    Google Scholar 

  • Stewart-Brown, S., Tennant, A., Tennant, R., Platt, S., Parkinson, J., & Weich, S. (2009). Internal construct validity of the Warwick-Edinburgh mental well-being scale (WEMWBS): A Rasch analysis using data from the Scottish health education population survey. Health and Quality of Life Outcomes, 7, 63.

    Article  Google Scholar 

  • Trochim, W., Donnelly, J. P., & Arora, K. (2016). Research methods: The essential knowledge base (2nd ed.). California: Wadsworth Publishing. https://doi.org/10.1186/1477-7525-7-15.

    Book  Google Scholar 

  • Valla, J. P., Bergeron, L., Bidaut-Russell, M., St-Georges, M., & Gaudet, N. (1997). Reliability of the Dominic-R: A young child mental health questionnaire combining visual and auditory stimuli. Journal of Child Psychology and Psychiatry, 38, 717–724. https://doi.org/10.1023/A:1007562200613.

    Article  PubMed  Google Scholar 

  • Varni, J. W., Limbers, C. A., & Burwinkle, T. M. (2007). Impaired health-related quality of life in children and adolescents with chronic conditions: A comparative analysis of 10 disease clusters and 33 disease categories/severities utilizing the PedsQLTM 4.0 general core scales. Health and Quality of Life Outcomes, 5, 43–43. https://doi.org/10.1186/1477-7525-5-43.

    Article  PubMed  PubMed Central  Google Scholar 

  • Volker, M., Lopata, C., Smerbeck, A. M., Knoll, V. A., Thomeer, M. L., Toomey, J. A., & Rodgers, J. D. (2010). BASC-2 PRS profile for students with high-functioning autism spectrum disorders. Journal of Autism and Developmental Disorders, 40, 188–199. https://doi.org/10.1007/s10803-009-0849-6.

    Article  PubMed  Google Scholar 

  • Waddell, C., Shepherd, C. A., Chen, A., & Boyle, M. H. (2013). Creating comprehensive children’s mental health indicators for British Columbia. Canadian Journal of Community Mental Health, 32, 9–27 Retrieved from https://www-cjcmh-com.proxy.bib.uottawa.ca/loi/cjcmh.

    Article  Google Scholar 

  • Welman, J. C., & Kruger, S. J. (1999). Research methodology for the business and administrative sciences. Johannesburg, South Africa: International Thompson.

  • Williams (2008). Screening and assessment tools for children: Literature review. Retrieved from: https://humanservices.ucdavis.edu/sites/default/files/104056-MentalHealthLR.pdf.

  • Zhou, Y., Lin, F. C., Du, Y. S., Qin, L. D., Zhao, Z. M., Xu, J. R., & Leib, H. (2011). Gray matter abnormalities in internet addiction: A voxel-based morphometry study. European Journal of Radiology, 79, 92–95. https://doi.org/10.1016/j.ejrad.2009.10.025.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Thank you to the children and mental health practitioners who collaborated in the development of the ISA. We would also like to acknowledge the Society for Pastoral Care and Counselling Research for the John Wells Spiritual Care Award, as well as Saint Paul University for the internal grant, that funded this research.

Funding

This research was funded through the Society for Pastoral Care & Counselling Research, John Wells Spiritual Care Award, as part of a larger project. An internal university grant also partially funded this research.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Laura Lynne Armstrong.

Ethics declarations

Conflict of Interest

The authors declare that there is no conflict of interest.

Ethical Approval

Ethical approval for human subjects was obtained for this project. “All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.”

Informed Consent

“Informed consent was obtained from all individual participants included in the study.”

This work has not been submitted for consideration by any other journals. All authors agree to the content of this manuscript.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Armstrong, L.L., Watt, E., St. John, E. et al. The interactive symptoms assessment: I.S.A. – development and validation using a knowledge translation-integrated model. Curr Psychol 41, 3038–3054 (2022). https://doi.org/10.1007/s12144-020-00801-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12144-020-00801-5

Keywords

Navigation