Abstract
Pictorial mood assessments reduce the barriers of age, culture, gender and language fluency in the course of psychiatric assessments. This study sought to validate the Ottawa Mood Scales, a pictorial form of mood assessment questionnaire among non-native English speaking young adults in Malaysia. Since the Ottawa Mood Scales has not been previously validated, the convergent validity of the Ottawa Mood Scales was measured against the Positive and Negative Affect Scale (PANAS), an established mood assessment instrument. A total of 129 young adults (aged 18–34) were recruited and completed an online survey with the Ottawa Mood Scales and PANAS questionnaires. Exploratory factor analysis indicated that the Ottawa Mood Scales has a one-dimensional structure and that a four-item model demonstrated higher reliability than the original 5-item model. Scores on the Ottawa Mood Scales items positively and significantly correlated with scores on the negative PANAS subscale, which supports the validity of the Ottawa Mood Scales in measuring the negative effect. The Cronbach’s α was .793 for the four-item model of the Ottawa Mood Scales indicating acceptable reliability in this Malaysian young adult sample. It was concluded that the Ottawa Mood Scales could have utility in assessing mood disorder symptoms in young adults.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Altarriba, J., Basnight, D. M., & Canary, T. M. (2003). Emotion representation and perception across cultures. Online Readings in Psychology and Culture. https://doi.org/10.9707/2307-0919.1033.
Bless, H., & Burger, A. M. (2017). Mood and the regulation of mental abstraction. Current Directions in Psychological Science, 26(2), 159–164. https://doi.org/10.1177/0963721417690456.
Bond, A., & Lader, M. (1974). The use of analogue scales in rating subjective feelings. British Journal of Medical Psychology, 47(3), 211–218. https://doi.org/10.1111/j.2044-8341.1974.tb02285.x.
Boynton, P. M., & Greenhalgh, T. (2004). Selecting, designing, and developing your questionnaire. BMJ, 328(7451), 1312–1315. https://doi.org/10.1136/bmj.328.7451.1312.
Bradley, M. M., & Lang, P. J. (1994). Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry, 25(1), 49–59. https://doi.org/10.1016/0005-7916(94)90063-9.
Brislin, R. W. (1976). Comparative research methodology: Cross-cultural studies. International Journal of Psychology, 11(3), 215–229. https://doi.org/10.1080/00207597608247359.
Broekens, J., & Brinkman, W.-P. (2013). AffectButton: A method for reliable and valid affective self-report. International Journal of Human-Computer Studies, 71(6), 641–667.
Buil, I., de Chernatony, L., & Martínez, E. (2012). Methodological issues in cross-cultural research: An overview and recommendations. Journal of Targeting, Measurement and Analysis for Marketing, 20(3–4), 223–234. https://doi.org/10.1057/jt.2012.18.
Cheng, M. (2011). The Ottawa Mood Scales. Ottawa: Michael Cheng.
Cheng, M. (2019). Dr. Michael Cheng. Retrieved June 19, 2020, from http://www.drcheng.ca/.
Chin, C. (2018, November 1). Survey shows most Malaysians speak good English. The Star Online (p. 1). Petaling Jaya.
Chou, K.-L., Lee, T. M. C., & Ho, A. H. Y. (2007). Does mood state change risk taking tendency in older adults? Psychology and Aging, 22(2), 310–318. https://doi.org/10.1037/0882-7974.22.2.310.
Cook, A. J., Roberts, D. A., Nelson, K. C., Clark, B. R., & Parker, B. E. (2018). Development of a pictorial scale for assessing functional interference with chronic pain: The Pictorial Pain Interference Questionnaire. Journal of Pain Research, 11, 1343–1354. https://doi.org/10.2147/JPR.S160801.
Crawford, J. R., & Henry, J. D. (2004). The Positive and Negative Affect Schedule (PANAS): Construct validity, measurement properties and normative data in a large non-clinical sample. British Journal of Clinical Psychology, 43(3), 245–265. https://doi.org/10.1348/0144665031752934.
Cristobal, E., Flavián, C., & Guinalíu, M. (2007). Perceived e-service quality (PeSQ): Measurement validation and effects on consumer satisfaction and web site loyalty. Managing Service Quality, 17(3), 317–340. https://doi.org/10.1108/09604520710744326.
de Carvalho, H. W., Andreoli, S. B., Lara, D. R., Patrick, C. J., Quintana, M. I., Bressan, R. A. et al. (2013). Structural validity and reliability of the Positive and Negative Affect Schedule (PANAS): Evidence from a large Brazilian community sample. Revista Brasileira de Psiquiatria, 35(2), 169–172. https://doi.org/10.1590/1516-4446-2012-0957.
Desmet, P. (2003). Measuring emotion: Development and application of an instrument to measure emotional responses to products. In M. A. Blyth, A. F. Monk, K. Overbeeke, & P. C. Wright (Eds.), Funology: from usability to enjoyment (Vol. 3, pp. 111–123). Dordrecht: Khwer Academic Publishers.
Desmet, P., Vastenburg, M., & Romero, N. (2016). Mood measurement with Pick-A-Mood: Review of current methods and design of a pictorial self-report scale. Journal of Design Research, 14(3), 241–279. https://doi.org/10.1504/JDR.2016.079751.
Diener, E., Wirtz, D., Biswas-Diener, R., Tov, W., Prieto-Kim, C., Choi, D. et al. (2009). New measures of well-being: Flourishing and positive and negative feelings. Social Indicators Research Series, https://doi.org/10.1007/978-90-481-2354-4
Dupuy, H. J. (1984). The psychological general well-being (PGWB) index. In N. K. Wenger, M. E. Mattson, C. D. Furberg, & J. Elinson (Eds.), Assessment of quality of life in clinical trials of cardiovascular therapies (pp. 170–183). New York: Le Jacq Publishing.
Ebesutani, C., Smith, A., Bernstein, A., Chorpita, B. F., Higa-McMillan, C., & Nakamura, B. (2011). A bifactor model of negative affectivity: Fear and distress components among younger and older youth. Psychological Assessment, 23(3), 679–691. https://doi.org/10.1037/a0023234.
EF Education First. (2018). EF English Proficiency Index (8th ed.). Stockholm: EF.
Franco, F., Swaine, J. S., Israni, S., Zaborowska, K. A., Kaloko, F., Kesavarajan, I., et al. (2014). Affect-matching music improves cognitive performance in adults and young children for both positive and negative emotions. Psychology of Music. https://doi.org/10.1177/0305735614548500.
Friedlmeier, W., Schawrz, B., & Chakkarath, P. (2005). Culture and human development: The importance of cross-cultural research to the social sciences. Hove: Psychology Press.
Green, P. (2016). A behavioural approach to helping an older adult with a learning disability and mild cognitive impairment overcome depression. British Journal of Learning Disabilities, 45(1), 81–88. https://doi.org/10.1111/bld.12160.
Grossi, E., Groth, N., Mosconi, P., Cerutti, R., Pace, F., Compare, A., et al. (2006). Development and validation of the short version of the Psychological General Well-Being Index (PGWB-S). Health and Quality of Life Outcomes, 4, 88. https://doi.org/10.1186/1477-7525-4-88.
Hirshkowitz, M., Sarwar, A., & Sharafkhaneh, A. (2011). Evaluating sleepiness. Principles and practice of sleep medicine (5th ed., pp. 1624–1631). Philadelphia: W.B. Saunders. https://doi.org/10.1016/B978-1-4160-6645-3.00143-2
Hodge, D. R., & Gillespie, D. F. (2007). Phrase completion scales: A better measurement approach than Likert scales? Journal of Social Service Research, 33(4), 1–12. https://doi.org/10.1300/J079v33n04_01.
Hum, J., Rietveld, T., Wiedijk, P., & van Lieshout, P. (2017). A pilot study into a possible relationship between diet and stuttering. Journal of Fluency Disorders, 52, 25–36. https://doi.org/10.1016/j.jfludis.2017.02.004.
IBM Corp. (2012). IBM SPSS statistics for windows. Armonk, NY: IBM Corp.
Jones, M. V., Lane, A. M., Bray, S. R., Uphill, M., & Catlin, J. (2005). Development and validation of the Sport Emotion Questionnaire. Journal of Sport and Exercise Psychology, 27, 407–431.
Kim, H.-Y. (2013). Statistical notes for clinical researchers: Assessing normal distribution (2) using skewness and kurtosis. Restorative Dentistry & Endodontics, 38(1), 52–54. https://doi.org/10.5395/rde.2013.38.1.52.
Klink, L. M. (2019). The effectiveness of animal-assisted therapy on the anxiety and school attendance of students with disabilities. Theses and Dissertations. Rowan University.
Knapp, T. R. (1990). Treating ordinal scales as interval scales: An attempt to resolve the controversy. Nursing Research, 39(2), 121–123. https://doi.org/10.1097/00006199-199003000-00019.
Kumar, A., Das, S., Chauhan, S., Kiran, U., & Satapathy, S. (2019). Perioperative anxiety and stress in children undergoing congenital cardiac surgery and their parents: Effect of brief intervention—a randomized control trial. Journal of Cardiothoracic and Vascular Anesthesia, 33(5), 1244–1250. https://doi.org/10.1053/j.jvca.2018.08.187.
Leung, S.-O. (2011). A comparison of psychometric properties and normality in 4-, 5-, 6-, and 11-point Likert scales. Journal of Social Service Research, 37(4), 412–421. https://doi.org/10.1080/01488376.2011.580697.
Lim, N. (2016). Cultural differences in emotion: Differences in emotional arousal level between the East and the West. Integrative Medicine Research, 5(2), 105–109. https://doi.org/10.1016/j.imr.2016.03.004.
Lloret, S., Ferreres, A., Hernández, A., & Tomás, I. (2017). The exploratory factor analysis of items: guided analysis based on empirical data and software. Annals of Psychology, 33(2), 417–432.
Lount, R. B. (2010). The impact of positive mood on trust in interpersonal and intergroup interactions. Journal of Personality and Social Psychology, 98(3), 420–433. https://doi.org/10.1037/a0017344.
McNair, D. M., Lorr, M., & Droppelman, L. F. (1992). Revised manual for the profile of mood states. Princeton: Educational and Industrial Testing Service.
Merz, E. L., Malcarne, V. L., Roesch, S. C., Ko, C. M., Emerson, M., Roma, V. G., et al. (2013). Psychometric properties of Positive and Negative Affect Schedule (PANAS) original and short forms in an African American community sample. Journal of Affective Disorders, 151(3), 942–949. https://doi.org/10.1016/j.jad.2013.08.011.
Minkel, J., & Phillips, S. (2015). Methodological considerations when integrating experimental manipulations of sleep and emotion. Sleep and Affect (pp. 119–138). Cambridge: Academic Press. https://doi.org/10.1016/B978-0-12-417188-6.00006-2
Netemeyer, R. G., Bearden, W. O., & Sharma, S. (2003). Scaling procedures: Issues and applications. London: Sage Publications.
Ostir, G. V., Smith, P. M., Smith, D., & Ottenbacher, K. J. (2005). Reliability of the Positive and Negative Affect Schedule (PANAS) in medical rehabilitation. Clinical Rehabilitation, 19(7), 767–769. https://doi.org/10.1191/0269215505cr894oa.
Riener, C. R., Stefanucci, J. K., Proffitt, D. R., & Clore, G. (2011). An effect of mood on the perception of geographical slant. Cognition & Emotion, 25(1), 174–182. https://doi.org/10.1080/02699931003738026.
Rusli, R., Md Yunus, M., & Hashim, H. (2018). Low speaking proficiency among the Malaysian undergraduates: Why and how? Persidangan Antarabangsa Sains Sosial dan Kemanusiaan (pp. 678–689). Bangi: Kolej Universiti Islam Antarabangsa Selangor.
Serafini, K., Malin-Mayor, B., Nich, C., Hunkele, K., & Carroll, K. M. (2016). Psychometric properties of the Positive and Negative Affect Schedule (PANAS) in a heterogeneous sample of substance users. The American Journal of Drug and Alcohol Abuse, 42(2), 203–212. https://doi.org/10.3109/00952990.2015.1133632.
Snoek, F. J., Pouwer, F., Welch, G. W., & Polonsky, W. H. (2000). Diabetes-related emotional distress in Dutch and U.S. diabetic patients. Diabetes Care, 23(9), 1305–1309.
Sunderland, T., & Minichiello, M. (1996). Dementia Mood Assessment Scale. International Psychogeriatrics, 8(3), 329–331.
Tappen, R. M., & Williams, C. L. (2008). Development and testing of the Alzheimer’s disease and Related Dementias Mood Scale. Nursing Research, 57(6), 426–435. https://doi.org/10.1097/NNR.0b013e31818c3dcc.
Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55. https://doi.org/10.5116/ijme.4dfb.8dfd.
Terry, P. C., & Fogarty, G. J. (2003). The Stellenbosch Mood Scale: A dual-language measure of mood safety climate view project cross-cultural validation of the Brunel Mood Scale view project. International Journal of Sport and Exercise Psychology. https://doi.org/10.1080/1612197X.2003.9671716.
Uchida, Y., & Kitayama, S. (2009). Happiness and unhappiness in east and west: Themes and variations. Emotion, 9(4), 441–456. https://doi.org/10.1037/a0015634.
Vale, L., Silcock, J., & Rawles, J. (1997). An economic evaluation of thrombolysis in a remote rural community. BMJ, 314, 570–572.
Walden, A. (2019). Reducing agitation in long-term care: A virtual reality intervention for dementia. Colorado Springs: University of Colorado Springs.
Wanous, J. P., & Reichers, A. (1996). Estimating the reliability of a single-item measure. Psychological Reports, 78, 631–634.
Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063–1070.
Weidong, Z., Jing, D., & Schick, C. J. (2004). The cross-cultural measurement of positive and negative affect examining the dimensionality of PANAS. Psychological Science (China), 27(1), 77–79.
Wu, H., & Leung, S.-O. (2017). Can Likert Scales be Treated as Interval Scales?—A Simulation Study. Journal of Social Service Research, 43(4), 527–532. https://doi.org/10.1080/01488376.2017.1329775.
Acknowledgements
The authors acknowledge University Tunku Abdul Rahman (6200/LM3) and participants who were volunteered to fill up the questionnaires. Special thanks to Dr Micheal Cheng (MD), the creator of TOMS, a wonderful pictorial form of mood assessment.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no competing interests.
Ethical Approval
All the participants evaluated conformed to the principles outlined in the Declaration of Helsinki and have been performed with the permission released by the responsible Ethics Committee.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Wong, MY., Croarkin, P.E., Lee, C.K. et al. Validation of Pictorial Mood Assessment with Ottawa Mood Scales and the Positive and Negative Affect Scale for Young Adults. Community Ment Health J 57, 529–539 (2021). https://doi.org/10.1007/s10597-020-00679-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10597-020-00679-4