Abstract
Paranoid thoughts have been reported in 20–30% of adolescents, and preliminary research has shown that paranoia and psychotic-like experiences have increased during the COVID-19 pandemic. However, previous research has typically used general measures to assess paranoia, rather than those specific to COVID-19, which may overlook particular facets of paranoia related to the pandemic and result in an under-reporting of paranoia prevalence rates during this time. Therefore, this study aimed to examine the psychometric properties of the Pandemic Paranoia Scale for Adolescents (PPS-A), which was adapted from the original scale to be appropriate for younger respondents, and to assess the prevalence of pandemic paranoia among adolescents. Adolescents (N = 462) recruited on Qualtrics from the United States (US) and United Kingdom (UK) completed an online survey consisting of the PPS-A and measures of general paranoia and negative affect. A subset of adolescent’s parents (N = 146) also completed an online survey providing dyadic data. Findings showed that the PPS-A shared the same three factor structure as the adult PPS (i.e., persecutory threat, paranoid conspiracy, and interpersonal mistrust) and across participant nationality, race, gender, and mental health diagnosis. It also demonstrated strong psychometric properties. The overall prevalence rate of pandemic-related paranoia among adolescents was 21% and prevalence rates were higher among US participants than UK participants. This study provides the most comprehensive psychometric evaluation of a pandemic paranoia scale designed for adolescents and highlights the continued prevalence of pandemic paranoia in this age-group nearly two years after COVID-19 began.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data Availability
Data is available by request from the corresponding author.
References
Agency for Healthcare Research and Quality. (2022, Oct). National Healthcare Quality and Disparities Report. https://www.ncbi.nlm.nih.gov/books/NBK587182/pdf/Bookshelf_NBK587182.pdf
Bebbington, P. E., McBride, O., Steel, C., Kuipers, E., Radovanovic, M., Brugha, T., Jenkins, R., Meltzer, H. I., & Freeman, D. (2013). The structure of paranoia in the general population. British Journal of Psychiatry, 202, 419–427. https://doi.org/10.1192/bjp.bp.112.119032
Bird, J. C., Evans, R., Waite, F., Loe, B. S., & Freeman, D. (2019). Adolescent paranoia: Prevalence, structure, and causal Mechanisms. Schizophrenia Bulletin, 45(5), 1134–1142. https://doi.org/10.1093/schbul/sby180
Bird, J. C., Loe, B. S., Kirkham, M., Fergusson, E. C., Shearn, C., Stratford, H., Teale, A.-L., Waite, F., & Freeman, D. (2020). The assessment of paranoia in young people: Item and test properties of the Bird Checklist of Adolescent Paranoia. Schizophrenia Research, 220, 116–122. https://doi.org/10.1016/j.schres.2020.03.046
Centers for Disease Control and Prevention. (2021). Youth Risk Behavior Survey: Data Summary and Trends Report. https://www.cdc.gov/healthyyouth/data/yrbs/pdf/YRBS_Data-Summary-Trends_Report2023_508.pdf
Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Routledge. https://doi.org/10.4324/9780203771587
Denecke, S., Schlier, B., Kingston, J. L., Ellett, L., So, S. H., Gaudiano, B. A., Morris, E. M. J., & Lincoln, T. M. (2023). Differentiating paranoia and conspiracy mentality using a network approach. Scientific Reports, 13(1), 22732. https://doi.org/10.1038/s41598-023-47923-x
Ellett, L., Schlier, B., Kingston, J. L., Zhu, C., So, S. H., Lincoln, T. M., Morris, E. M. J., & Gaudiano, B. A. (2023). Pandemic paranoia in the general population: International prevalence and sociodemographic profile. Psychological Medicine, 53(12), 5748–5755. https://doi.org/10.1017/s0033291722002975
Evans, L., Haeberlein, K., Chang, A., & Handal, P. (2021). Convergent validity and preliminary cut-off scores for the anxiety and depression Subscales of the DASS-21 in US adolescents. Child Psychiatry & Human Development, 52(4), 579–585. https://doi.org/10.1007/s10578-020-01050-0
Fearon, P., Kirkbride, J. B., Morgan, C., Dazzan, P., Morgan, K., Lloyd, T., Hutchinson, G., Tarrant, J., Fung, L. A., & W. A. I., Holloway, J., Mallett, R., Harrison, G., Leff, J., Jones, P. B., & Murray, R. M. (2006). Incidence of schizophrenia and other psychoses in ethnic minority groups: Results from the MRC AESOP Study. Psychological Medicine, 36(11), 1541–1550. https://doi.org/10.1017/S0033291706008774
Flora, D. B., & Flake, J. K. (2017). The purpose and practice of exploratory and confirmatory factor analysis in psychological research: Decisions for scale development and validation. Canadian Journal of Behavioural Science, 49(2), 78–88. https://doi.org/10.1037/cbs0000069
Freeman, D., & Garety, P. A. (2000). Comments on the content of persecutory delusions: Does the definition need clarification? British Journal of Clinical Psychology, 39(4), 407–414. https://doi.org/10.1348/014466500163400
Freeman, D., Loe, B. S., Kingdon, D., Startup, H., Molodynski, A., Rosebrock, L., Brown, P., Sheaves, B., Waite, F., & Bird, J. C. (2021). The revised Green et al., Paranoid Thoughts Scale (R-GPTS): Psychometric properties, severity ranges, and clinical cut-offs. Psychological Medicine, 51(2), 244–253. https://doi.org/10.1017/s0033291719003155
Freeman, D., Waite, F., Rosebrock, L., Petit, A., Causier, C., East, A., Jenner, L., Teale, A.-L., Carr, L., Mulhall, S., Bold, E., & Lambe, S. (2022). Coronavirus conspiracy beliefs, mistrust, and compliance with government guidelines in England. Psychological Medicine, 52(2), 251–263. https://doi.org/10.1017/S0033291720001890
Gindidis, S., Stewart, S., & Roodenburg, J. (2019). A systematic scoping review of adolescent mental health treatment using mobile apps. Advances in Mental Health, 17(2), 161–177. https://doi.org/10.1080/18387357.2018.1523680
Gurak, K., Maura, J., Weisman de Mamani, A., Martinez de Andino, A., & Rosenfarb, I. (2018). Racial and Dthnic Diagnostic Patterns in Schizophrenia Spectrum Disorders. In C. L. Frisby & W. T. O’Donohue (Eds.), Cultural Competence in Applied Psychology: An Evaluation of Current Status and Future Directions (pp. 603–617). Springer International Publishing; USA. https://doi.org/10.1007/978-3-319-78997-2_24
Jost, G. M., Hang, S., Shaikh, U., & Hostinar, C. E. (2023). Understanding adolescent stress during the COVID-19 pandemic. Current Opinion in Psychology, 52, 101646. https://doi.org/10.1016/j.copsyc.2023.101646
Kingston, J. L., Parker, A., & Schlier, B. (2022). Effects of paranoia on well-being in adolescents: A longitudinal mediational analysis. Schizophrenia Research, 243, 178–180. https://doi.org/10.1016/j.schres.2022.03.009
Kingston, J. L., Schlier, B., Ellett, L., So, S. H., Gaudiano, B. A., Morris, E. M. J., & Lincoln, T. M. (2023a). The Pandemic Paranoia Scale (PPS): Factor structure and measurement invariance across languages. Psychological Medicine, 53(6), 2652–2661. https://doi.org/10.1017/s0033291721004633
Kingston, J. L., Ellett, L., Thompson, E. C., Gaudiano, B. A., & Krkovic, K. (2023b). A Child-Parent Dyad Study on Adolescent Paranoia and the Influence of Adverse Life Events, Bullying, Parenting Stress, and Family Support. Schizophrenia Bulletin. https://doi.org/10.1093/schbul/sbad119
Kline, R. B. (2023). Principles and practice of structural equation modeling – (5th ed.). Guilford Press.
Lopes, B., Bortolon, C., & Jaspal, R. (2020). Paranoia, hallucinations and compulsive buying during the early phase of the COVID-19 outbreak in the United Kingdom: A preliminary experimental study. Psychiatry Research, 293, 113455. https://doi.org/10.1016/j.psychres.2020.113455
Lovibond, P. F., & Lovibond, S. H. (1995). The structure of negative emotional states: Comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behaviour Research and Therapy, 33(3), 335–343. https://doi.org/10.1016/0005-7967(94)00075-U
Mellor, D., Vinet, E. V., Xu, X., Mamat, N. H. B., Richardson, B., & Román, F. (2015). Factorial invariance of the DASS-21 among adolescents in four countries. European Journal of Psychological Assessment, 31(2), 138–142. https://doi.org/10.1027/1015-5759/a000218
Mzadi, A. E., Zouini, B., Kerekes, N., & Senhaji, M. (2022). Mental health profiles in a sample of Moroccan high school students: Comparison before and during the COVID-19 pandemic. Frontiers in Psychiatry, 12, 752539. https://doi.org/10.3389/fpsyt.2021.752539
National Health Service. (2022, Nov 29). Mental health of children and young people in England 2022 – Wave 3 follow-up to the 2017 survey. https://digital.nhs.uk/data-and-information/publications/statistical/mental-health-of-children-and-young-people-in-england/2022-follow-up-to-the-2017-survey#
Neumann, G., & Kawaoka, Y. (2023). Which virus will cause the next pandemic? Viruses. https://doi.org/10.3390/v15010199
Nguyen, H. T. M., Nguyen, H. V., Zouini, B., Senhaji, M., Bador, K., Meszaros, Z. S., Stevanovic, D., & Kerekes, N. (2022). The COVID-19 Pandemic and Adolescents’ Psychological Distress: A Multinational Cross-Sectional Study. International Journal of Environmental Research and Public Health. https://doi.org/10.3390/ijerph19148261
Nickerson, A. B., & Nagle, R. J. (2005). Parent and peer attachment in late childhood and early adolescence. The Journal of Early Adolescence, 25(2), 223–249. https://doi.org/10.1177/0272431604274174
Osman, A., Wong, J. L., Bagge, C. L., Freedenthal, S., Gutierrez, P. M., & Lozano, G. (2012). The Depression Anxiety Stress Scales—21 (DASS-21): Further examination of dimensions, scale reliability, and correlates. Journal of Clinical Psychology, 68(12), 1322–1338. https://doi.org/10.1002/jclp.21908
Panchal, U., Salazar de Pablo, G., Franco, M., Moreno, C., Parellada, M., Arango, C., & Fusar-Poli, P. (2023). The impact of COVID-19 lockdown on child and adolescent mental health: Systematic review. European Child & Adolescent Psychiatry, 32(7), 1151–1177. https://doi.org/10.1007/s00787-021-01856-w
Perez-Arce, F., Angrisani, M., Bennett, D., Darling, J., Kapteyn, A., & Thomas, K. (2021). COVID-19 vaccines and mental distress. PLoS ONE, 16(9), e0256406. https://doi.org/10.1371/journal.pone.0256406
Preti, A., & Cella, M. (2010). Paranoid thinking as a heuristic. Early Intervention in Psychiatry, 4(3), 263–266. https://doi.org/10.1111/j.1751-7893.2010.00190.x
Putnick, D. L., & Bornstein, M. H. (2016). Sep). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004
Rosebrock, L., Černis, E., Lambe, S., Waite, F., Rek, S., Petit, A., Ehlers, A., Clark, D. M., & Freeman, D. (2021). Catastrophic cognitions about coronavirus: the Oxford psychological investigation of coronavirus questionnaire [TOPIC-Q]. Psychological Medicine. https://doi.org/10.1017/s0033291721000283
Schleider, J. L., & Weisz, J. R. (2017). Little treatments, promising effects? Meta-analysis of single-session interventions for youth psychiatric problems. Journal of the American Academy of Child & Adolescent Psychiatry, 56(2), 107–115. https://doi.org/10.1016/j.jaac.2016.11.007
Schlier, B., Ellett, L., Thompson, E., Gaudiano, B., Krkovic, K., & Kingston, J. L. (2024). Measuring paranoid beliefs in adolescents: A Comparison of the Revised-Green et al.’s Paranoid Thoughts Scale (R-GPTS) and the Bird Checklist of Adolescent Paranoia (B-CAP). Research on Child and Adolescent Psychopathology. https://doi.org/10.1007/s10802-024-01187-9
Shevlin, M., Nolan, E., Owczarek, M., McBride, O., Murphy, J., Gibson Miller, J., Hartman, T. K., Levita, L., Mason, L., Martinez, A. P., McKay, R., Stocks, T. V. A., Bennett, K. M., Hyland, P., & Bentall, R. P. (2020). COVID-19-related anxiety predicts somatic symptoms in the UK population. British Journal of Health Psychology, 25(4), 875–882. https://doi.org/10.1111/bjhp.12430
Soper, D. S. (2024). Significance of the Difference between Two Correlations Calculator [Software]. Available from https://www.danielsoper.com/statcalc
Strauss, J. S. (1969). Hallucinations and delusions as points on continua function. Rating scale evidence. Archives of General Psychiatry, 21(5), 581–586. https://doi.org/10.1001/archpsyc.1969.01740230069010
Tai, D. B. G., Shah, A., Doubeni, C. A., Sia, I. G., & Wieland, M. L. (2020). The disproportionate impact of COVID-19 on racial and ethnic minorities in the United States. Clinical Infectious Diseases, 72(4), 703–706. https://doi.org/10.1093/cid/ciaa815
Tarka, P. (2017). The comparison of estimation methods on the parameter estimates and fit indices in SEM model under 7-point Likert scale. Archives of Data Science, Series A (online First), 2(1), 16-S. https://doi.org/10.5445/KSP/1000058749/10
Thompson, E., Millman, Z. B., Okuzawa, N., Mittal, V., DeVylder, J., Skadberg, T., Buchanan, R. W., Reeves, G. M., & Schiffman, J. (2015). Evidence-Based Early Interventions for Individuals at Clinical High Risk for Psychosis: A Review of Treatment Components. The Journal of Nervous and Mental Disease, 203(5). https://journals.lww.com/jonmd/fulltext/2015/05000/evidence_based_early_interventions_for_individuals.7.aspx
Tully, P. J., Zajac, I. T., & Venning, A. J. (2009). The structure of anxiety and depression in a normative sample of younger and older Australian adolescents. Journal of Abnormal Child Psychology, 37(5), 717–726. https://doi.org/10.1007/s10802-009-9306-4
Twenge, J. M. (2020). Increases in depression, self-harm, and suicide among US adolescents after 2012 and links to technology use: Possible mechanisms. Psychiatric Research and Clinical Practice, 2(1), 19–25. https://doi.org/10.1176/appi.prcp.20190015
Van De Schoot, R., Schmidt, P., De Beuckelaer, A., Lek, K., & Zondervan-Zwijnenburg, M. (2015). Editorial: Measurement Invariance [Editorial]. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2015.01064
van Os, J., Hanssen, M., Bijl, R. V., & Ravelli, A. (2000). Strauss (1969) revisited: A psychosis continuum in the general population? Schizophrenia Research, 45(1), 11–20. https://doi.org/10.1016/S0920-9964(99)00224-8
Villanti, A. C., LePine, S. E., Peasley-Miklus, C., West, J. C., Roemhildt, M., Williams, R., & Copeland, W. E. (2022). COVID-related distress, mental health, and substance use in adolescents and young adults. Child and Adolescent Mental Health, 27(2), 138–145. https://doi.org/10.1111/camh.12550
Wastler, H. M., & Núñez, D. (2022). Psychotic experiences, emotion regulation, and suicidal ideation among Chilean adolescents in the general population [Brief Research Report]. Frontiers in Psychiatry. https://doi.org/10.3389/fpsyt.2022.983250
Wiens, K., Bhattarai, A., Pedram, P., Dores, A., Williams, J., Bulloch, A., & Patten, S. (2020). A growing need for youth mental health services in Canada: Examining trends in youth mental health from 2011 to 2018. Epidemiology and Psychiatric Sciences, 29, E115. https://doi.org/10.1017/s2045796020000281
Wong, K. K., Freeman, D., & Hughes, C. (2014). Suspicious young minds: Paranoia and mistrust in 8- to 14-year-olds in the UK and Hong Kong. British Journal of Psychiatry, 205(3), 221–229. https://doi.org/10.1192/bjp.bp.113.135467
Wong, K. K., Wang, Y., Esposito, G., & Raine, A. (2022). A three-timepoint network analysis of Covid-19’s impact on schizotypal traits, paranoia and mental health through loneliness. UCL Open Environment. https://doi.org/10.14324/111.444/ucloe.000044
Wu, Z., Liu, Z., Zou, Z., Wang, F., Zhu, M., Zhang, W., Tao, H., Ross, B., & Long, Y. (2021). Nov). Changes of psychotic-like experiences and their association with anxiety/depression among young adolescents before COVID-19 and after the lockdown in China. Schizophrenia Research, 237, 40–46. https://doi.org/10.1016/j.schres.2021.08.020
Zubin, J., & Spring, B. (1977). Vulnerability–a new view of schizophrenia. Journal of Abnormal Psychology, 86(2), 103–126. https://doi.org/10.1037/0021-843x.86.2.103
Funding
This research received no specific grant from any funding agency, commercial, or not-for-profit sectors. Dr. Rabasco’s effort was supported by the National Institute of Mental Health (T32MH126426). Dr. Browne is supported by a VA Rehabilitation Research and Development Career Development Award (IK1RX003904). Dr. Thompson's effort was supported by a grant from the National Institute of Mental Health (K23 MH119211).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Disclosure
The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the United States Government or Department of Veterans Affairs.
Conflict of Interest
None to report.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Rabasco, A., Browne, J., Kingston, J. et al. Pandemic Paranoia Scale for Adolescents (PPS-A): An Initial Psychometric Evaluation and Prevalence Study of Adolescents in the United States and United Kingdom. Res Child Adolesc Psychopathol (2024). https://doi.org/10.1007/s10802-024-01228-3
Accepted:
Published:
DOI: https://doi.org/10.1007/s10802-024-01228-3