Abstract
Research has questioned whether it is feasible to assess psychosocial variables through web-based recruitment methods. Previous literature on IBD focused exclusively on testing differences on psychosocial scores and did not test the invariance between types of recruitment on the relationships between variables. The aim of the present study is thus to analyse structural invariance between internet-recruited and hospital-recruited groups of IBD patients on a mediation model with theoretical basis on previous studies (experiential avoidance as possible mediator of the association between IBD symptomatology and psychopathology). The internet sample included 137 IBD patients recruited through a patients association, and the hospital sample comprised 66 IBD patients. Structural equation modelling was used; a multiple-group comparison was conducted to examine model invariance between samples. Although the internet sample presented higher levels of experiential avoidance and psychopathological symptoms compared to the hospital sample, the relationships between these variables were invariant across groups. Experiential avoidance partially mediated the impact of IBD symptomatology on levels of stress, anxiety, and depression symptoms in a similar way for online respondents and hospital-recruited patients. This is a new finding that argues for the validity of web-based research methods.
Similar content being viewed by others
References
Aguirre-Camacho, A., Pelletier, G., González-Márquez, A., Blanco-Donoso, L. M., García-Borreguero, P., & Moreno-Jiménez, B. (2017). The relevance of experiential avoidance in breast cancer distress: Insights from a psychological group intervention. Psycho-Oncology, 26(4), 469–475. https://doi.org/10.1002/pon.4162.
Bokemeyer, B., Hardt, J., Hüppe, D., Prenzler, A., Conrad, S., Düffelmeyer, M., Hartmann, P., Hoffstadt, M., Klugmann, T., Schmidt, C., Weismüller, J., Mittendorf, T., & Raspe, H. (2013). Clinical status, psychosocial impairments, medical treatment and health care costs for patients with inflammatory bowel disease (IBD) in Germany: An online IBD registry. Journal of Crohn's & Colitis, 7(5), 355–368. https://doi.org/10.1016/j.crohns.2012.02.014.
Bond, F. W., Hayes, S. C., Baer, R. A., Carpenter, K. M., Guenole, N., Orcutt, H. K., Waltz, T., & Zettle, R. (2011). Preliminary psychometric properties of the acceptance and action questionnaire–II: A revised measure of psychological inflexibility and experiential avoidance. Behavior Therapy, 42, 676–688. https://doi.org/10.1016/j.beth.2011.03.007.
Braithwaite, D., Emery, J., de Lusignan, S., & Sutton, S. (2003). Using the internet to conduct surveys of health professionals: A valid alternative? Family Practice, 20, 545–551. https://doi.org/10.1093/fampra/cmg509.
Byrne, B. M. (2010). Structural equation modeling with AMOS: Basic concepts, applications, and programming (2nd ed.). New York: Routledge, Taylor & Francis.
Chawla, N., & Ostafin, B. (2007). Experiential avoidance as a functional dimensional approach to psychopathology: An empirical review. Journal of Clinical Psychology, 63, 871–890. https://doi.org/10.1002/jclp.20400.
Cohen, J., Cohen, P., West, S., & Aiken, L. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3th ed.). New Jersey: Lawrence Erlbaum Associates.
Cohen, A. B., Lee, D., Long, M. D., Kappelman, M. D., Martin, C. F., Sandler, R. S., & Lewis, J. D. (2013). Dietary patterns and self-reported associations of diet with symptoms of inflammatory bowel disease. Digestive Diseases and Sciences, 58(5), 1322–1328. https://doi.org/10.1007/s10620-012-2373-3.
Dillman, D. A. (2000). Mail and internet surveys: The tailored design method (2nd ed.). New York: Wiley.
Eysenbach, G., & Wyatt, J. (2002). Using the internet for surveys and health research. Journal of Medical Internet Research, 4, E13. https://doi.org/10.2196/jmir.4.2.e13.
Field, A. (2018). Discovering statistics using SPSS (5th ed.). London: Sage Publications.
Gillanders, D. T., Sinclair, A. K., MacLean, M., & Jardine, K. (2015). Illness cognitions, cognitive fusion, avoidance and self-compassion as predictors of distress and quality of life in a heterogeneous sample of adults, after cancer. Journal of Contextual Behavioral Science, 4(4), 300–311. https://doi.org/10.1016/j.jcbs.2015.07.003.
Hadlandsmyth, K., White, K. S., Nesin, A. E., & Greco, L. a. (2013). Proposing an acceptance and commitment therapy intervention to promote improved diabetes management in adolescents: A treatment conceptualization. International Journal of Behavioral Consultation and Therapy, 7(4), 12–15. https://doi.org/10.1037/h0100960.
Hayes, S. C., Wilson, K. G., Gifford, E. V., Follette, V. M., & Strosahl, K. (1996). Experimental avoidance and behavioral disorders: A functional dimensional approach to diagnosis and treatment. Journal of Consulting and Clinical Psychology, 64(6), 1152–1168. https://doi.org/10.1037/0022-006X.64.6.1152.
Hayes, S. C., Strosahl, K. D., & Wilson, K. G. (1999). Acceptance and commitment therapy: An experiential approach to behavior change. New York: Guilford Press.
Herrero, J., & Meneses, J. (2006). Short web-based versions of the perceived stress (PSS) and Center for Epidemiological Studies-Depression (CESD) scales: A comparison to pencil and paper responses among internet users. Computers in Human Behavior, 22(5), 830–846. https://doi.org/10.1016/j.chb.2004.03.007.
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118.
Joinson, A. (1999). Social desirability, anonymity, and Intemet-based questionnaires. Behavior Research Methods, Instruments, & Computers, 31(3), 433–438. https://doi.org/10.3758/BF03200723.
Jones, M. P., Bratten, J., & Keefer, L. (2007). Quality of life in patients with inflammatory bowel disease and irritable bowel syndrome differs between subjects recruited from clinic or the internet. American Journal of Gastroenterology, 102(10), 2232–2237. https://doi.org/10.1111/j.1572-0241.2007.01444.x.
Kemp, S. (2018). 2018 Digital Yearbook. Retrieved from https://wearesocial.com/us/blog/2018/01/global-digital-report-2018.
Kline, P. (2000). The handbook of psychological testing (2nd ed.). London: Routledge.
Kline, R. B. (2005). Principles and practice of structural equation modeling (2nd ed.). New York: The Guilford Press.
Lenert, L., & Skoczen, S. (2002). The internet as a research tool: Worth the price of admission? Annals of Behavioral Medicine, 24(4), 251–256. https://doi.org/10.1207/S15324796ABM2404_01.
Loubet, P., Verger, P., Abitbol, V., Peyrin-Biroulet, L., & Launay, O. (2018). Pneumococcal and influenza vaccine uptake in adults with inflammatory bowel disease in France: Results from a web-based study. Digestive and Liver Disease, 50, 563–567. https://doi.org/10.1016/j.dld.2017.12.027.
Lovibond, S. H., & Lovibond, P. F. (1995). Manual for the depression anxiety stress scales (2nd ed.). Sydney: Psychology Foundation.
Pais-Ribeiro, J. L., Honrado, A., & Leal, I. (2004). Contribuição Para O Estudo da Adaptação Portuguesa das Escalas de Ansiedade, Depressão e stress (EADS) de 21 Itens de Lovibond e Lovibond [contribution for the study of the Portuguese adaptation of Lovibond and Lovibond’s depression anxiety stress scales (DASS)]. Psicologia, Saúde & Doenças, 5(2), 229–239. https://doi.org/10.1080/13548500500524088.
Pinto-Gouveia, J., Gregório, S., Dinis, A., & Xavier, A. (2012). Experiential avoidance in clinical and nonclinical samples. International Journal of Psychology and Psychological Therapy, 12(2), 139–156.
Schillewaert, N., & Meulemeester, P. (2005). Comparing response distributions of offline and online data collection methods. International Journal of Market Research, 47(2), 163–178.
Schumacker, R. E., & Lomax, R. G. (2004). A beginner's guide to structural equation modeling (2nd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.
Soetikno, R. M., Mrad, R., Pao, V., & Lenert, L. A. (1997). Quality-of-life research on the internet: Feasibility and potential biases in patients with ulcerative colitis. Journal of the American Medical Informatics Association, 4(6), 426–435. https://doi.org/10.1136/jamia.1997.0040426.
Suler, J. (2004). The online disinhibition effect. Cyberpsychology & Behavior, 7(3), 321–326. https://doi.org/10.1089/1094931041291295.
Tabachnick, B., & Fidell, L. (2007). Using multivariate statistics (5th ed.). Boston: Pearson.
Tew, G. A., Jones, K., & Mikocka-Walus, A. (2016). Physical activity habits, limitations, and predictors in people with inflammatory bowel disease: A large cross-sectional online survey. Inflammatory Bowel Diseases, 22, 2933–2942. https://doi.org/10.1097/MIB.0000000000000962.
Trindade, I. A., Ferreira, C., & Pinto-Gouveia, J. (2016). Inflammatory bowel disease: The harmful mechanism of experiential avoidance for patients’ quality of life. Journal of Health Psychology, 21(12), 2882–2892. https://doi.org/10.1177/1359105315587142.
Trindade, I. A., Ferreira, C., & Pinto-Gouveia, J. (2017). Shame and emotion regulation in inflammatory bowel disease: Effects on psychosocial functioning. Journal of Health Psychology, 135910531771892. https://doi.org/10.1177/1359105317718925.
Trindade, I. A., Duarte, J., Ferreira, C., Coutinho, M., & Pinto-Gouveia, J. (2018a). The impact of illness-related shame on psychological health and social relationships: Testing a mediational model in students with chronic illness. Clinical Psychology & Psychotherapy, 23(5), 408–414. https://doi.org/10.1002/cpp.2175.
Trindade, I. A., Ferreira, C., & Pinto-Gouveia, J. (2018b). The longitudinal effects of emotion regulation on physical and psychological health: A latent growth analysis exploring the role of cognitive fusion in IBD. British Journal of Health Psychology, 23(1), 171–185. https://doi.org/10.1111/bjhp.12280.
Voth, J., & Sirois, F. M. (2009). The role of self-blame and responsibility in adjustment to inflammatory bowel disease. Rehabilitation Psychology, 54(1), 99–108. https://doi.org/10.1037/a0014739.
Wang, C. C., Liu, K. S., Cheng, C. L., & Cheng, Y. Y. (2013). Comparison of web-based versus paper-and-pencil administration of a humor survey. Computers in Human Behavior, 29(3), 1007–1011. https://doi.org/10.1016/j.chb.2012.12.029.
Weijman, I., Ros, W. J. G., Rutten, G. E. H. M., Schaufeli, W. B., Schabracq, M. J., & Winnubst, J. A. M. (2005). The role of work-related and personal factors in diabetes self-management. Patient Education and Counseling, 59(1), 87–96. https://doi.org/10.1016/j.pec.2004.10.004.
Acknowledgments
We thank the Portuguese Association for IBD (Associação Portuguesa para a Doença Inflamatória do Intestino; APDI) for the help provided during the recruitment of the internet sample.
Funding
This research was supported by the first author (Inês A Trindade), Ph.D. Grant (SFRH/BD/101906/2014) sponsored by FCT (Portuguese Foundation for Science and Technology).
Author information
Authors and Affiliations
Contributions
I.A.T.: study design, data analysis, writing up of the first draft of the paper. L.F.: writing and revision of the paper. F.P.: patient recruitment, data collection. C.F.: writing and revision of the paper. J.P.G: revision of the paper. All authors provided critical feedback.
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare no conflict of interest.
Ethical Approval
This study was approved by the Ethics Committees of the Coimbra University Hospital (Centro Hospitalar Universitário de Coimbra) and the Faculty of Psychology and Education Sciences of the University of Coimbra.
Informed Consent
All procedures were in accordance with the ethical standards of the Helsinki Declaration of 1975, as revised in 2000. Informed consent was obtained from all patients that participated in the study.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Trindade, I.A., Keefer, L., Portela, F. et al. Measuring structural model invariance across internet-recruited and hospital-recruited IBD patients: Experiential avoidance’s effect on psychopathological symptoms. Curr Psychol 40, 3459–3466 (2021). https://doi.org/10.1007/s12144-019-00281-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12144-019-00281-2