Skip to main content
Log in

Measuring structural model invariance across internet-recruited and hospital-recruited IBD patients: Experiential avoidance’s effect on psychopathological symptoms

  • Published:
Current Psychology Aims and scope Submit manuscript

Abstract

Research has questioned whether it is feasible to assess psychosocial variables through web-based recruitment methods. Previous literature on IBD focused exclusively on testing differences on psychosocial scores and did not test the invariance between types of recruitment on the relationships between variables. The aim of the present study is thus to analyse structural invariance between internet-recruited and hospital-recruited groups of IBD patients on a mediation model with theoretical basis on previous studies (experiential avoidance as possible mediator of the association between IBD symptomatology and psychopathology). The internet sample included 137 IBD patients recruited through a patients association, and the hospital sample comprised 66 IBD patients. Structural equation modelling was used; a multiple-group comparison was conducted to examine model invariance between samples. Although the internet sample presented higher levels of experiential avoidance and psychopathological symptoms compared to the hospital sample, the relationships between these variables were invariant across groups. Experiential avoidance partially mediated the impact of IBD symptomatology on levels of stress, anxiety, and depression symptoms in a similar way for online respondents and hospital-recruited patients. This is a new finding that argues for the validity of web-based research methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

References

  • Aguirre-Camacho, A., Pelletier, G., González-Márquez, A., Blanco-Donoso, L. M., García-Borreguero, P., & Moreno-Jiménez, B. (2017). The relevance of experiential avoidance in breast cancer distress: Insights from a psychological group intervention. Psycho-Oncology, 26(4), 469–475. https://doi.org/10.1002/pon.4162.

    Article  PubMed  Google Scholar 

  • Bokemeyer, B., Hardt, J., Hüppe, D., Prenzler, A., Conrad, S., Düffelmeyer, M., Hartmann, P., Hoffstadt, M., Klugmann, T., Schmidt, C., Weismüller, J., Mittendorf, T., & Raspe, H. (2013). Clinical status, psychosocial impairments, medical treatment and health care costs for patients with inflammatory bowel disease (IBD) in Germany: An online IBD registry. Journal of Crohn's & Colitis, 7(5), 355–368. https://doi.org/10.1016/j.crohns.2012.02.014.

    Article  Google Scholar 

  • Bond, F. W., Hayes, S. C., Baer, R. A., Carpenter, K. M., Guenole, N., Orcutt, H. K., Waltz, T., & Zettle, R. (2011). Preliminary psychometric properties of the acceptance and action questionnaire–II: A revised measure of psychological inflexibility and experiential avoidance. Behavior Therapy, 42, 676–688. https://doi.org/10.1016/j.beth.2011.03.007.

    Article  PubMed  Google Scholar 

  • Braithwaite, D., Emery, J., de Lusignan, S., & Sutton, S. (2003). Using the internet to conduct surveys of health professionals: A valid alternative? Family Practice, 20, 545–551. https://doi.org/10.1093/fampra/cmg509.

    Article  PubMed  Google Scholar 

  • Byrne, B. M. (2010). Structural equation modeling with AMOS: Basic concepts, applications, and programming (2nd ed.). New York: Routledge, Taylor & Francis.

    Google Scholar 

  • Chawla, N., & Ostafin, B. (2007). Experiential avoidance as a functional dimensional approach to psychopathology: An empirical review. Journal of Clinical Psychology, 63, 871–890. https://doi.org/10.1002/jclp.20400.

    Article  PubMed  Google Scholar 

  • Cohen, J., Cohen, P., West, S., & Aiken, L. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3th ed.). New Jersey: Lawrence Erlbaum Associates.

    Google Scholar 

  • Cohen, A. B., Lee, D., Long, M. D., Kappelman, M. D., Martin, C. F., Sandler, R. S., & Lewis, J. D. (2013). Dietary patterns and self-reported associations of diet with symptoms of inflammatory bowel disease. Digestive Diseases and Sciences, 58(5), 1322–1328. https://doi.org/10.1007/s10620-012-2373-3.

    Article  PubMed  Google Scholar 

  • Dillman, D. A. (2000). Mail and internet surveys: The tailored design method (2nd ed.). New York: Wiley.

    Google Scholar 

  • Eysenbach, G., & Wyatt, J. (2002). Using the internet for surveys and health research. Journal of Medical Internet Research, 4, E13. https://doi.org/10.2196/jmir.4.2.e13.

    Article  PubMed  PubMed Central  Google Scholar 

  • Field, A. (2018). Discovering statistics using SPSS (5th ed.). London: Sage Publications.

    Google Scholar 

  • Gillanders, D. T., Sinclair, A. K., MacLean, M., & Jardine, K. (2015). Illness cognitions, cognitive fusion, avoidance and self-compassion as predictors of distress and quality of life in a heterogeneous sample of adults, after cancer. Journal of Contextual Behavioral Science, 4(4), 300–311. https://doi.org/10.1016/j.jcbs.2015.07.003.

    Article  Google Scholar 

  • Hadlandsmyth, K., White, K. S., Nesin, A. E., & Greco, L. a. (2013). Proposing an acceptance and commitment therapy intervention to promote improved diabetes management in adolescents: A treatment conceptualization. International Journal of Behavioral Consultation and Therapy, 7(4), 12–15. https://doi.org/10.1037/h0100960.

    Article  Google Scholar 

  • Hayes, S. C., Wilson, K. G., Gifford, E. V., Follette, V. M., & Strosahl, K. (1996). Experimental avoidance and behavioral disorders: A functional dimensional approach to diagnosis and treatment. Journal of Consulting and Clinical Psychology, 64(6), 1152–1168. https://doi.org/10.1037/0022-006X.64.6.1152.

    Article  PubMed  Google Scholar 

  • Hayes, S. C., Strosahl, K. D., & Wilson, K. G. (1999). Acceptance and commitment therapy: An experiential approach to behavior change. New York: Guilford Press.

    Google Scholar 

  • Herrero, J., & Meneses, J. (2006). Short web-based versions of the perceived stress (PSS) and Center for Epidemiological Studies-Depression (CESD) scales: A comparison to pencil and paper responses among internet users. Computers in Human Behavior, 22(5), 830–846. https://doi.org/10.1016/j.chb.2004.03.007.

    Article  Google Scholar 

  • Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118.

    Article  Google Scholar 

  • Joinson, A. (1999). Social desirability, anonymity, and Intemet-based questionnaires. Behavior Research Methods, Instruments, & Computers, 31(3), 433–438. https://doi.org/10.3758/BF03200723.

    Article  Google Scholar 

  • Jones, M. P., Bratten, J., & Keefer, L. (2007). Quality of life in patients with inflammatory bowel disease and irritable bowel syndrome differs between subjects recruited from clinic or the internet. American Journal of Gastroenterology, 102(10), 2232–2237. https://doi.org/10.1111/j.1572-0241.2007.01444.x.

    Article  PubMed  Google Scholar 

  • Kemp, S. (2018). 2018 Digital Yearbook. Retrieved from https://wearesocial.com/us/blog/2018/01/global-digital-report-2018.

  • Kline, P. (2000). The handbook of psychological testing (2nd ed.). London: Routledge.

    Google Scholar 

  • Kline, R. B. (2005). Principles and practice of structural equation modeling (2nd ed.). New York: The Guilford Press.

    Google Scholar 

  • Lenert, L., & Skoczen, S. (2002). The internet as a research tool: Worth the price of admission? Annals of Behavioral Medicine, 24(4), 251–256. https://doi.org/10.1207/S15324796ABM2404_01.

    Article  PubMed  Google Scholar 

  • Loubet, P., Verger, P., Abitbol, V., Peyrin-Biroulet, L., & Launay, O. (2018). Pneumococcal and influenza vaccine uptake in adults with inflammatory bowel disease in France: Results from a web-based study. Digestive and Liver Disease, 50, 563–567. https://doi.org/10.1016/j.dld.2017.12.027.

    Article  PubMed  Google Scholar 

  • Lovibond, S. H., & Lovibond, P. F. (1995). Manual for the depression anxiety stress scales (2nd ed.). Sydney: Psychology Foundation.

    Google Scholar 

  • Pais-Ribeiro, J. L., Honrado, A., & Leal, I. (2004). Contribuição Para O Estudo da Adaptação Portuguesa das Escalas de Ansiedade, Depressão e stress (EADS) de 21 Itens de Lovibond e Lovibond [contribution for the study of the Portuguese adaptation of Lovibond and Lovibond’s depression anxiety stress scales (DASS)]. Psicologia, Saúde & Doenças, 5(2), 229–239. https://doi.org/10.1080/13548500500524088.

    Article  Google Scholar 

  • Pinto-Gouveia, J., Gregório, S., Dinis, A., & Xavier, A. (2012). Experiential avoidance in clinical and nonclinical samples. International Journal of Psychology and Psychological Therapy, 12(2), 139–156.

    Google Scholar 

  • Schillewaert, N., & Meulemeester, P. (2005). Comparing response distributions of offline and online data collection methods. International Journal of Market Research, 47(2), 163–178.

    Article  Google Scholar 

  • Schumacker, R. E., & Lomax, R. G. (2004). A beginner's guide to structural equation modeling (2nd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.

    Book  Google Scholar 

  • Soetikno, R. M., Mrad, R., Pao, V., & Lenert, L. A. (1997). Quality-of-life research on the internet: Feasibility and potential biases in patients with ulcerative colitis. Journal of the American Medical Informatics Association, 4(6), 426–435. https://doi.org/10.1136/jamia.1997.0040426.

    Article  PubMed  PubMed Central  Google Scholar 

  • Suler, J. (2004). The online disinhibition effect. Cyberpsychology & Behavior, 7(3), 321–326. https://doi.org/10.1089/1094931041291295.

    Article  Google Scholar 

  • Tabachnick, B., & Fidell, L. (2007). Using multivariate statistics (5th ed.). Boston: Pearson.

    Google Scholar 

  • Tew, G. A., Jones, K., & Mikocka-Walus, A. (2016). Physical activity habits, limitations, and predictors in people with inflammatory bowel disease: A large cross-sectional online survey. Inflammatory Bowel Diseases, 22, 2933–2942. https://doi.org/10.1097/MIB.0000000000000962.

    Article  PubMed  Google Scholar 

  • Trindade, I. A., Ferreira, C., & Pinto-Gouveia, J. (2016). Inflammatory bowel disease: The harmful mechanism of experiential avoidance for patients’ quality of life. Journal of Health Psychology, 21(12), 2882–2892. https://doi.org/10.1177/1359105315587142.

    Article  PubMed  Google Scholar 

  • Trindade, I. A., Ferreira, C., & Pinto-Gouveia, J. (2017). Shame and emotion regulation in inflammatory bowel disease: Effects on psychosocial functioning. Journal of Health Psychology, 135910531771892. https://doi.org/10.1177/1359105317718925.

  • Trindade, I. A., Duarte, J., Ferreira, C., Coutinho, M., & Pinto-Gouveia, J. (2018a). The impact of illness-related shame on psychological health and social relationships: Testing a mediational model in students with chronic illness. Clinical Psychology & Psychotherapy, 23(5), 408–414. https://doi.org/10.1002/cpp.2175.

    Article  Google Scholar 

  • Trindade, I. A., Ferreira, C., & Pinto-Gouveia, J. (2018b). The longitudinal effects of emotion regulation on physical and psychological health: A latent growth analysis exploring the role of cognitive fusion in IBD. British Journal of Health Psychology, 23(1), 171–185. https://doi.org/10.1111/bjhp.12280.

    Article  PubMed  Google Scholar 

  • Voth, J., & Sirois, F. M. (2009). The role of self-blame and responsibility in adjustment to inflammatory bowel disease. Rehabilitation Psychology, 54(1), 99–108. https://doi.org/10.1037/a0014739.

    Article  PubMed  Google Scholar 

  • Wang, C. C., Liu, K. S., Cheng, C. L., & Cheng, Y. Y. (2013). Comparison of web-based versus paper-and-pencil administration of a humor survey. Computers in Human Behavior, 29(3), 1007–1011. https://doi.org/10.1016/j.chb.2012.12.029.

    Article  Google Scholar 

  • Weijman, I., Ros, W. J. G., Rutten, G. E. H. M., Schaufeli, W. B., Schabracq, M. J., & Winnubst, J. A. M. (2005). The role of work-related and personal factors in diabetes self-management. Patient Education and Counseling, 59(1), 87–96. https://doi.org/10.1016/j.pec.2004.10.004.

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

We thank the Portuguese Association for IBD (Associação Portuguesa para a Doença Inflamatória do Intestino; APDI) for the help provided during the recruitment of the internet sample.

Funding

This research was supported by the first author (Inês A Trindade), Ph.D. Grant (SFRH/BD/101906/2014) sponsored by FCT (Portuguese Foundation for Science and Technology).

Author information

Authors and Affiliations

Authors

Contributions

I.A.T.: study design, data analysis, writing up of the first draft of the paper. L.F.: writing and revision of the paper. F.P.: patient recruitment, data collection. C.F.: writing and revision of the paper. J.P.G: revision of the paper. All authors provided critical feedback.

Corresponding author

Correspondence to Inês A. Trindade.

Ethics declarations

Conflict of Interest

The authors declare no conflict of interest.

Ethical Approval

This study was approved by the Ethics Committees of the Coimbra University Hospital (Centro Hospitalar Universitário de Coimbra) and the Faculty of Psychology and Education Sciences of the University of Coimbra.

Informed Consent

All procedures were in accordance with the ethical standards of the Helsinki Declaration of 1975, as revised in 2000. Informed consent was obtained from all patients that participated in the study.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Trindade, I.A., Keefer, L., Portela, F. et al. Measuring structural model invariance across internet-recruited and hospital-recruited IBD patients: Experiential avoidance’s effect on psychopathological symptoms. Curr Psychol 40, 3459–3466 (2021). https://doi.org/10.1007/s12144-019-00281-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12144-019-00281-2

Keywords

Navigation