Abstract
Childhood behavioral problems are common; despite evidence that parenting interventions improve outcomes, the use of these programs is limited. Virtual delivery may ameliorate attendance barriers, but little is known on the acceptability and feasibility of virtual group parenting interventions. This mixed-method study explored the feasibility, acceptability, and appropriateness of the virtual delivery of a parenting intervention, Child–Adult Relationship Enhancement in Primary Care (PriCARE) among 18 caregivers and 8 facilitators. Subjects completed survey instruments assessing acceptability, appropriateness, feasibility, and telehealth usability and participated in semi-structured interviews exploring these constructs. Directed content analysis of interview transcripts identified themes. Most participants were female with a mean age of 35 years among caregivers and 37 years among facilitators. Slightly less than half of caregivers were Black (44%), with the remaining White. The majority of facilitators were White (88%). Over half (56%) of families received government assistance. Surveys indicated high acceptability, appropriateness, feasibility, and telehealth usability. We identified five overarching themes from qualitative analysis: nuances of feasibility, high acceptability, balancing skills and group dynamics, flexibility within fidelity, and multiple perspectives of disparities. Within these themes, reduced logistical barriers and the normalization of virtual meetings were contrasted with virtual burnout and distractions in the home. The majority of participants expressed that they learned helpful parenting skills, even in the setting of the suboptimal group dynamic of the virtual format. While disparities in technology and support systems were identified, the participation of caregivers who would not have attended in person was highlighted.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data Availability
Data available upon request.
References
Affordable Connectivity Program, (2023). Universal Service Administrative Company. https://www.affordableconnectivity.gov/
ATLAS.ti, (2022). Scientific Software Development GmbH [ATLAS.ti 22 Windows]
Baker, C. N., Arnold, D. H., & Meagher, S. (2011). Enrollment and attendance in a parent training prevention program for conduct problems. Prevention Science, 12(2), 126–138. https://doi.org/10.1007/s11121-010-0187-0
Biederman, J., Petty, C. R., Dolan, C., et al. (2008). The long-term longitudinal course of oppositional defiant disorder and conduct disorder in ADHD boys: Findings from a controlled 10-year prospective longitudinal follow-up study. Psychological Medicine, 38(7), 1027–1036. https://doi.org/10.1017/s0033291707002668
Chacko, A., Jensen, S. A., & Lowry, L. S. et al. (2016). Engagement in behavioral parent training: Review of the literature and implications for practice. Clinical Child and Family Psychology Review, 19(3), 204–215. https://doi.org/10.1007/s10567-016-0205-2
Chaudry, A., & Wimer, C. (2016). Poverty is not just an indicator: The relationship between income, poverty, and child well-being. Academic Pediatrics, 16(3, Supplement), S23-S29. https://doi.org/10.1016/j.acap.2015.12.010
Child-Adult Relationship Enhancement in Primary Care (PriCARE) / Criando Niños Con CARIÑO (CARIÑO), (2022). U.S. National Library of Medicine. Updated 7/12/22. Accessed Aug 27, 2022. https://clinicaltrials.gov/ct2/show/NCT05233150
Cree, R. A. B. R., & Robinson, L. R, et al. (2018). Health care, family, and community factors associated with mental, behavioral, and developmental disorders and poverty among children aged 2–8 years — United States, 2016. 67, 1377–1383
Currie, J., & Widom, C. S. (2010). Long-term consequences of child abuse and neglect on adult economic well-being. Child Maltreatment, 15(2), 111–120. https://doi.org/10.1177/1077559509355316
Dougherty, L. R., Smith, V. C., Bufferd, S. J., Kessel, E., Carlson, G. A., & Klein, D. N. (2015). Preschool irritability predicts child psychopathology, functional impairment, and service use at age nine. Journal of Child Psychology and Psychiatry, 56(9), 999–1007. https://doi.org/10.1111/jcpp.12403
Drewek, R., Mirea, L., & Adelson, P. D. (2017). Lead time to appointment and no-show rates for new and follow-up patients in an ambulatory clinic. Health Care Management (Frederick), 36(1), 4–9. https://doi.org/10.1097/hcm.0000000000000148
Duberley, J., Johnson, P., & Cassell, C. (2012). Qualitative organizational research: Core methods and current challenges. SAGE Publications, Inc. https://sk.sagepub.com/books/qualitative-organizational-research-core-methods-and-current-challenges
Egger, H. L., & Angold, A. (2006). Common emotional and behavioral disorders in preschool children: Presentation, nosology, and epidemiology. J Child Psychol Psychiatry. Mar-Apr, 47(3–4), 313–337. https://doi.org/10.1111/j.1469-7610.2006.01618.x
Elizabeth, D. R., & Spencer, H. H. (2015). Triangulate and expand. Handbook of Qualitative Organizational Research. Routledge: chap Triangulate and Expand
Expanding broadband, (2022). Potential role of municipal networks to address tahe digital divide. https://crsreports.congress.gov/product/pdf/R/R47225/1
Furlong, M., McGilloway, S., Bywater, T., Hutchings, J., Smith, S. M., & Donnelly, M. (2012). Behavioural and cognitive-behavioural group-based parenting programmes for early-onset conduct problems in children aged 3 to 12 years. Cochrane Database Systymatic Review, (2), Cd008225. https://doi.org/10.1002/14651858.CD008225.pub2
Hennink, M., & Kaiser, B. N. (2022). Sample sizes for saturation in qualitative research: A systematic review of empirical tests. Social Science & Medicine, 292, 114523. https://doi.org/10.1016/j.socscimed.2021.114523
Hsieh, H. F., & Shannon, S. E. (2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15(9), 1277–1288. https://doi.org/10.1177/1049732305276687
Kuppens, S., & Ceulemans, E. (2019). Parenting styles: A closer look at a well-known concept. Journal of Child and Family Studies, 28(1), 168–181. https://doi.org/10.1007/s10826-018-1242-x
Lebrun-Harris, L. A., Ghandour, R. M., Kogan, M. D., & Warren, M. D. (2022). Five-year trends in US children’s health and well-being, 2016–2020. JAMA Pediatrics., 176(7), e220056–e220056. https://doi.org/10.1001/jamapediatrics.2022.0056
Luby, J. L., Gaffrey, M. S., Tillman, R., April, L. M., & Belden, A. C. (2014). Trajectories of preschool disorders to full DSM depression at school age and early adolescence: Continuity of preschool depression. American Journal of Psychiatry, 171(7), 768–776. https://doi.org/10.1176/appi.ajp.2014.13091198
Miller, C. J., Barnett, M. L., Baumann, A. A., Gutner, C. A., & Wiltsey-Stirman, S. (2021). The FRAME-IS: A framework for documenting modifications to implementation strategies in healthcare. Implementation Science, 16(1), 36. https://doi.org/10.1186/s13012-021-01105-3
Moon, D. J., Damman, J. L., & Romero, A. (2020). The effects of primary care-based parenting interventions on parenting and child behavioral outcomes: A systematic review. Trauma, Violence & Abuse, 21(4), 706–724. https://doi.org/10.1177/1524838018774424
Morrison-Smith, S., & Ruiz, J. (2020). Challenges and barriers in virtual teams: A literature review. SN Applied Sciences, 2(6), 1096. https://doi.org/10.1007/s42452-020-2801-5
O’Cathain, A., Murphy, E., & Nicholl, J. (2010). Three techniques for integrating data in mixed methods studies. BMJ, 341, c4587. https://doi.org/10.1136/bmj.c4587
Ogundele, M. O. (2018). Behavioural and emotional disorders in childhood: A brief overview for paediatricians. World Journal of Clinical Pediatrics, 7(1), 9–26. https://doi.org/10.5409/wjcp.v7.i1.9
Parmanto, B., Lewis, A. N., Jr., Graham, K. M., & Bertolet, M. H. (2016). Development of the Telehealth Usability Questionnaire (TUQ). International Journal of Telerehabilitation Springer, 8(1), 3–10. https://doi.org/10.5195/ijt.2016.6196
Peacock-Chambers, E., Ivy, K., & Bair-Merritt, M. (2017). Primary care interventions for early childhood development: A systematic review. Pediatrics, 140(6) https://doi.org/10.1542/peds.2017-1661
Perrin, E. C., Sheldrick, R. C., McMenamy, J. M., Henson, B. S., & Carter, A. S. (2014). Improving parenting skills for families of young children in pediatric settings: A randomized clinical trial. JAMA Pediatrics, 168(1), 16–24. https://doi.org/10.1001/jamapediatrics.2013.2919
Powell, B. J., Proctor, E. K., & Glisson, C. A, et al. (2013). A mixed methods multiple case study of implementation as usual in children’s social service organizations: Study protocol. Implement Science, 8, 92. https://doi.org/10.1186/1748-5908-8-92
Sandler, I., Ingram, A., Wolchik, S., Tein, J. Y., & Winslow, E. (2015). Long-term effects of parenting-focused preventive interventions to promote resilience of children and adolescents. Child Dev Perspect., 9(3), 164–171. https://doi.org/10.1111/cdep.12126
Sayal, K., Washbrook, E., & Propper, C. (2015). Childhood behavior problems and academic outcomes in adolescence: Longitudinal population-based study. Journal of the American Academy of Child and Adolescent Psychiatry, 54(5), 360–8.e2. https://doi.org/10.1016/j.jaac.2015.02.007
Schilling, S., French, B., Berkowitz, S. J., Dougherty, S. L., Scribano, P. V., & Wood, J. N. (2017). Child-Adult Relationship Enhancement in Primary Care (PriCARE): A randomized trial of a parent training for child behavior problems. Acad Pediatr. Jan-Feb, 17(1), 53–60. https://doi.org/10.1016/j.acap.2016.06.009
Schilling, S., Ritter, V., Wood, J. N., Fine, J., & Zolotor, A. J. (2020). Child-Adult Relationship Enhancement in Primary Care: A randomized trial of a skill-based parent training with parent mentor adaptation. Journal of Developmental and Behavioral Pediatrics, 41(4), 272–280. https://doi.org/10.1097/dbp.0000000000000759
Shaffer, A., Kotchick, B., Dorsey, S., & Rex, F. (2001). The past, present, and future of behavioral parent training: Interventions for child and adolescent problem behavior. The Behavior Analyst Today, 2. https://doi.org/10.1037/h0099922
Shaikh, U. U., & Asif, Z. (2022). Persistence and dropout in higher online education: Review and categorization of factors. Frontiers in Psychology, 13, 902070. https://doi.org/10.3389/fpsyg.2022.902070
Shaver, J. (2022). The state of telehealth before and after the COVID-19 pandemic. Primary Care, 49(4), 517–530. https://doi.org/10.1016/j.pop.2022.04.002
Slomski, A. (2012). Chronic mental health issues in children now loom larger than physical problems. JAMA, 308(3), 223–225. https://doi.org/10.1001/jama.2012.6951
Smith, J. D., Cruden, G. H., & Rojas, L. M, et al. (2020). Parenting interventions in pediatric primary care: A systematic review. Pediatrics, 146(1) https://doi.org/10.1542/peds.2019-3548
StataCorp, (2019). Inventor; StataCorp. Stata Statistical Software: Release 16. College Station, TX, USA
Stringaris, A., Lewis, G., & Maughan, B. (2014). Developmental pathways from childhood conduct problems to early adult depression: Findings from the ALSPAC cohort. British Journal of Psychiatry, 205(1), 17–23. https://doi.org/10.1192/bjp.bp.113.134221
Weiner, B. J., Lewis, C. C., & Stanick, C, et al. (2017). Psychometric assessment of three newly developed implementation outcome measures. Implement Science, 12(1), 108. https://doi.org/10.1186/s13012-017-0635-3
Weitzman, C., Wegner, L., & Developmental, T. S. O., et al. (2015). Promoting optimal development: Screening for behavioral and emotional problems. Pediatrics, 135(2), 384–395. https://doi.org/10.1542/peds.2014-3716
Wiltsey Stirman, S., Baumann, A. A., & Miller, C. J. (2019). The FRAME: An expanded framework for reporting adaptations and modifications to evidence-based interventions. Implementation Science, 14(1), 58. https://doi.org/10.1186/s13012-019-0898-y
Wood, J. N., Kratchman, D., Scribano, P. V., Berkowitz, S., & Schilling, S. (2021). Improving child behaviors and parental stress: A randomized trial of Child Adult Relationship Enhancement in Primary Care. Academic Pediatrics, 21(4), 629–637. https://doi.org/10.1016/j.acap.2020.08.002
Zhang, S., & Elhadad, N. (2016). Factors contributing to dropping-out in an online health community: Static and longitudinal analyses. American Medical Informatics Association Annual Symposium Proceedings, 2016, 2090–2099.
Funding
This research was partially supported by a National Research Service Award Post-Doctoral Traineeship from the Health Resources and Services Administration sponsored by The Cecil G. Sheps Center for Health Services Research, The University of North Carolina at Chapel Hill, Grant No. 2-T32-HP14001-34–00 (Brittany Raffa). This research is funded by the Eunice Kennedy Shriver National Institute of Child Health and Human Development (1R01HD103902-01) (Schilling, Wood).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix 1. Final codebook
Description | |
|---|---|
Factors impeding virtual PriCARE feasibility Virtual PriCARE seems implementable Virtual PriCARE seems possible Virtual PriCARE seems doable Virtual PriCARE seems easy to use Challenges with technology New distractions Virtual burn out | This code group includes factors that made PriCARE less feasible/more difficult to implement in the virtual setting This code mentions any challenges with technology, such as bandwidth, not seeing everyone on the screen, multiple speakers/cross talking, muting/unmuting people, and caregivers turning their cameras off This code mentions any challenges with distractions related to the virtual platform, such as cooking dinner or putting children to bed in the background. It also describes how caregivers responded to distractions such as letting their child watch TV while they participated in the session This code describes how the new norm of virtual technology makes the implementation of virtual PriCARE more difficult because caregivers and facilitators were weary of using virtual platforms to interact because they are using it so much in their daily routine |
Factors promoting virtual PriCARE feasibility Mitigation of participation barriers for caregivers Reduced time commitment for facilitators Normalization of virtual meetings | This code group includes factors that made PriCARE more feasible/easier to implement in the virtual setting This code includes mentions of mitigation of outside factors for caregivers, such as travel time and gas, not having to leave work early to participate, or being able to participate from home while also doing activities in the background This code includes mentions of a reduced time commitment for facilitators, both due to shortened sessions and no travel time This code describes how the new norm of virtual technology makes the implementation of virtual PriCARE easier because participants and trainers being more familiar with virtual platforms, and have already acquired the necessary elements (smart phone, Wi-Fi, zoom app, etc.) |
Adaptations Recorded playtime | This code includes any changes mentioned due to facilitating virtually instead of in person, including asking more questions, taking on more of the role of a teacher, and managing technology This code includes mentions of recorded parent–child playtime to replace some of the caregiver role-play which needed to be shortened in the virtual format |
Fidelity | This code includes mentions of consistent elements in relation to facilitating PriCARE virtually, including the same preparation and teaching of content |
Appropriateness Virtual PriCARE seems fitting PriCARE seems suitable Virtual PriCARE seems applicable Virtual PriCARE seems like a good match Virtual PriCARE components that are appropriate Virtual PriCARE components that are not appropriate | This code group was used to designate whether or not facilitators and caregivers felt virtual format was a good fit, suitable, and applicable to helping caregivers achieve the PriCARE objectives This code indicates that facilitators or caregivers felt the virtual format was an appropriate setting for caregivers to learn PriCARE skills. Comments about being able to effectively communicate the program material as well as comments about successfully learning and mastering PriCARE skills and content should be coded here This code indicates that facilitators or caregivers felt the virtual format was suboptimal for caregivers to learn PriCARE skills. Comments about not being able to effectively communicate program content and caregivers not being able to master PriCARE skills should be coded here. Also include challenges related to interpersonal interactions between caregivers and between caregivers and facilitators due to the virtual platform such as lack of social interactions and bonding between caregivers and caregivers not staying back to have one-on-one discussions with facilitators |
Acceptability Virtual PriCARE meets my approval Virtual PriCARE is appealing to me I like virtual PriCARE I welcome virtual PriCARE Virtual PriCARE components that are acceptable Virtual PriCARE components that are not acceptable | This code group was used to designate whether or not caregivers or trainers felt that virtual PriCARE met their approval and was appealing Any mentions that the caregiver or facilitator liked or enjoyed attending or facilitating the virtual intervention. Include descriptions of the program meeting caregiver expectations. Descriptions of the caregiver being able to successfully master PriCARE skills or achieve better communication with their child because of the program should be coded under appropriateness Any mentions that the caregiver or facilitator did not enjoy about attending or facilitating the virtual intervention or wished had been different |
Recommendations | This code mentions recommendations for adaptations to improve the implementation of virtual PriCARE |
Disparities | This code mentions the impact of disparities on the implementation of and engagement in virtual PriCARE, including engagement disparities by SES, race, ethnicity, and family size |
Appendix 2. Qualitative interview guides
Trainer Interview Guide.
Hello. My name is _______ and I am from the University of North Carolina at Chapel Hill. I have asked you to participate in this short, roughly 20-min, interview so that I can learn more about your experiences facilitating the PriCARE program virtually. Our goal is to collect information from both trainers and caregivers and see if virtual PriCARE was an effective, appropriate, feasible, and acceptable program.
Thanks so much for taking the time to do this today! I want to hear about all aspects of your experience, both positive and negative, as we want to improve the program as much as possible for future participants. Your answers will be kept confidential and will not be connected back with your name, so please speak as honestly and openly as you can.
I have questions to get the conversation started but am also willing to talk about anything that you hope to share beyond them. I will be recording our phone conversation to allow for transcription and documentation so that I do not have to take notes while we talk. Is it okay if I turn on the recorder now?
-
1)
Compared to facilitating in-person PriCARE groups, were there any unique challenges to facilitating virtual PriCARE?
-
a.
How did you negotiate these challenges?
-
b.
What, if anything, did you change about how you facilitated due to the switch to a virtual platform?
-
a.
-
2)
What, if anything, worked better in the virtual platform compared to in-person?
-
3)
How do you think the parents engaged in the virtual setting?
-
a.
How might this parent engagement have been different in-person?
-
a.
-
4)
How was your engagement as a trainer impacted by the switch to a virtual platform?
-
a.
Did you feel that you could communicate effectively with parents in the virtual setting?
-
a.
-
5)
In your opinion, were parents able to meet the objectives of the PriCARE program (ex: mastery of the Ps and Qs) in the virtual setting?
-
6)
In general, what are the benefits of virtual PriCARE for trainers?
-
7)
In general, what are the challenges of virtual PriCARE for trainers?
-
8)
Do you have a preference between facilitating PriCARE in-person or virtually?
Thank you so much for your feedback! We will use these ideas, thoughts, and suggestions to see how to make virtual PriCARE the best experience possible. Do you have any questions for me before we wrap up?
Caregiver Interview Guide.
Hello. My name is _______ and I am from the University of North Carolina at Chapel Hill. I have asked you to participate in this short, roughly 20-min, interview so that I can learn more about your experiences with the virtual PriCARE parenting program. Our goal is to collect information from multiple caregivers and see if virtual PriCARE was an effective, appropriate, feasible, and acceptable program.
Thanks so much for taking the time to do this today! I will be asking you questions about the PriCARE sessions you participated in. I want to hear about all aspects of your experience, both positive and negative, as we want to improve the program as much as possible for future participants. Your answers will be kept confidential and will not be connected back with your name, so please speak as honestly and openly as you can. As a thank you for your time, we will send you $20.
I have questions to get the conversation started but am also willing to talk about anything that you hope to share beyond them. I will be recording our phone conversation to allow for transcription and documentation so that I do not have to take notes while we talk. Is it okay if I turn on the recorder now?
-
1)
What did you take away from the virtual PriCARE program?
-
a)
What part of the program was especially important to you?
-
a)
-
2)
How did you feel about doing PriCARE virtually?
-
a)
What, if anything, worked well?
-
b)
What, if anything, do you wish had been different?
-
a)
-
3)
Did you face any challenges with childcare during the sessions?
-
4)
Did the PriCARE program meet your expectations?
-
a)
Can you tell me more about that?
-
a)
-
5)
How was communication with the PriCARE facilitators and other caregivers during the virtual program?
-
a)
Can you tell me more about that?
-
a)
-
6)
What do you think would have been different about your experience if you had attended the in-person version of the program?
-
7)
In considering caregivers in general, what are the benefits of participating in virtual PriCARE?
-
a)
Is there anything beneficial specifically related to the virtual platform?
-
a)
-
8)
Generally, what would you say are the challenges to caregiver participation in virtual PriCARE?
-
a)
Are there challenges specifically related to the virtual platform?
-
a)
Thank you so much for your feedback! We will use these ideas, thoughts, and suggestions to see how to make virtual PriCARE the best experience possible. Do you have any questions for me before we wrap up?
Appendix 3. Survey
General Questions.
Please complete the questionnaire below as part of the research study evaluating the implementation of the virtual version of Child–Adult Relationship Enhancement in Primary Care.
-
1.
Are you a trainer who facilitates virtual PriCARE or a parent/caregiver who participated in virtual PriCARE?
-
a.
Trainer
-
b.
Parent/Caregiver
-
a.
Trainer Questions.
For each of the questions below, please enter or select what best matches your answer.
Demographics
-
1.
What is your age?
-
a.
*short answer*
-
a.
-
2.
What is your race? Select all that apply.
-
a.
American Indian or Alaskan Native; Asian; Black or African American; Native Hawaiian or Other Pacific Islander; White; Prefer Not to Say
-
a.
-
3.
What is your ethnicity?
-
a.
Hispanic or Latino; Not Hispanic or Latino
-
a.
-
4.
What gender do you identify as?
-
a.
Male; Female; Other; Prefer Not to Say
-
a.
PriCARE Experience
-
1.
How many in-person PriCARE groups did you facilitate before the switch to a virtual platform?
-
a.
*short answer*
-
a.
-
2.
How many virtual PriCARE groups have you facilitated?
-
a.
*short answer*
-
a.
-
3.
Do you provide PriCARE consultation/supervision?
-
a.
Yes; No
-
a.
The next statements are about the virtual PriCARE program. Please indicate how much you agree or disagree with each statement.
AIM
-
1.
Virtual PriCARE meets my approval.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
2.
Virtual PriCARE is appealing to me.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
3.
I like virtual PriCARE.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
4.
I welcome virtual PriCARE.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
IAM
-
1.
Virtual PriCARE seems fitting.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
2.
Virtual PriCARE seems suitable.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
3.
Virtual PriCARE seems applicable.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
4.
Virtual PriCARE seems like a good match.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
FIM
-
1.
Virtual PriCARE seems implementable.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
2.
Virtual PriCARE seems possible.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
3.
Virtual PriCARE seems doable.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
4.
Virtual PriCARE seems easy to use.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
The next statements are about the virtual platform and experience with facilitating virtual PriCARE. Please indicate how much you agree or disagree with each statement.
TUQ
-
1.
Virtual PriCARE improves my access to facilitate parenting programs.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
2.
Virtual PriCARE saves me time traveling to the clinic.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
3.
Virtual PriCARE provides for my training needs.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
4.
It was simple to learn to use the virtual platform.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
5.
It was easy to learn to use the virtual platform.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
6.
I believe I could become productive quickly using the virtual platform.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
7.
The way I interact with the virtual platform is pleasant.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
8.
I like using the virtual platform.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
9.
The virtual platform is simple and easy to understand.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
10.
The virtual platform is able to do everything I would want it to be able to do.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
11.
I could easily talk to the caregivers using the virtual platform.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
12.
I could hear the caregivers clearly using the virtual platform.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
13.
I felt I was able to express myself effectively.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
14.
Using the virtual platform, I could see the caregivers as well as if we met in person.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
15.
I think the sessions provided over the virtual platform were the same as in-person sessions.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
16.
Whenever I made a mistake using the virtual platform, I could recover easily and quickly.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
17.
The virtual platform gave us error messages that clearly told me how to fix problems.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
18.
I feel comfortable communicating with the caregivers using the virtual platform.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
19.
A virtual format, such as the virtual platform, is an acceptable way to attend parenting programs, such as PriCARE.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
20.
I would use virtual PriCARE again.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
21.
Overall, I am satisfied with virtual PriCARE.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
For the questions below, please select what best matches your answer.
Other
-
1.
What device did you use to facilitate virtual PriCARE? Select all that apply.
-
a.
Phone; Tablet; Desktop Computer; Laptop Computer; Other
-
a.
-
2.
Do you consistently have access to wireless internet where you live?
-
a.
Yes; No
-
a.
Caregiver Questions.
For each of the questions below, please enter or select what best matches your answer. Throughout this questionnaire, when a question refers to "your child," we mean the child who was enrolled in the program with you.
Demographics
-
1.
What is your age?
-
2.
What is your child’s age?
-
3.
How many children do you have total?
-
4.
Are your other children older or younger than the child who was enrolled in the program with you?
-
a.
Older; Younger; Both Older and Younger
-
a.
-
5.
What is your race? Select all that apply.
-
a.
American Indian or Alaskan Native; Asian; Black or African American; Native Hawaiian or Other Pacific Islander; White; Prefer Not to Say
-
a.
-
6.
What is your ethnicity?
-
a.
Hispanic or Latino; Not Hispanic or Latino; Prefer Not to Say
-
a.
-
7.
What gender do you identify as?
-
a.
Male; Female; Other; Prefer Not to Say
-
a.
-
8.
What is the highest grade or level of education that you have completed? If exact level is not listed, mark the closest equivalent.
-
a.
Elementary School/Primary School (includes grades 1–5); Middle School/Junior High (includes grades 6–8); High School/Preparatory School; Trade School/Vocational School; University/College; Graduate School; Prefer Not to Say
-
a.
-
9.
What is your current employment status?
-
a.
Employed full time for 30 h/week or more in one job
-
b.
Employed part time for less than 30 h/week in one or more jobs
-
c.
Self-employed
-
d.
Homemaker
-
e.
Student
-
f.
Not employed
-
g.
Prefer not to say
-
a.
-
10.
How much is your current household income? Include your own income, the income of everyone in the household, and income from all other sources.
-
a.
Under $10,000 per year; $10,000—19,999 per year; $20,000—39,999 per year; $40,000—59,999 per year; $60,000—79,999 per year; More than $80,000 per year; Do Not Know/Prefer Not to Say
-
a.
-
11.
Do you or anyone in your household receive Medicaid, TANF, Work First, SNAP, or support from any other governmental assistance programs?
-
a.
Yes; No; Do Not Know/Prefer Not to Say
-
a.
The next statements are about the virtual PriCARE program. Please indicate how much you agree or disagree with each statement.
AIM
-
1.
Virtual PriCARE meets my approval.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
2.
Virtual PriCARE is appealing to me.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
3.
I like virtual PriCARE.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
4.
I welcome virtual PriCARE.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
IAM
-
1.
Virtual PriCARE seems fitting.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
2.
Virtual PriCARE seems suitable.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
3.
Virtual PriCARE seems applicable.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
4.
Virtual PriCARE seems like a good match.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
FIM
-
1.
Virtual PriCARE seems implementable.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
2.
Virtual PriCARE seems possible.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
3.
Virtual PriCARE seems doable.
-
4.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
5.
Virtual PriCARE seems easy to use.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
The next statements are about the virtual platform and experience with attending virtual PriCARE. Please indicate how much you agree or disagree with each statement.
TUQ
-
1.
Virtual PriCARE improves my access to parenting programs.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
2.
Virtual PriCARE saves me time traveling to the clinic.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
3.
Virtual PriCARE provides for my parenting needs.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
4.
It was simple to learn to use the virtual platform.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
5.
It was easy to learn to use the virtual platform.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
6.
I believe I could become productive quickly using the virtual platform.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
7.
The way I interact with the virtual platform is pleasant.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
8.
I like using the virtual platform.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
9.
The virtual platform is simple and easy to understand.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
10.
The virtual platform is able to do everything I would want it to be able to do.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
11.
I could easily talk to the trainers and other caregivers using the virtual platform.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
12.
I could hear the trainers and other caregivers clearly using the virtual platform.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
13.
I felt I was able to express myself effectively.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
14.
Using the virtual platform, I felt I could see the trainers and other caregivers as well as if we met in person.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
15.
I think the sessions provided over the virtual platform would be the same as in-person sessions.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
16.
Whenever I made a mistake using the virtual platform, I could recover easily and quickly.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
17.
The virtual platform gave us error messages that clearly told me how to fix problems.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
18.
I felt comfortable communicating with the trainers and other caregivers using the virtual platform.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
19.
A virtual format, such as the virtual platform, is an acceptable way to attend parenting programs, such as PriCARE.
-
20.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
21.
I would attend virtual PriCARE again or recommend it to other parents.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
-
22.
Overall, I am satisfied with virtual PriCARE.
-
a.
Completely Disagree; Disagree; Neither Agree nor Disagree; Agree; Completely Agree
-
a.
For each of the questions below, please select what best matches your answer.
Other
-
1.
How often do you go online?
-
a.
Once or twice a month; Three or four times a month; Once or twice a week; Three or four times a week; Five times a week or more
-
a.
-
2.
How long do you spend online each time?
-
a.
Less than 30 min; 30–60 min; 1–2 h; More than 2 h; Most of the day
-
a.
-
3.
How many years ago did you start using the internet this often?
-
a.
Less than one year ago; 1–2 years ago; 3–4 years ago; 5 or more years ago
-
a.
-
4.
What device did you use to attend virtual PriCARE? Select all that apply.
-
a.
Phone; Tablet; Desktop Computer; Laptop Computer; Other
-
a.
-
5.
Do you consistently have access to wireless internet where you live?
-
a.
Yes; No
-
a.
Please select how often you have used the internet to do any of the following activities related to child-rearing.
-
1.
Look for information to help with school homework.
-
a.
Never; Rarely; Sometimes; Often; Very Often
-
a.
-
2.
Contact a teacher via the Internet.
-
a.
Never; Rarely; Sometimes; Often; Very Often
-
a.
-
3.
Look for an online educational game.
-
a.
Never; Rarely; Sometimes; Often; Very Often
-
a.
-
4.
Seek guidance on child development.
-
a.
Never; Rarely; Sometimes; Often; Very Often
-
a.
-
5.
Look up family health-related information.
-
a.
Never; Rarely; Sometimes; Often; Very Often
-
a.
-
6.
Look for parenting-related topics.
-
a.
Never; Rarely; Sometimes; Often; Very Often
-
a.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Raffa, B.J., Wood, J.N., Rezabek, R. et al. A Feasibility Study on the Virtual Adaptation of Child–Adult Relationship Enhancement in Primary Care. J. technol. behav. sci. (2024). https://doi.org/10.1007/s41347-024-00393-y
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s41347-024-00393-y