Background

Clinical trials are necessary to test various drugs as well as other medical or behavioral interventions. Natural history studies are critical to our understanding of disease etiology and progression. Both place considerable demands on participants who often endure invasive interventions or assessment procedures over long periods of time. Participants’ satisfaction with a trial or study experience is likely important to both compliance with the study protocol and study retention. However, few studies have examined study satisfaction and experiences among study participants [1]. This dearth of literature is particularly noteworthy in pediatric populations. Published studies of parent satisfaction focus mostly on the child’s care or specific aspects of a study [2,3,4,5,6], but studies of parents’ overall satisfaction with a study in which their child is enrolled are limited. The studies that do exist suggest that most participating parents will recommend the study to others and are willing to participate in a new study [2, 5, 7].

Studies examining factors associated with parent study satisfaction are also limited. Less educated parents and those from racial or ethnic minority groups often report greater satisfaction than higher educated parents or those from the majority culture [3, 8]. Higher overall satisfaction was also associated with fewer transportation problems and fewer study-related financial difficulties [6]. Most studies examining parent satisfaction do not report differences between mothers’ and fathers’ satisfaction; studies examining fathers’ study satisfaction are rare.

Type 1 diabetes is an autoimmune disease usually diagnosed in childhood; its prevalence is increasing worldwide [9]. Exogenous insulin replacement by injection or insulin pump is necessary for survival and there is no cure for type 1 diabetes. Although children at risk for type 1 diabetes can be identified by genetic and immunologic markers, there currently is no means to prevent the disease in these high-risk children. The Diabetes Prevention Trial (DPT-1) tested both insulin injections and oral insulin as possible prevention strategies in children at risk for type 1 diabetes; neither intervention was effective [10, 11]. Participants’ satisfaction was examined in all arms of the study. There was a high level of study satisfaction overall, but some important differences between participants emerged: parents reported greater study satisfaction than children, adult participants reported greater study satisfaction than child participants, and mothers reported greater study satisfaction than fathers [12, 13].

The Environmental Determinants of Diabetes in the Young (TEDDY) study was designed to identify environmental triggers of type 1 diabetes in genetically at-risk children from birth to 15 years of age. Using the DPT-1 methodology, TEDDY monitors parent study satisfaction on an ongoing basis and has found it to be associated with both study retention [14] and adherence with OGTT assessments [15], but not food record compliance [16].

The role of study staff as a determinant of participants’ study satisfaction seems critical since it is a potentially modifiable component of a study’s protocol. Studies suggest that participants were more likely to report greater study satisfaction when they felt the study staff had enough time for them, listened to them, and treated them with respect and friendliness [5, 17,18,19]. Few studies have examined whether consistency in study staff is important to participants’ study satisfaction. In a study examining reasons for retention, 89% of the parents gave the highest rating “liked a lot” for “seeing the same staff at each visit” [20]. Another study reported frequent staff changes across study visits as one of the top three most negative experiences for participants in a long-term trial [21].

The aim of the current study was to identify factors associated with parent study satisfaction in TEDDY, with a particular focus on the role of staff consistency. The study is unique in that it examines study satisfaction in both mothers and fathers in a multinational study at two points in time: after one year and after 4 years. Furthermore, the availability of psychosocial and sociodemographic variables collected during the TEDDY study permitted an examination of a wide range of factors potentially associated with study satisfaction. Since the different TEDDY countries have different approaches to study staffing, TEDDY data provided an important opportunity to examine the association of staff consistency with parent study satisfaction.

Methods

The TEDDY study

The aim of the TEDDY study is to identify environmental triggers of diabetes-related autoimmunity and progression to type 1 diabetes in genetically at-risk children. A total of 8676 children were enrolled in TEDDY before 4.5 months of age. Enrollment occurred during 2004–2010 in four different countries: Finland, Germany, Sweden, and the US. Each country’s ethical board approved the TEDDY study [22]. Most participants (89%) have no family members with type 1 diabetes. TEDDY children are followed until type 1 diabetes diagnosis or 15 years of age. The protocol includes four visits per year until four years of age, with visits reduced to two times per year for islet autoantibody-negative children while islet autoantibody-positive children maintain quarterly visits. Study visits include data collection from interviews, questionnaires, blood draws, and nasal swabs.

Study satisfaction

In TEDDY, overall study satisfaction was measured by questionnaire at a child’s 6- and 15-months visits, then annually thereafter. In the present study, we used the data from the 15-month and the four-year questionnaires, since 15 months is one year after enrollment and four years is the end of the quarterly visit schedule for all TEDDY children. Both mothers and fathers were administered the questionnaires. Using the same methodology employed in the DPT-1 [12, 13], study satisfaction was measured by three items: 1) “Overall, how do you feel about having your child participate in the TEDDY study? (scored 2 =like it a lot, 1 =like it a little, 0 =it is ok or dislike it),” 2) “Do you think your child’s participation in TEDDY was a good decision? (scored: 2 = a great decision, 1 = a good decision, 0= an ok decision or bad decision)’” and 3) “Would you recommend the TEDDY study to a friend? (scored: 2 =yes, 1 =maybe, 0 =no).” Since these items were highly correlated, they were summed to create a total satisfaction score with a range of 0–6. Reliability estimates for this sample ranged from α = 0.80 to α = 0.83.

Study sample/population

We examined study satisfaction at two different time points: one year (child-age 15 months) and four years after enrollment (child-age 48 months). Out of the 8676 enrolled children, there were 6576 mothers and 5859 fathers at child-age 15 months who had completed the study satisfaction measure. At child-age four years, there were 4744 mothers and 4063 fathers with study satisfaction scores. Parents were excluded if the child was not HLA eligible (child-age 15 months: 56 mothers and 47 fathers; child-age four years: 27 mothers and 22 fathers); the child had maternal autoantibodies at birth (child-age 15 months: 263 mothers and 231 fathers; child-age four years: 176 mothers and 154 fathers; or the child developed islet autoantibodies for type 1 diabetes (child-age 15 months: 678 mothers and 639 fathers; child-age four years: 531 mothers and 476 fathers). The final sample consisted of 5579 mothers and 4942 fathers at child-age 15 months and 4010 mothers and 3411 fathers at child-age four years (Fig. 1).

Fig. 1
figure 1

Flowchart

Sociodemographic measures

Sociodemographic variables collected at study inception included country of residence, child sex, child has a first-degree relative (mother, father, or sibling) with type 1 diabetes (yes/no), parental age at birth of the child, and child ethnic minority status (yes = for USA: the mother was not born in the USA, the mother’s first language is not English, or the child is a member of an ethnic minority; for Europe: the country of birth or mother’s first language is one other than that of the TEDDY country in which the child is living. Others = no). Additional sociodemographic variables collected at the 9-month visit included parent education (categorized as primary education or some trade school, graduated trade school, graduated college/university or higher), parent’s first child (yes/no), and parent’s marital status (parents married/living together: yes/no).

Study-related variables

Recruitment cohort

The recruitment cohort was of interest because TEDDY made a protocol change in March 2009 which introduced a study intervention designed to reduce study drop-outs [23]. Consequently, two recruitment cohorts were examined: children enrolled in TEDDY from September 2004–February 2009 and children enrolled from March 2009–February 2010.

Study staff consistency

Since all personnel working in the TEDDY study have a specific staff code recorded at every study visit, the number of staff changes prior to any given study visit could be examined. For the 15-month analysis, we counted the number of staff changes for that specific family from enrollment to the 15-month visit (from a minimum of 0 to a maximum of 4). For the four-year analysis, we counted the number of staff changes in the year prior to the four-year visit (from a minimum of 0 to a maximum of 3). We also examined the total number of staff changes from study inception to the four-year study visit. However, the number of staff changes in the year prior to the four-year visit proved to be more strongly related to parent study satisfaction and is presented here.

Parent lifestyle behaviors

At the 9-month study visit, the following parent lifestyle behaviors were collected: smoking (yes/no) and working outside the home (yes/no).

Parent depression

The Depression subscale of the Well Being QuestionnaireFootnote 1 [24] was collected at the 15-month visit, than annually thereafter, with higher scores indicating a higher level of depression. The scores obtained at the 15-month and the four-year visit were used in the current analysis. Reliability estimates for this sample ranged from α = 0.62 to α = 0.69.

Parent reactions to the TEDDY Child’s type 1 diabetes risk

Parent reactions to the child’s type 1 diabetes risk were assessed at six months, 15 months and annually thereafter. Data collected at the 15-month and four-year visit were used in the current analysis.

Risk perception accuracy

The accuracy of the parent’s perception of the child’s risk for type 1 diabetes was assessed by the following item: “Compared to other children, do you think your child’s risk for developing diabetes is: much lower, somewhat lower, about the same, somewhat higher, or much higher. Responses of “higher” or “much higher” were categorized as accurate, while all other responses were categorized as inaccurate.

Belief that the Child’s type 1 diabetes risk can be reduced

Two questions were used to assess parent beliefs that the child’s diabetes risk can be reduced: “I can do something to reduce my child’s risk of developing diabetes” and “Medical professionals can do something to reduce my child’s risk for developing diabetes.” The parent was asked to agree or disagree with each statement on a five-point scale, from strongly agree to strongly disagree. The two items were reverse scored and summed to create a total score with a range of 0–8. A higher score indicated greater belief that the child’s risk of type 1 diabetes can be reduced. The coefficient alpha for this sample ranged from α = 0.67 to α = 0.71.

Parent anxiety about the Child’s risk for type 1 diabetes

Parent anxiety about the child’s risk for type 1 diabetes was measured by a 6-item short form [25] of the State Anxiety component of The State-Trait-Anxiety Inventory for Adults™ (STAI)Footnote 2 [26]. The measure was designed to specifically assess the parent’s anxiety about the child’s risk for type 1 diabetes. The 6-item short form score was converted to the 20-item scale score to make it comparable with the larger STAI literature [25]; a higher score indicated higher anxiety. Reliability estimates for this sample ranged from α = 0.90 to α = 0.91.

Data analysis

Comparison of study variables across independent groups were conducted using ANOVA for continuous variables and chi-square for categorical variables. Paired t-tests were used to compare mothers’ and fathers’ satisfaction scores. Multiple linear regression models were used to identify factors associated with study satisfaction of mothers and fathers separately, when the child was 15 months and four years of age. The analysis was done block by block in the following order: sociodemographic, study-related variables, parent lifestyle behaviors, parent depression, and parent reaction to the child’s type 1 diabetes risk. At each step, variables with a p value of < 0.10 were retained. The final model included all variables with a p value of < 0.05 in either the mother or father models. Since staff change was markedly higher in the US than Europe, the interaction of staff change by Europe (yes/no) was tested in all final models.

SPSS version 27 (IBM SPSS Statistics for Windows, Armonk, NY: IBM Corp) were used for the statistical analyses.

Results

Descriptive statistics for all study variables at child-age 15 months are provided by country for mothers (Table 1) and fathers (Table 2). There were significant country differences for all study variables except child sex and parents living together (fathers only). Noteworthy is the large difference in the number of staff changes in the US compared to Europe. In the first 15 months of the study, there were an average of 2.5 staff changes in the US compared to an average of 1.1 staff changes in Finland and 0.3 staff changes in Sweden (mothers’ data), a highly significant difference (p < 0.001 both for mothers and fathers).

Table 1 Mothers’ sample characteristics at child-age 15 months by country
Table 2 Fathers’ sample characteristics at child-age 15 months by country

Parent satisfaction score at 15-months and 4 years

The parent satisfaction score ranged from 0 to 6 and was skewed in a positive direction. At child-age 15-months, 45% of the mothers and 38% of the fathers had a score of six, the highest possible satisfaction score. At child-age four years, the results were similar with 48% of mothers and 40% of fathers with a score of six. Mothers had higher scores (M = 4.50, 95% Cl 4.46,4.55) than fathers (M = 4.12, 95% Cl 4.07, 4.17) at 15-months p < 0.001. The results were similar at four years (mothers: M = 4.59, 95% Cl 4.53,4.64; fathers: M = 4.18, 95% Cl 4.12, 4.25, p < 0.001). A total of 3825 mothers and 3138 fathers completed both the 15-month and four-year satisfaction measure. In this subgroup, parent satisfaction scores remained high over time (mothers: 15-months M = 4.68, 95% Cl 4.62, 4.73 and four-years M = 4.60, 95% Cl 4.55, 4.66; fathers: 15-months M = 4.25, 95% Cl 4.19, 4.31 and four-years M = 4.20, 95% Cl 4.13, 4.26).

Variables associated with mothers’ study satisfaction

Table 3 describes the factors associated with mothers’ study satisfaction at child-age 15 months and four years. The results were similar at both time-points. Country, mother’s education level, parents living together, maternal depression, risk perception accuracy, anxiety about the child’s type 1 diabetes risk, and belief that the child’s type 1 diabetes risk could be reduced were all associated with mothers’ study satisfaction at 15 months and at four years. Swedish and US mothers were more satisfied than Finnish mothers. Mothers with basic primary or trade school education were more satisfied than mothers with a university degree. Mothers living with the child’s father were less satisfied than those living apart, and mothers with higher depression subscale scores were less satisfied than those with lower depression scores. Mothers who were accurate about their child’s type 1 diabetes risk, those who were less anxious about the risk, and those who believed something could be done to reduce the child’s risk were all more satisfied with the TEDDY study. Mothers who were older at the child’s birth reported lower satisfaction scores at 15 months (p = 0.001), but not at four years (p = 0.734). More frequent staff change was associated with less study satisfaction at 15 months (− 0.04, 95% Cl-0.08,0.003, p = 0.071), but not at four years (0.01, 95% Cl − 0.05, 0.07, p = 0.806), although the 15-month study result only approached significance.

Table 3 Final generalized liner models for mothers’ satisfaction at child-age 15 months and 4 years

Variables associated with fathers’ study satisfaction

The multiple linear regression model results for fathers are provided in Table 4. Similar to the findings for mothers, the variables of country, education level, parental depression, risk perception accuracy, and belief that the child’s type 1 diabetes risk could be reduced were all associated with fathers’ study satisfaction. At 15 months (− 0.07, 95% Cl − 0.11, − 0.02, p = 0.007) but not at four years (− 0.02, 95% Cl − 0.09, 0.05, p = 0.531), fathers were less satisfied if there were greater staff changes since enrollment. There were two additional findings for fathers that did not occur for mothers: fathers with type 1 diabetes in the family were more satisfied (p = 0.006) at child-age 15 months, while fathers who smoked were more satisfied with their participation in TEDDY (p = 0.032) at child-age 4 years.

Table 4 Final generalized liner model for fathers’ satisfaction at child-age 15 months and 4 years

Interaction of staff consistency with European versus US sites

Because of the large differences in staff change frequency between European and US sites, we examined whether staff consistency was differentially important for Europe and the US. The interaction was significant for both mothers and fathers at both 15 months and four years. Consequently, we reran our final models for the US and Europe separately. Staff consistency was important for Europe, but not the US, with greater staff change frequency associated with lower study satisfaction among European mothers (child-age 15 months: − 0.30,95% Cl − 0.36, − 0.24, p < 0.001; child-age four years: -0.41, 95% Cl − 0.53, − 0.29, p < 0.001) and fathers (child-age 15 months: -0.28, 95% Cl − 0.34, − 0.21, p < 0.001; child-age four years: -0.35, 95% Cl − 0.48, − 0.21, p < 0.001). Adjusting for all other variables in the final model, one additional staff change before 15 months of age significantly decreased the mothers’ average satisfaction score by − 0.30 and fathers’ by − 0.28; at four years the score decreased by − 0.41 for mothers and − 0.35 for fathers. (Table 5, Fig. 2).

Table 5 Association of staff consistency with parent study satisfaction at child-age 15 months and 4 years
Fig. 2
figure 2

Study satisfaction at child-age 15 months and 4 years for US and Europe by number of staff changes in the last year

Discussion

Similar to prior studies of parent study satisfaction [2, 5,6,7, 21], most TEDDY parents were very satisfied with their study participation; over 45% of mothers and over 38% of fathers had the highest possible satisfaction score after 1 year and 4 years in the study. DPT-1 [12, 13] used the same questions to measure satisfaction as in this study and their results were similar to ours with high parental satisfaction among both mothers and fathers. In DPT-1, mothers were more satisfied than fathers [13]. Our study showed similar results: mothers’ mean satisfaction scores were higher than fathers’ at both 15 months and four years. Differences between mothers’ and fathers’ study satisfaction may be partially explained by mothers’ more active role in the study; although many fathers did participate, mothers more often accompanied the child to TEDDY visits.

The TEDDY study is unique in both its monitoring of parental study satisfaction across time and its comprehensive examination of factors potentially related to parent study satisfaction. Factors associated with study satisfaction were similar for mothers and fathers and showed a similar pattern at child-age 15 months and four years.

Like our study, others have reported that lower education level is associated with higher study satisfaction [3, 8]. Being part of a longitudinal study with visits several times per year provides a parent with an opportunity to ask questions and talk to professionals about the child’s type 1 diabetes risk. Perhaps this is more important to parents with lower education compared to more highly educated parents who may more readily access information elsewhere. The repeated study visits may also provide important support to mothers who are not living with the child’s father; these mothers reported greater satisfaction with their study participation.

We found that variables related to parental reactions to their child’s type 1 diabetes risk to be associated with study satisfaction. Both parents with accurate risk perception and parents who believed they could do something to prevent their child from developing type 1 diabetes had higher study satisfaction scores. Anxiety about the child’s type 1 diabetes risk showed a weaker association. More anxious mothers were less satisfied at both child-age 15 months and 4 years. Father anxiety was weakly associated with study satisfaction at 15 months, but not at 4 years. The accuracy of a parent’s perception of their child’s diabetes risk is a modifiable variable. Parents participating in the TEDDY study receive information about their child’s type 1 diabetes risk at least once a year. Knowing one’s child is at risk for a chronic disease may increase a parent’s anxiety but also their willingness to continue participating. Knowing that someone is watching for signs and symptom of type 1 diabetes in their child may provide some comfort and a greater sense of satisfaction with study participation.

The role of study staff in parent study satisfaction is likely influenced by the invasiveness, duration, and frequency of study visits. Previous research has shown that even in studies with a short duration, participants’ satisfaction increased when they felt study staff had time for them, listened to them, treated them with respect, and were easy to communicate with [5, 17, 19]. In long-term trials, the consistency of study staff may be particularly important [21]. Prior study participants have expressed feelings of abandonment when their staff were transferred or when the study ended without opportunities for future contact [19]. In our study, we found that staff consistency was associated with European parent study satisfaction at both child-age 15 months and after four years. For these parents, fewer changes in study staff were associated with higher satisfaction scores, although this was not the case among US parents. This result is consistent with a prior report which found that one of the reasons for Swedish families to stay in TEDDY was to be seen by the same staff at all visits [27]. Although the participating countries in TEDDY follow the same study protocol, the operation of study clinics varies markedly. It was more common in European sites for participants to have a dedicated staff person following them though the study. This may be one of the reasons why European parents reported lower study satisfaction when faced with increasing staff changes. In contrast, from study inception, participants in US sites often saw different study staff across visits and were less affected by staff changes. Differences in health care systems may also play a part. European participants were all part of universal health care systems in which most children are followed by the same nurse or pediatrician from birth until they start school. US families have a very different health care experience. Some may see the same pediatrician on a regular basis, but many do not.

The present study had several limitation. We only investigated the importance of staff consistency and did not examine other staff characteristics shown to be important for study satisfaction or study retention, such as staff friendliness or responsiveness to questions [20]. Other studies have suggested that study staff often underestimate the importance of their own role in participant study satisfaction and study retention [19, 20]. This study is also limited to those who participated in TEDDY for at least one year. Consequently, we do not know if our findings apply to parents who withdrew from TEDDY in the first year. Our study only involved children who were at-risk for type 1 diabetes but did not yet have the disease; whether our findings would be similar for parents of children with diabetes remains to be seen. Similarly, the TEDDY study offers no intervention to prevent the disease. As a consequence, intervention trials may identify different factors associated with parental study satisfaction. However, the association of parent study satisfaction to both study retention and compliance [14, 15, 19, 20], suggests that the identification of factors associated with parent study satisfaction is important to the design of pediatric research studies. This study has numerous strengths in this regard, including a large sample size from four different countries, assessment of both mothers’ and fathers’ study satisfaction across long periods of time, use of a reliable measure of study satisfaction, and a comprehensive analysis of multiple factors for possible association with parental study satisfaction.

Conclusions

Sociodemographic factors, parental characteristics, and study-related variables were all related to parent study satisfaction. Those that are potentially modifiable are of particular interest as possible targets of future efforts to improve parent study satisfaction. Three such factors were identified: parent accuracy about the child’s type 1 diabetes risk, parent beliefs that something can be done to reduce the child’s risk, and study staff consistency. However, staff consistency was important only for European parents.