A Conceptual Model of Angelman Syndrome and Review of Relevant Clinical Outcomes Assessments (COAs)

Abstract

Background

Angelman syndrome (AS) is a rare, neurological genetic disorder for which no clinical outcomes assessments (COAs) or conceptual models (CM) have been developed.

Objective

This study aimed to identify symptoms and impacts relevant and important in this patient population and develop a conceptual model of AS, and to evaluate the content validity of selected COA instruments with potential for inclusion in clinical studies of AS to capture treatment benefit.

Methods

For both concept elicitation (CE) and cognitive interviews (CI), caregivers of children, adolescents, and adults with AS and clinicians with AS experience were targeted. For CI, clinicians discussed the Modified Performance-Oriented Mobility Assessment (MPOMA-G) and ProtoKinetics Zeno Walkway™ and caregivers reviewed the Pediatric Evaluation of Disability Inventory Computer Adaptive Test (PEDI-CAT), the Anxiety, Depression and Mood Scale (ADAMS), the Aberrant Behavior Checklist–Community (ABC-C), and the Morning Diary.

Results

Four clinicians and 34 caregivers participated in CE interviews; three clinicians and 36 caregivers participated in CI. A conceptual model, initially informed by literature, was refined based on interview data. Five domains of symptoms, signs, and characteristics of AS were identified: cognitive and executive functioning, social-emotional, emotional-expressive behavior, sensory-compulsive behavior, and physical. Patient impacts were identified in three domains: activities of daily living, school, and social/community. Caregiver impacts were identified in five domains: mental health, physical health, work, home, and social. While all instruments demonstrated the ability to provide relevant data for the AS population, each instrument either contained some items irrelevant to individuals with AS or was missing important concepts based on the interviews. No single instrument covered all relevant domains specific to AS.

Conclusion

Future work should consider the adaptation of existing COAs and the development of a novel AS-specific instrument for use in clinical research to ensure outcomes important to this patient population are captured.

Introduction

Angelman syndrome (AS) is a rare, neurological genetic disorder characterized by developmental delays, learning disabilities, severe speech impairment, and ataxia [1,2,3]. The prevalence of AS, which affects all racial/ethnic groups and both males and females equally, has been estimated to be approximately one in 10,000 to 40,000 people in the general population. However, this figure may be underestimated, as many cases go undiagnosed [3].

As research in AS progresses, it is important to understand the patient experience and the outcomes of greatest relevance and importance to patients and/or their caregivers in the evaluation of new treatments. This patient-centered approach is underscored by the US Food and Drug Administration’s (FDA) Patient-Focused Drug Development (PFDD) initiative, which is designed to ensure that the patient perspective is considered in drug development and evaluation, including the identification of relevant endpoints and the collection of patient-reported or observer-reported information from well defined and reliable clinical outcomes assessments (COAs) to inform decision making [4,5,6]. Clinical study results measured by a well defined and reliable COA in appropriately designed investigations can be used to support a claim in medical product labeling [4].

To date, no AS-specific COA instruments have been developed. Instead, a number of existing COAs developed for pediatric populations or other conditions similar to AS have been used to capture treatment benefit in clinical trials [7,8,9,10,11,12,13,14]. However, these instruments have not been fully evaluated to determine whether they are content valid or fit-for-purpose in AS clinical trials. The lack of disease-specific COAs developed for the AS population can lead to unreliable results in controlled clinical trials that assess treatment effect [15].

There is no prior research that has systematically explored the patient and/or caregiver perspectives of the symptoms and impacts associated with AS, nor has a conceptual model of AS been previously published. A conceptual model of a disease or condition is a useful tool for informing a COA measurement strategy, as it depicts the signs, symptoms, and impacts of the condition and can help identify relevant concepts that could be impacted by treatment and should be measured to capture treatment benefit [16]. The objectives of this study were to identify symptoms and impacts relevant and important in this patient population, develop a conceptual model of AS, and to evaluate the content validity of selected COA instruments that have the potential for inclusion in clinical studies of AS to capture treatment benefit.

Methods

Overview of Methods

Concept elicitation (CE) interviews with clinicians and caregivers of children, adolescents, and adults with AS were conducted, followed by cognitive interviews (CI) to assess a set of five COA instruments. The following COAs were selected based on a previously conducted literature review [17, 18] for potential use with children and adults with AS: the Modified Performance-Oriented Mobility Assessment (MPOMA-G), ProtoKinetics Zeno Walkway™ (Protokinetics, Havertown, PA, USA), the Pediatric Evaluation of Disability Inventory Computer Adaptive Test (PEDI-CAT), the Anxiety, Depression and Mood Scale (ADAMS), and the Aberrant Behavior Checklist–Community (ABC-C). The criteria for instrument selection included frequent use in AS or other mimicking disorders, prior use in a clinical trial, and a high likelihood of mapping to relevant concepts in AS. In addition, a previously unvalidated sleep diary (the Morning Diary) that was developed for a specific trial in AS to capture key concepts on sleep was included in the evaluation [19].

Eligibility Criteria and Recruitment

With a target sample of 36 caregivers for CE and CI, participants were required to be the primary caregiver¹ of a child/adolescent with AS aged 5–17 years, inclusive, or an adult with AS aged 18 years or over, with a molecular confirmation of diagnosis. Caregivers were excluded if the patient was non-ambulatory. Caregivers were recruited through patient advocacy groups (PAGs), utilizing online postings, emails, and social media. Study staff screened all participants via telephone.

Five clinicians were targeted for both CI and CE interviews. Clinicians had to have a doctoral degree with 2 years of clinical experience with AS, or be a physiotherapist, occupational therapist, or physical therapist, or have a Master’s degree in a medical, educational, or psychology-related field with 2 years of experience with AS patients. They also had to consult or treat at least two AS patients in the past 12 months. For CI, preference was given to physicians who were both currently treating patients with AS and had prior experience with the instruments under review.

Study Procedures

Both clinician and caregiver CE interviews were conducted by experienced interviewers via telephone, although caregivers were given the option of a face-to-face interview. Interviews followed a semi-structured interview guide (see Supplemental Appendix in electronic supplementary material [ESM]) and were audio recorded with the participant’s permission. Caregivers also completed a socio-demographic questionnaire. Clinician interviews lasted approximately 60 min, and caregiver interviews lasted approximately 120 min. Clinician participants received $350 USD and caregiver participants were remunerated $150 USD for their time.

For CI, clinicians reviewed the MPOMA-G and the Zeno Walkway™. The MPOMA-G is a clinician-completed measure that provides an overall score on gait based on the clinician’s observation of step length and height, step symmetry, step continuity, trunk sway, and walk stance [20]. The Zeno Walkway™ is an electronic floor mat that captures and analyzes multiple parameters of an individual’s gait [21]. Clinicians received a copy of the MPOMA-G and related training materials prior to the interview. Interviews were conducted via telephone, lasted approximately 90 min, were audio recorded with permission, and followed a semi-structured guide (Supplemental Appendix, see ESM).

Caregivers reviewed four observer-reported outcomes measures (ObsROs): the PEDI-CAT, the ABC-C, the ADAMS, and the Morning Diary. The PEDI-CAT is a computer adaptive test designed for observation of children and young adults through age 21 years [22]. The full PEDI-CAT covers four domains: mobility, daily activities, social cognitive, and responsibility; however, only the mobility and daily activities modules were evaluated in this study, as these domains were more relevant to the cognitive skills of those with AS and most likely to demonstrate treatment benefit among those with AS. The mobility module item bank has 75 items, and the daily activities module item bank has 68 items. Since this is a computer adaptive test, caregivers did not see all items while taking the PEDI-CAT, but they were asked about each item in these two domains during the interview.

The ADAMS is a 28-item questionnaire measuring mood-related behaviors in those with an intellectual disability [23], and the ABC-C consists of 58 items focusing on aberrant behaviors, such as hyperactivity, irritability, lethargy/social withdrawal, stereotypic behavior, and inappropriate speech [24].

The Morning Diary [19] is an electronic sleep diary developed specifically for use with individuals with AS. It has two modules, one for caregivers to complete about the patient and one for caregivers to complete about themselves. Caregivers reviewed screenshots of the electronic diary.

Due to the length of the instruments, caregivers participated in three in-person cognitive interviews, each lasting approximately 90 min. The ABC-C and PEDI-CAT were discussed in separate interviews, and the ADAMS and Morning Diary were discussed in the same interview. The order of administration was altered with each interview. After completing the instrument, the caregiver responded to questions about each item’s ease of completion, meaning, and relevancy. Interviews were audio recorded with permission. Caregivers were remunerated $150 USD for each of the three cognitive interviews. Interviews took place across the United States, with participants having the option to either hold the interviews at home or at a neutral location nearby.

Analysis

Verbatim transcripts were developed from the audio recordings and reviewed by members of the study team to remove any identifying data and correct any transcription errors. For CE, a content and thematic analytic approach was used [25]. MaxQDA, a qualitative analysis software program, was used to help organize the data and code the transcripts [26]. For CE, initial transcripts were coded by each of the participating coders (7 in total) to ensure consistency in the application of codes. Data saturation, the point at which no new concepts emerged from analyzed interview data, was evaluated using a data saturation matrix [27]. For CI, interviews were coded using MaxQDA, with a specific focus on identifying any issues related to clarity, comprehensiveness, or relevance. Demographic information for both phases was summarized using descriptive statistics.

Ethics

The study received approval from a central institutional review board (IRB), Salus IRB (Austin, TX, USA). All participants provided written informed consent prior to being interviewed.

Results

Sample Characteristics

Four clinicians were successfully recruited to participate in CE. Of these four, two also participated in CI. One new clinician was recruited to participate in CI, for a total of three clinicians.

Of the four clinicians completing CE interviews, two specialized in genetics, one was a behavioral psychologist, and one was a psychiatrist who works with both adults and children. The clinicians currently treated an average of 14 patients (range 2–30) with AS, and had treated an average of 65 patients (range 40–100) with AS over the course of their careers. Three clinicians practiced primarily in an academic setting affiliated with a children’s hospital, while one practiced privately and at a children’s hospital.

For CI, two of the clinicians from CE completed interviews. While an expert on AS, one of these clinicians was not an expert on gait, the focus of the instruments under evaluation. One new clinician participated in this phase, a physical therapist (PT) who had no current patients with AS, but had treated 10 over the course of his career. This PT practiced in an academic setting affiliated with a children’s hospital.

A total of 36 caregivers were interviewed for CE; however, two participants were found to lack molecular confirmation based on questionnaire responses (1 child and 1 adolescent) and were removed from the dataset, resulting in a total of 34 caregiver interviews representing three patient age groups (11 children, 11 adolescents, and 12 adults). Patients had a mean (SD) age of 15.7 (7.43) years (range 5–35 years), and the racial/ethnic breakdown was 88.2% White/Caucasian, 2.9% Asian, and 8.8% Hispanic. Patients had a mean (SD) of 12.8 (6.6) years since diagnosis (Table 1). All caregiver participants were female, and the mean (SD) age was 45.8 (10.2) years. More than half the sample (58.9%) had a college degree or higher, and 76.5% were employed full- or part-time (Table 2). Saturation was attained by the 26th interview, supporting the adequacy of the sample.

Table 1 Patient characteristics—concept elicitation

Table 2 Caregiver characteristics—concept elicitation

Thirty-three of the original 34 caregivers also participated in CI. One caregiver did not participate in CI, as the participant’s child was determined to be non-ambulatory during the course of the interview. While technically ineligible, the participant was still able to provide valuable insight on the impacts of AS. As such, it was decided to include this participant’s data in the CE analysis but to replace them for Phase 2 (CI). Three new caregivers, who had previously shown interest in the study, were screened and enrolled in the study for CI only for a total sample of 36 caregivers completing CI (See Table 3 for caregiver characteristics and Table 4 for patient characteristics).

Table 3 Caregiver sample characteristics—cognitive interviews

Table 4 Patient sample characteristics—cognitive interviews

Conceptual Model Development

A preliminary conceptual model was drafted based on the results of a previously conducted literature review [17, 18]. The conceptual model was refined upon completion of the concept elicitation interviews. The final model (Figs. 1, 2, and 3) demonstrates the signs, symptoms and characteristics of AS, as well as impacts on both the patients and the caregivers. Sample quotes illustrating selected concepts from each domain represented in the model are provided in Tables 5 and 6.

Fig. 1

Signs, symptoms, and characteristics of Angelman syndrome

Fig. 2

Patient impacts

Fig. 3

Caregiver impacts

Table 5 Signs, symptoms and characteristics of Angelman syndrome (AS)—sample caregiver quotes

Table 6 Patient and caregiver impacts—sample caregiver quotes

Cognitive and Executive Function

Difficulties and/or disorders related to cognitive and executive functioning are key defining characteristics of AS. These include deficits in intellectual functioning, seizures, short attention span, hyperactivity/restlessness, impulsivity, an impaired recognition of danger, and memory issues. All were discussed in the interviews. Memory issues were included in the preliminary model based on the literature but were not mentioned during the interviews.

Of particular note, seizures (34, 100%), difficulty paying attention (34, 100%), and hyperactivity/restlessness (30, 88%) were reported by the majority of caregivers and clinicians. A number of caregivers (13, 38%) described an improvement in their child’s seizures with increasing age, with none reporting that seizures had worsened. However, a few noted that the seizures changed in other ways, such as seizure type or trigger(s). The improvement of seizures over the lifespan was corroborated by the clinicians, who all reported that seizures tended to be more severe in childhood and improved in adolescence or adulthood. Caregivers, as well as one of the clinicians, also noted improvement in attention and hyperactivity/restlessness with age.

Social-Emotional

The social-emotional domain describes the patient in relation to his/her interactions with others and related emotions. These include communication difficulties, anxiety, being overly friendly with strangers, gregariousness and a happy demeanor, as well as lacking social inhibitions/being socially inappropriate, being easily excitable, resistance to/difficulty with change, and frustration.

Communication difficulties were especially important and were discussed by all caregivers and clinicians during CE. Most caregivers described their child as ‘non-verbal,’ though some reported use of limited verbal language. Communication might improve over time in the form of increased number of signs, gestures or word approximations, but patients, in general, remained non-verbal across the lifespan. Communication difficulties could lead to frustration for both patient and caregiver, as well as behavioral problems due to the patient’s inability to express wants or needs.

Patients with AS were noted to be happy and social, with a tendency towards over-friendly behavior with strangers. Most caregivers (32, 94%) also reported that their child was easily excitable. There was variability in whether or not excitability changed over the lifespan, and some noted a close relationship to anxiety.

Anxiety was reported by most caregivers (27, 79%) and all of the clinicians. Of the 27 patients with anxiety, nine were adults, eight were children, and ten were adolescents. Caregivers perceived anxiety in their child through his/her actions, body language, and vocalizations. Anxiety could be triggered by crowds, new environments, poor sleep, and/or meeting new people.

Emotional-Expressive Behavior

Emotional-expressive behaviors were noted in the qualitative interviews and include behaviors that individuals with AS might use as a means to communicate or express themselves. All caregivers reported that their child, either previously or currently, exhibits some form of the following behaviors: aggressive behavior (26, 76%), inappropriate laughing (26, 76%), acting in an uncooperative/stubborn/demanding way (14, 41%), destructive behavior (11, 32%), and yelling (10, 29%). Included in the definition of aggressive behaviors were hitting (15, 44%), hair pulling (14, 41%), pinching (10, 29%) and general aggressiveness (9, 26%). Caregivers commonly reported that these behaviors were instrumental and goal-driven. All four clinicians also discussed behavioral issues as a characteristic of AS, with two clinicians particularly noting the resulting family impact.

Caregivers offered a variety of tactics for managing emotional-expressive behaviors, including going outside, separating from the situation, giving the individual a break, and taking the patient to a quiet place. Only one caregiver described the behaviors as only a concern of the past. Changes in behaviors over time were highly variable. Six caregivers reported neither a positive nor negative change, eight reported improvement with increasing age, and ten reported worsening over time. Eight of the ten caregivers reporting worsening behavior over time are caregivers of children or teens rather than adults.

Sensory-Compulsive Behavior

Sensory-compulsive behaviors include water fascination, fascination with paper or other crinkly objects, stereotyped behavior, compulsions, abnormal food behaviors, and mouthing/chewing inedible objects. Rituals was included in the preliminary model but not reported during CE. Of all of the reported sensory-compulsive behaviors, the most frequently reported were water fascination (29, 85%) and obsession with food (14, 41%). Water fascination was described as loving to swim and take baths, enjoying moving water, and/or bubbles. Among those who reported a change over time, caregivers of children and adults most commonly reported a decrease, whereas caregivers of teens reported no change.

None of the caregivers reporting on an obsession with food noted improvement over time. Three caregivers reported a worsening over time, and the others reported no change.

Physical

The physical domain includes problems with mobility, difficulty with fine and gross motor skills, eating problems, reflux, constipation, and sleep problems, among others. Ear infections, gagging (not related to eating), and reflux were not included in the preliminary model and were added based on clinician and/or caregiver interviews, while physical impacts of laughing were not noted during interviews but included in the preliminary model.

The majority of caregivers (33, 97%) and all clinicians reported problems with mobility. Common themes included balance-related problems, difficulty with gait, ataxia, the need for assistance or assistive devices, and problems with stairs. Muscular issues were noted to be age-specific, such as hypotonia in young children followed by hypertonia, spasticity and possibly contracture as they age.

The majority of caregivers (27, 79%) reported sleep problems, such as difficulty falling and staying asleep, need for less sleep, and not being able to sleep alone, among others. All clinicians also reported sleep problems as a common characteristic of AS. Many caregivers reported that the patient took and benefited from sleep aids, such as melatonin and trazodone. Fifteen caregivers, and three of the clinicians, reported that sleep problems improved with increasing age. Nine (75%) caregivers of adults reported sleep problems versus 10 caregivers of adolescents (91%) and eight caregivers of children (73%).

Patient Impacts

Individuals with AS experience multiple impacts on activities of daily living, school, and social and community-related interactions. In general, individuals with AS lack independence and must rely on their caregivers for assistance to complete all of the basic activities of daily living. This need for total assistance continues across the lifespan.

Individuals with AS also experience challenges in school, due to absenteeism for health and sometimes behavior-related issues, and general challenges in learning and focusing, due to a short attention span and having cognitive deficits. They also can experience difficulties in participating in school functions, such as field trips or other group activities.

Patients are very impacted socially, despite their desire to interact with others, as their behaviors, such as the hair-pulling and hitting, can drive others away, impacting relationships inside and outside the home. Drooling, for example, can also create a social barrier. Physical challenges associated with walking or heat sensitivity can make it difficult to keep up with others, participate in play, or get around in the community.

Caregiver Impacts

The mental and physical health, work, home and social lives of caregivers are also impacted. The need to constantly be on alert causes stress, worry and anxiety, frustration, and fear. Caregivers also experience physical health issues, such as back pain from lifting or assisting their child and bruising, scratching and other injuries from aggressive behaviors. Sleep deprivation and exhaustion were frequently noted due to their child’s sleep problems.

Caregivers are also impacted at work, with some changing jobs or careers, working from home, decreasing hours, or leaving the workforce entirely. Those who continue to work face issues with absenteeism and productivity.

Caregivers have difficulty completing tasks around the home, such as chores and errands. Life often revolves around the individual with AS, impacting decisions on family activities and causing challenges in caring for other children. It can also be a challenge ensuring the child doesn’t destroy or damage the home due to their behaviors.

Caregivers also report difficulty with friendships, intimate relationships, and family relationships. They feel isolated and at times unsupported by others and have difficulty participating in social activities and planning and taking vacations.

Cognitive Interviews

MPOMA-G

In general, all three clinicians who participated in CI correctly interpreted the items and response options of the MPOMA-G, but there were a few issues noted with regard to item interpretation. Specifically, issues related to the items on step symmetry, step continuity, and trunk sway and their associated response options. Further clarification as to what should be considered when answering these questions was needed. Some of the clinicians felt that the MPOMA-G might be difficult to answer based on the age of the patient and their ability and/or motivation to walk. For instance, it may be difficult to use if a child or adult could only take a few steps. One clinician noted it may be easier if the scoring was done using a video recording of the patient walking instead of in person.

Overall, most items of the MPOMA-G were rated as highly relevant for use in AS by at least two out of three clinicians. As noted previously, one clinician, while an expert on AS, was not an expert on gait. This particular clinician rated some items as only moderately relevant for children with AS and suggested consideration be given to whether or not an individual is just learning to walk. Specifically, this included the right and left swing foot and the right and left foot clearance items.

Two of the three clinicians provided lower relevancy ratings for the step symmetry item for children with AS, and one also provided a lower rating for the adults. One clinician had a concern for consistency in his/her measurements, both with regard to adults and children with AS.

One clinician rated step continuity less relevant for both children and adults with AS, as he/she felt it was less studied and a more difficult concept to understand. All clinicians rated the trunk sway item as highly relevant for both children and adults with AS. One clinician rated walk stance as moderately relevant for both children and adults with AS. See Table 7 for sample quotes.

Table 7 Cognitive interviews—sample clinician quotes

Zeno Walkway™

One clinician reported that the Zeno Walkway™ was very relevant for individuals with AS and was a tool that could provide measurement in several key areas, such as gait speed, base of support, and angle of toe out. Another clinician noted that one benefit of the Zeno Walkway™ was that it was more objective than the MPOMA-G, but that it did not capture everything that might be important to measure, such as step symmetry and step continuity. See Table 7 for sample quotes.

PEDI-CAT

Most participants found the PEDI-CAT to be easy to understand and answer and relevant to AS. Some items required further clarification. For example, a few caregivers noted difficulty answering DA083 (using a TV remote) and DA098 (using a keypad) because they were not sure if they should be thinking about intention or just physical ability. See Table 8 for sample quotes.

Table 8 Cognitive interviews—sample caregiver quotes

Participants interpreted relevancy differently. Items received lower ratings if the patient had already mastered the skill, was unable to perform the activity, was not allowed to perform the task for safety concerns, and/or if the skill was viewed as less important. The majority of participants found the items highly relevant, as they relate to activities necessary for independence.

ABC-C

The ABC-C was generally found to be easy to understand and complete. Item relevancy varied, but the majority of items (33 out of 58 items) were rated as highly relevant by at least 42% of caregivers. All items were rated as highly relevant by at least two caregivers (2, 6%). Some items (e.g., Item 9. ‘Talks excessively’) were considered less relevant due to the mostly non-verbal nature of this population. These items need further clarification to note whether body gestures or vocalizations should be considered when responding. See Table 8 for sample quotes.

Items related to activity levels were also problematic for some. Questions on underactivity were less relevant for children with AS, who tend to be more hyperactive, while the hyperactivity items were less relevant for some teens and adults, who had outgrown hyperactivity. Items on isolation or lack of interest in social interactions were also reported to be less relevant.

ADAMS

Overall, caregivers found the ADAMS instructions and response scale to be clear and easy to understand and complete. However, some items were interpreted inconsistently, such as Item 1. ‘Nervous,’ Item 7. ‘Tense,’ Item 10. ‘Sad,’ and Item 23. ‘Listless.’

Relevancy ratings varied considerably, with more caregivers giving ratings of ‘not at all relevant’ than ‘extremely relevant.’ For instance, Item 5. ‘Sleeps more than normal’ was problematic. While sleep was considered important, oversleeping was not a concern. Items relating to communication were also problematic. See Table 8 for sample quotes.

Morning Diary

The Morning Diary was found to be highly relevant for use with children and adults with AS. A majority of caregivers found that the questions in the four primary groups of items—night waking, disruptive behavior, subject coming out of the bedroom, and caregiver sleeping with subject—to be highly relevant. However, the instrument’s wording and dual diary structure, with some questions designed to capture the caregiver’s experience and some to capture the patient’s experience, caused confusion, demonstrating a need for the instrument to be further refined. For example, on the question in the caregiver diary on night waking, some caregivers were unsure as to what should be considered. See Table 8 for sample quotes. Some caregivers also expressed concern about their ability to answer some of the questions, particularly if they were not awake or physically present to observe their child.

Discussion

This is the first study to conduct in-depth, qualitative interviews with caregivers of children, adolescents, and adults with AS. Patient, caregiver, and clinician insights play an important role in the drug development process and can inform the appropriate and relevant selection of endpoints in clinical trials [5, 6]. This insight provides a deep understanding of the impacts of AS on patients and their caregivers. As such, the findings of this study are instrumental in providing guidance in identifying the concepts that are most important to patients and caregivers. Researchers can then be sure these important concepts are being captured and appropriately measured in the context of a clinical trial. The insight provided in this study informed the development of the first conceptual model of AS.

This study also highlights patient-relevant and potentially appropriate measures that could be used in AS clinical trials. The identified measures meet some, if not all, of FDA guidance for COA assessments in related diseases, but have not been previously evaluated for content validity specifically for use in children and adults with AS.

While the instruments each covered relevant concepts for AS, particularly those related to mobility, fine and gross motor skills, sleep, and behavior-related issues, not one instrument covered all domains or was completely ready for use without adaptation in order to be fully applicable to an adult or child with AS, particularly to account for the mostly non-verbal population, as items related to speech and verbal communication are not relevant, and non-observable symptoms are difficult for a caregiver to assess. Furthermore, as individuals with AS age, the characteristics and impacts of AS also may change; therefore, developing separate instruments for children and adults is important. Additionally, areas that are not well covered by any of the measures are the more distal impacts of AS, such as school, relationships, and social interactions. Those with AS seek out social interaction, but their difficulty communicating and aggressive behaviors hinder their ability to socialize with their peers and others in the community. Similarly, the measures do not address the substantial impact that caring for a child with AS has on the caregiver and family overall. Caregivers experience fatigue and other physical impairments related to the demands of providing full-time care for their children through adulthood. Caregiving also can affect spousal and family relationships and make engaging in social activities and maintaining friendships more challenging. The need to provide constant care takes an emotional toll on caregivers, causing stress, worry, frustration, and fear [28].

It is important to note a few study limitations. Caregiver selection was limited to those who responded to study advertisements via two patient advocacy groups and may not be representative of all caregivers of an individual with AS. Additionally, for the clinician CI, due to the rare nature of AS, it was difficult to identify and enroll clinicians who had expertise in AS and gait. Therefore, participants with expertise in AS were enrolled, even if they were not gait experts. Also, this study focused on ambulatory patients with AS, so results may not apply to those who are non-ambulatory.

Conclusion

AS is a condition that affects individuals in a number of domains (e.g., behavior, motor and communication ability, and sleep) and their overall ability to be independent. All six instruments demonstrated that each could provide important and useful information relevant to the AS population; however, each instrument is problematic in that it either contains items found not to be relevant to individuals with AS or is missing concepts found to be important based on the interviews. Moreover, no single instrument covers all relevant domains specific to AS. Therefore, there is supportive evidence that future work should consider the adaptation of existing COAs and the development of a novel Angelman-specific instrument that could be implemented in clinical research to ensure that outcomes important to patients and caregivers are considered as part of the benefit and risk assessment of new treatments.

Data Availability

The qualitative interview data generated during and/or analyzed during the current study are proprietary and not publicly available but may be available from the corresponding author on reasonable request.