Background

The measurement of health-related quality of life (HRQL) is increasingly becoming part of the overall assessment of a patient's health both in the clinical and the research setting, as it provides a more complete picture of the health of the patient. Measuring HRQL includes assessing the patient's perceptions of their physical, emotional and social health and function that can supplement clinical information on their health status.

It is now widely endorsed that children as far as possible should rate their own HRQL [1, 2]. However, there is some suggestion that children may not be able to provide accurate and reliable assessments of their HRQL [3] and that this may be due to problems understanding the questions, lack of understanding of the disease itself or time perception differences [4]. Assessment of HRQL in children may also be compromised by their age and development and by their ability to complete lengthy questionnaires [5].

There are conflicting views regarding the benefits of using proxies for measuring HRQL. There is some doubt as to whether proxy reports provide an accurate reflection of the child's HRQL [3, 68]. Patient and proxy reports may differ because of the lack of parallel content in the instruments used [9]. Some studies have highlighted limited concordance between child and parent reports [912] whilst others have reported more complementary information from children and their parents [7, 13]. What is important about proxy ratings is understanding when parents are able to provide useful information. This is more likely to be in relation to impact of HRQL on the family, sibling relationships and to a lesser extent school progress [14]. Parents' knowledge of their child is likely to be more limited in relation to activities or relationships that exist outside home and with respect to internal feeling states [9, 10, 12]. Parents also have a role to play when a child is too young or ill to provide a HRQL assessment. It has been suggested that consistent parent-proxy reports may prove to be more reliable and valid in longitudinal HRQL and long-term outcome investigations than their children's own reports alone because of the rapid changes in children's attitudes, abilities, and priorities as part of the normal developmental process [15]. The solution is to regard both child and parental assessment as valid and contributing to the total picture regarding the child's HRQL [14].

When measuring the HRQL of children it may be necessary or desirable to obtain reports from their parents [10]. Clinicians often look to parents for guidance regarding their child's HRQL as they play an important role in medical decision making [16]. It is important that the clinician is confident in a parent's evaluation of their child's HRQL. If a child is unable to provide HRQL judgements, drawing on alternate sources of information regarding a patient's HRQL may be a useful source of information provided that additional information is available to support the validity of the proxy ratings [16]. Even when a child's responses are available, the perspective of the parent has an important bearing on health care decisions with respect to the child. For these reasons, parallel reporting is increasingly recommended in studies involving the assessment of health outcomes in child populations with analogous questionnaires for children and their parents being developed [10].

In spite of this, may measures of child HRQL do not include parallel parent versions [17, 18]. For this reason, we report the development and validation of a parent version of the Minneapolis-Manchester Quality of Life Instrument (MMQL-UK (PF)) that could be used in parallel with the child version to assess the HRQL of children with chronic conditions, those in public care and their healthy peers.

Methods

Study questionnaires

Minneapolis-Manchester Quality of Life Instrument (MMQL)

This questionnaire was originally developed in the US for use with child cancer survivors [19]. The original version of the MMQL had three different forms, one for children aged 8–11 (Child form, MMQL-CF), one for 12–18 year olds (Youth Form, MMQL-YF) and one for young people aged 19–25 years. All the original child MMQL forms measured the components of physical functioning, psychological functioning, social functioning, cognitive functioning, body image and outlook on life. Intimate relations was an additional component in the questionnaires for 12–18 and 19–25 year olds. No parent form is available for the original MMQL forms. The anglicised MMQL-UK (CF) version of the questionnaires (based on the 12–18 year age group) was used as the basis for the development of the parent form (MMQL-UK (PF)). This measured the components of physical appearance, school functioning, social functioning, emotional functioning and physical functioning [20].

PedsQL™ version 4.0 core module

PedsQL™ measurement system is a modular approach to measuring HRQL in children and adolescents and their parents which is rapidly becoming established in the US and Europe [21, 22]. Anglicised versions are also available [13]. It consists of a brief, practical generic core module, which is complemented by a number of condition specific measures. Reliability and validity of the generic core module has been demonstrated [22]. PedsQL™ measures the components of physical functioning, emotional functioning, social functioning and school functioning. Parents or carers were asked to complete this core module as part of the validation of the newly developed parent MMQL-UK.

Study population

This study was carried out in the context of a wider study to anglicise and shorten the Manchester-Minneapolis Quality of Life Survey for children (MMQL-UK (CF))[20]. The MMQL-UK (CF) was used as the basis for the development of an adult form (MMQL-UK (PF)).

Before wider administration of the MMQL-UK (PF) could take place, the phrasing of the questions from the child form had to be modified to make them adult oriented. This was done by qualitative methods. An opportunistic sample of 15 parents of school children (age range 10–18) were recruited for interviews from a local school known to one of the researchers (PU) for development of the MMQL-UK (PF). During the interviews parents were asked to comment on the wording and structure of the questionnaire as well as completing a draft parent form. Interviews were carried out either at the home or at Swansea University, depending on the preference of the parent.

The newly developed MMQL-UK (PF) was then compared with the shortened and anglicised version of the MMQL-UK (CF). This paper concentrates specifically on the validation of the MMQL-UK (PF) and comparison with the child (CF) version. The Anglicisation and validation of the MMQL-UK (CF) is reported elsewhere [20]. Although the original MMQL form was developed to measure HRQL in cancer survivors the anglicised MMQL-UK (CF) was developed for use with both healthy and chronic conditions. The MMQL-UK (PF) was therefore developed to be suitable for the same populations (i.e. healthy and chronic conditions).

Children and their parents or carers who met the inclusion criteria (see Table 1) were approached to take part in the study comparing the child and parent MMQL. Four chronic conditions (asthma, diabetes, chronic inflammatory bowel disease (IBD) and allogenic bone marrow transplant (BMT) following acute lymphoblastic leukaemia (ALL)) were chosen as exemplars for the study. In addition 'looked after' children in public care were recruited as a fifth exemplar. These groups were chosen to ensure a cross section of conditions varying in chronicity and degree of self-care involved and for their diverse impact on the different domains of childhood HRQL. Children with a chronic health problem were identified with the guidance of collaborating clinicians. Children in public care were identified through looked after assessments.

Table 1 Inclusion criteria for children and parents entering the study

Where possible, written information was sent out to the families of children with a chronic health condition one week before a routine outpatient appointment. On attendance at the clinic, a researcher provided a further verbal explanation of the study, took written consent and supervised completion of the questionnaires. Families of children not due in clinic during the data collection period were sent written information along with a reply form on which they could indicate their interest in the study. Telephone contact was made with families responding positively, to provide further verbal feedback about the study. Arrangements were made for families agreeing to take part to complete the questionnaire either in clinic or at home. Children in public care and their carers were provided with verbal and written information when attending paediatric assessments. If families expressed an interest in the study, arrangements were made for a home visit, where the interviewer gained informed consent and questionnaires were completed.

Participants for the control group were recruited from schools in Swansea, Neath, Port Talbot and Bridgend (Wales, UK). The control group were healthy children (and their parents) who were not currently using health care resources for any serious condition. Participants were given a screening questionnaire prior to participation that included a section about health status. Anyone who was identified as having a health problem was excluded from participation in the study. Permission to approach schools was obtained from the Directors of Education in each Local Education Authority, before selecting schools via multi-stage sampling. Information was sent to head teachers of sampled schools, inviting their school to participate. A researcher visited schools expressing an interest, to discuss the project further and arrange for data collection. Written information for parents, parental consent forms and parent questionnaires were supplied for each child to take home. Parents were asked to complete their questionnaires at home and return them to school by a specified date, along with consent for their child to complete the questionnaires. It was emphasised that completion of questionnaires should not involve consultation with the child. For those children that had parental consent, re-explanation and completion of questionnaires followed in class a week later, under the supervision of the researcher.

In both subject and control groups, children with moderate to severe learning difficulties and children and parents for whom English was not their first language were excluded from the study.

The study was approved by the Welsh Multi-centre Research Ethics Committee (MREC). Informed consent was sought from all children (subjects and controls) and their parents or those with parental responsibilities (for children less than 16 years of age), following oral and written explanation of the study.

Analysis

Data were analysed using the Statistical Package for Social Sciences (SPSS) version 11.4.

Assessing internal consistency

The internal consistency of the MMQL-UK (PF) components were assessed by item-total correlations and Cronbach's alpha [23]. Questions yielding item-total correlations below 0.4 were considered for rejection [24]. Questions were also considered for rejection if more than 75% of individuals gave the same response, because such questions are not sensitive enough to discriminate between different levels of severity [24]. Questions were also considered for exclusion if they were disliked or considered difficult to answer by the parents completing them. Cronbach's alpha for each of the resulting components should exceed 0.7 [25]. Principal components analysis was then performed on the parent content without any restrictions on the data and the structure was compared to the emergent structure from the child form. This was carried out in order to validate the underlying components of the MMQL-UK (PF).

Assessing validity

The construct validity of the MMQL-UK (PF) components were assessed by comparing them with the appropriate parent PedsQL™ quality of life scales. If the components were valid measures of HRQL, they would be expected to show significant small to moderate levels of correlation with each of the PedsQL™ scales, with the largest correlations being seen between the PedsQL™ scales measuring physical, social, emotional and school function and the comparable MMQL-UK (PF) components.

The discriminant validity of the MMQL-UK (PF) was assessed by comparison of component scores between parents whose children were being treated and the parents of the control group. Our a priori hypothesis was based on identifying moderate to large differences in effect size between each exemplar and the control group [26]. If the components were valid measures of HRQL, the exemplar groups would be expected to score lower on the MMQL-UK (PF) components than the control group. Independent samples t-tests with Bonferroni corrections were used to compare control and exemplar groups. Differences in component score between the exemplars and control groups were also reported as effect sizes where 0.2–0.49 represented a small difference, 0.5–0.79 represented a moderate difference and greater than 0.8 represented a large difference [26].

The relationship between the MMQL-UK (CF) and MMQL-UK (PF) was determined using Pearson's correlation. If the two reports measure the same concept, then moderate correlation would be expected between the component scores of the MMQL-UK (CF) and the MMQL-UK (PF).

Assessing reproducibility

Following initial completion of the MMQL-UK (PF) by parents of the exemplar group children, they were asked to complete a second 'retest' questionnaire the next time their child visited clinic. This was a maximum of three months after the first assessment. In addition to completing the MMQL-UK (PF), the parents of children were asked to rate whether they thought their child's health had changed (improved, got worse or stayed the same) since the first questionnaire was completed. Those parents reporting no change were included in the reproducibility analysis. Reproducibility was assessed using intra-class correlation co-efficient [27].

Assessing responsiveness

The responsiveness of the MMQL-UK (PF) was assessed by using the scores of the exemplar group parents who reported a change in their child's health. The response ratio (mean change in scores for subjects reporting a change divided by the standard deviation of the subjects reporting no change) was used to quantify the responsiveness [27]. The larger the ratio, the more responsive the instrument.

Results

In order to have a parallel proxy report, question selection for the parent form replicated that for the child form. A total of 29 questions were selected for the anglicised and shortened MMQL-UK (CF) and MMQL-UK (PF) with five proposed components: physical appearance, school functioning, social functioning, emotional functioning and physical functioning.

  1. 874

    children and 572 parents completed the MMQL-UK (CF) and MMQL-UK (PF). The internal consistency of the MMQL-UK (PF) was excellent, with all components exceeding the accepted criterion of 0.70 (see Table 2)

Table 2 Internal consistency of the MMQL-UK (PF) component

The construct validity of the MMQL-UK (PF) was good, with significant correlations being evident between the MMQL-UK (PF) and the proxy PedsQL™ on those scales measuring similar constructs, i.e physical functioning, emotional functioning, social functioning and school functioning (see Table 3).

Table 3 Correlations between the MMQL-UK (PF) and the PedsQL™ proxy-report components

Table 4 illustrates significant differences between the mean component scores for the parents of control and exemplar groups. All exemplar proxies reported lower HRQL for physical functioning than controls. Proxy physical appearance scores were significantly lower for the diabetes, cancer and IBD groups compared with controls and proxy emotional functioning reported by parents was lower for all children with a chronic health problem when compared with controls. Proxy school functioning scores were significantly lower compared with controls for the cancer group and those in public care and proxy social functioning was significantly lower for the cancer group and those in public care than for controls.

Table 4 Mean scores (Standard Deviation) for the MMQL-UK (PF) components for the different patient groups and controls

Intra-class correlations ranged from 0.65–0.91 for the MMQL-UK (PF) components demonstrating good reproducibility for the questionnaire (see Table 5)

Table 5 Reproducibility of the MMQL-UK (PF) components for parents reporting no change in their child's health status (N = 50)

Weak to moderate levels of responsiveness were demonstrated for all components except social functioning, with ratios for emotional and physical functioning reaching significance. The negative ratio for social functioning however, suggested that reported changes in HRQL were in the opposite direction to changes in health status (see Table 6)

Table 6 Responsiveness of the MMQL-UK (PF) components for parents reporting an improvement or deterioration in their child's health status

Table 7 illustrates the correlations between the MMQL-UK (CF) and the MMQL-UK (PF) for all the controls and exemplar groups. The individual exemplar groups were examined in addition to the whole group to determine if the correlation patterns were similar. We were particularly interested in the looked after children group as the proxy form was completed by the carer as opposed to the parents as in the other exemplar groups. All the groups showed similar correlations and as such the data were analysed as one group. Statistically significant moderate to good correlations were seen for all five components between the MMQL-UK (CF) and the MMQL-UK (PF).

Table 7 Correlations between the MMQL-UK (CF) and MMQL-UK (PF)

Discussion

A parent version of the MMQL (MMQL-UK (PF)) was successfully developed based on the anglicised and shortened child version which has been recently validated in the UK (MMQL-UK (CF))[20]. The parent version was developed in parallel with the child version with only minor modifications being made to the wording of the questions.

Good internal reliability was found for the MMQL-UK (PF), with alphas exceeding 0.70 for all the components, thus making them acceptable for group comparisons [25]. Construct validity of the MMQL-UK (PF) was established through moderate correlations with the parent PedsQL™ core module.

Discriminant validity was demonstrated for the MMQL-UK (PF) proxy report with differences being noted in HRQL by parents of healthy children and children with chronic health conditions and carers of children in local authority care. The reproducibility and responsiveness of the MMQL-UK (PF) were indicated by good test-retest results. The relationship between the MMQL-UK (CF) and MMQL-UK (PF) was confirmed by moderate correlations indicating that the two reports measure the same concept.

The availability of a proxy report is important as there may be occasions when a child is either unable or unwilling to complete a HRQL measure. However interpretation of proxy reports should be undertaken with caution as they may not accurately reflect the child's view, particularly for some components. However if they are used in conjunction with a clinical consultation or other objective assessments they could potentially provide useful information on the health of the child [16].

It should be recognised that both child and proxy ratings have value but the question is to clarify how differences in perception of HRQL arise between the child and the proxy [5]. It has been contested that disagreement is not necessarily undesirable and multiple viewpoints can be valid and informative [28]. Caregivers may recognize functional limitations that patients are unaware of or deny. Arguably, assessments of HRQL that are used to inform decision making in health care based on community-based preferences need not be restricted to the patient perspective [29].

It is recommended that parent proxy reports be available for child HRQL measures, a condition that the PedsQL™ also fulfils. The availability of proxy-reports in addition to child reports may be more desirable than reports from the child alone. In medical consultations, the clinicians often look to the parents for guidance regarding medical decision making in relation to their children [16]. The parent view of their child's HRQL can be informative and provide an alternative viewpoint [28].

Further studies are needed to determine the accuracy of the MMQL-UK (PF) proxy reports compared with the MMQL-UK (CF) child reports in other conditions and different age groups of children. The usefulness of the MMQL-UK (PF) in assessing longitudinal outcomes of children also warrants further attention.

Conclusion

This study established the reliability and validity of a new MMQL proxy report (MMQL-UK (PF)). The MMQL-UK (PF) showed good correlations with the child form (MMQL-UK (CF)) in healthy children, those in public care and those suffering from chronic conditions.