Parental compliance - an emerging problem in Liverpool community child health surveys 1991-2006
- First Online:
- Cite this article as:
- Koshy, G. & Brabin, B.J. BMC Med Res Methodol (2012) 12: 53. doi:10.1186/1471-2288-12-53
- 2.2k Views
Compliance is a critical issue for parental questionnaires in school based epidemiological surveys and high compliance is difficult to achieve. The objective of this study was to determine trends and factors associated with parental questionnaire compliance during respiratory health surveys of school children in Merseyside between 1991 and 2006.
Four cross-sectional respiratory health surveys employing a core questionnaire and methodology were conducted in 1991, 1993, 1998 and 2006 among 5-11 year old children in the same 10 schools in Bootle and 5 schools in Wallasey, Merseyside. Parental compliance fell sequentially in consecutive surveys. This analysis aimed to determine the association of questionnaire compliance with variation in response rates to specific questions across surveys, and the demographic profiles for parents of children attending participant schools.
Parental questionnaire compliance was 92% (1872/2035) in 1991, 87.4% (3746/4288) in 1993, 78.1% (1964/2514) in 1998 and 30.3% (1074/3540) in 2006. The trend to lower compliance in later surveys was consistent across all surveyed schools. Townsend score estimations of socio-economic status did not differ between schools with high or low questionnaire compliance and were comparable across the four surveys with only small differences between responders and non-responders to specific core questions. Respiratory symptom questions were mostly well answered with fewer than 15% of non-responders across all surveys. There were significant differences between mean child age, maternal and paternal smoking prevalence, and maternal employment between the four surveys (all p<0.01). Out-migration did not differ between surveys (p=0.256) with three quarters of parents resident for at least 3 years in the survey areas.
Methodological differences or changes in socio-economic status of respondents between surveys were unlikely to explain compliance differences. Changes in maternal employment patterns may have been contributory. This analysis demonstrates a major shift in community parental questionnaire compliance over a 15 year period to 2006. Parental questionnaire compliance must be factored into survey designs and methodologies.
Compliance is critical for representativeness for school based epidemiological surveys and it is becoming increasingly difficult to achieve high compliance in these surveys in urban areas in industrialised settings. Several sequential school based surveys were carried out in Merseyside between 1991 and 2006. This provided an opportunity to assess participant questionnaire compliance in the same school populations over a prolonged period. In the early 1990’s the dock area of Liverpool had substantial coal dust pollution following importation of steam coal from South America. The first Respiratory Health Survey was completed in 1991, amongst school children aged 5-11 years and achieved a parental compliance for questionnaire completion of 92%. Analysis of this data showed a spatial association of childhood asthma symptoms which was associated with the concentrations of airborne dust pollution on contour maps [1, 2]. As a consequence a total of three further cross-sectional surveys were undertaken in the same primary schools in 1993, 1998, and 2006, using essentially the same parental questionnaire and survey methodology . These studies had focussed on childhood health outcomes in relation to pregnancy smoking, residential location, socio-economic status and factors related to asthma, obesity and Attention Deficit Hyperactivity Disorder (ADHD) [4–14].
The surveys provide a unique opportunity to assess parental participant compliance in the same survey schools over a 15 year period. Decline in response rates to general population surveys have been demonstrated over recent decades , and with even steeper declines seen over recent years [16,17,18,19]. Insight into participant characteristics which modify such study participation is essential in order to facilitate improving questionnaire response rates, as well as for establishing the validity of survey findings.
Parental compliance fell sequentially in the consecutive Merseyside surveys over the fifteen year period, and the present analysis aimed to describe how response rates to specific questions varied over time and how they related to socioeconomic status and demographic characteristics of parents of children attending these primary schools.
Merseyside Respiratory Health Surveys
The Merseyside Respiratory Health Surveys were first undertaken in 1991 because of the effects of airborne dust pollution on asthma risk among children attending primary schools and living around the Sefton Dock area [1, 4]. The Liverpool docks were well known as a route for importation of a range of commodities and steam importation and handling of coal started on a large scale during the period from 1980 to 1990. These dock activities resulted in air pollution from black dust which affected people living in and around the dock area. Children attending primary schools adjacent to the Bootle dock area of Merseyside were first reported by school teachers in 1990 and 1991 to be experiencing frequent asthma episodes which required inhaler use. To investigate these complaints and determine the prevalence of respiratory morbidity in primary school children in the area exposed to airborne dust, a Steering Committee was established under the auspices of Sefton Health Authority. This lead to the completion of a Respiratory Health Survey in 1991, in school children aged 5-11 years. The main objective was to determine whether the school children in a specific locality, exposed to airborne coal dust pollution had an excess of respiratory symptoms compared to school children of the same age from non - dust exposed areas of Merseyside of comparable socio-economic status (Wallasey). A link with airborne dust pollution was demonstrated [2, 16] and as a consequence further sequential surveys were planned in the same primary schools to assess the health trends in children, and to monitor the effects of proposed environmental interventions through community surveillance. As a consequence of these activities, the changes in parent-reported childhood asthma prevalence in Merseyside have been assessed in consecutive cross-sectional surveys undertaken in 1991, 1993, 1998 and 2006. The 1993 survey aimed to determine environmental and host risk factors for respiratory symptoms and to monitor asthma over a two year period [1, 2]. The 1998 survey involved on-going monitoring of respiratory symptom prevalence [3, 7, 14]. The 2006 survey was conducted to establish if the increasing prevalence of childhood asthma had plateaued, as well as to determine the prevalence of obesity and other child health outcomes in relation to pregnancy smoking [3, 5–7, 11, 13, 14].
Children (5-11 years) attending these schools were invited to take part in the study following a letter to parents requesting written informed consent. Parents were required to complete a questionnaire and give permission to measure their child’s height and weight. The sampling frame for each of the four surveys was:-1991(alternate children in school class registers) and for 1993, 1998 and 2006 (all children on the school class registers). In 2006 one primary school surveyed between 1991 and 1998 had since closed and this was replaced with a school in the same geographical locality as the school which had closed (less than 0.5Km). Schools comprised almost wholly Caucasian pupil populations and this composition had changed little during the survey periods .
Parental questionnaire and data collection procedure
Parents received questionnaires through their child’s school teacher with an information letter and written consent form, and a supporting letter from the school’s headmaster. Class registers were used to identify children. Forms were taken home by individual children and teachers requested children to return envelopes containing the questionnaire within one week.
The original questionnaire was a modified version of one designed and used by Clifford et al . The questionnaire was further modified in 1998 and 2006 to include core questions related to the ISAAC protocol (International Study of Asthma and Allergy in Childhood)  which ensured comparable diagnostic information on the epidemiology of asthma and across surveys.
For doctor diagnosed asthma status the question asked was ‘Has your child ever been diagnosed by a doctor as having asthma or bronchial asthma?’ Information regarding birth weight, maternal risk factors including smoking history during pregnancy, and respiratory problems were collected. The same questionnaire was used and the core questions were similar for all surveys with slight modifications in the 1998 and 2006 surveys, in which additional questions on parental smoking practices and maternal alcohol consumption were included. Envelopes with questionnaires for absent children were forwarded to parents, if the child re-attended within the period of each school survey (two weeks). Class lists were made available by head teachers to enable compliance to be calculated. A single reminder letter was sent for unreturned questionnaires.
For anthropometric measurements, children were asked to remove their shoes and heavy garments. Height was measured to the nearest millimetre using a Minimeter scale, which was placed against a vertical surface in the school building. Height was measured with the child standing erect, and measured by the same observer for all children in a particular survey. Weight was measured to the nearest 100 grams using electronic scales (Seca). These were pre-calibrated and the weight reading checked prior to each survey.
Data for the 1991, 1993 and 1998 surveys were screened for outliers, cross-checked with the original questionnaires, and non-biological values were omitted. Data was manually entered for the 1991, 1993, and 1998 surveys, and optically read with manual checking for the 2006 survey. Optical reading of questionnaires was completed using the Read Soft software program. Once data was ready in word pad form it was directly transferred to Microsoft excel, and then to SPSS (Statistical Package for the Social Sciences) for analysis.
It was not possible to validate parental responses to health parameters with general practice medical records.
Data analysis and statistical methods
The analysis assumes that the population is representative of a single Caucasian ethnic group and that the denominator school populations represented the same geographic catchment areas for the 15 year survey period. The primary hypothesis examined whether question compliance was related to changes in socio-economic status.
Statistical analysis was performed using the Epi-Info, and SPSS (version 17) and all data was anonymised. Distributions for demographic, social and respiratory characteristics were compared using Chi-square, for comparison of proportions and the student t-test for comparison of continuous values. Statistical tests were two tailed and p<0.005 was considered significant. Mean Townsend scores were estimated for participants of each survey and separately for responders and non-responders to specific key questions. These questions were on child health status, breast feeding, parental employment, parental and childhood asthma diagnosed by a doctor, household smoking, dampness in the home, childhood wheeze and excess cough.
The level of household socio-economic status was calculated using the Townsend Deprivation Scores derived from respondents postcodes. This used MIMAS software (Manchester Information and Association Services), which converts UK postcodes directly to deprivation scores which range between -6 to -3 (least deprived) and +4 - +12 (most deprived). Townsend scores had been used for the 1991, 1993, and 1998 survey analyses and this socio-economic score was retained for use in the 2006 survey analysis.
Methodological characteristics of four cross-sectional surveys
Number of schools
Pre-notification by letter
Every second child
Re-visits for absenteeism
at 2-4 weeks
at 2-4 weeks
at 2 weeks
at 2 weeks
Months of survey
September to December
September to December
September to December
September to December
Age of children
Total number of questionnaires
Mother completed questionnaire
Father completed questionnaire
Both parents completed questionnaire
New questions added*
New questions added**
Ethical Committee approval for these surveys was provided by the Royal Liverpool Children’s Hospital NHS Trust, Alder Hey and the Liverpool School of Tropical Medicine Ethical Committees.
Parental questionnaire compliance
% difference 1991-2006
Percentage of missing responses to specific questions
Question on sex
Question on age
Question on birthweight
Child considered healthy
Child breast fed
Dampness at home
Prevalence of socio-demographic characteristics of household respondents
Mean child age
(Upper quartile +4 to +12)
Mean Townsend score
Maternal smoking during pregnancy
Paternal smoking during pregnancy
Duration of residence at present address ≥3 years
Dampness at home
Townsend scores in responders or non-responders to specific questions
Child considered healthy
Child breast fed
Dampness at home
It is important to establish the extent to which sampling bias explains survey variation in prevalence of child health outcomes in these surveys. We reported a significant increase in prevalence of maternal asthma with survey year from 1991 to 2006 (6.6% to 13.4%), p<0.001)  with a lower childhood prevalence of doctor diagnosed asthma in 2006 than 1998 (29.8% and 19.4%). There was an increasing proportion of hospital admissions between 1991 and 1998 (5.5% to 11.3%, p<0.001), which decreased in 2006 (9.7%). Childhood obesity prevalence was higher in 2006 (14.9%) compared to 1991 (9.2%, p=0.039, linear trend) . Over these periods the pattern of questionnaire compliance showed a linear reduction across all schools with the largest difference between the 1998 and 2006 surveys. The trends were comparable between the ten Liverpool and five Wallasey schools and it is unlikely that non-compliance was a specific problem to Liverpool schools, although these had had an early history of airborne dust exposure from the Liverpool docks. It is likely that the very high survey compliance in 1991 and 1993 was influenced by community concerns about childhood health and dust pollution. The much lower response rate in 2006 is unlikely to be related entirely to amelioration of these environmental exposures which occurred in the interim period.
It is unlikely that questionnaire and sampling variation explained changes in compliance between the four surveys as essentially the same survey instrument, methodology and schools were used for these sequential assessments. The surveys were comparable in terms of questionnaire design and the same core questions were used which comprised the majority of listed questions.
Response rates to general population surveys have been in decline over recent decades, with compliance ranging from 30% to 70% [15, 20–27] and the much lower compliance in the 2006 Merseyside survey was consistent with this pattern. This was a major concern, as marked prevalence changes in the survey population were concurrently observed for both childhood and parental asthma , and for childhood obesity . The response rates in these school surveys are critical for assessing the validity of the study findings. Response representativeness is more important than the actual response rate in this type of survey . A low response rate of 30% has been proposed as acceptable for patient satisfaction surveys, providing the sample is representative . Supplemental analysis is helpful to confirm that respondents are in fact representative of the population . Ideally analysis of representativeness in relation to non-response bias should compare data from responders who participated in the survey, with non responders who didnot participate in order to measure the potential bias resulting from low response rates . In the present survey this was not possible, and an alternative approach of comparing socio-economic characteristics of responders and non-responders to specific questions was adopted.
Without information on the household characteristics of parents who did not return the questionnaires, it is not possible to determine if these comprised households with different socio-economic profiles. Non-responders have often been shown to differ from responders in terms of a number of socio-demographic and economic variables which are linked to lifestyles, attitudes and beliefs [24, 31]. The pattern of non-response bias is difficult to assess because characteristics of those who are contacted, but refuse to participate, will not be available . There were no mean differences in socio-economic deprivation indices between respondents across the four surveys. This population was predominantly Caucasian (>94%)  throughout these survey years, and there were no major shifts in ethnic composition, indicating there were no substantial ethnic demographic changes.
The pattern of parental non-responses to specific questions varied across the four surveys indicating some influence of survey year on response characteristics. Non-responses to some core questions were higher in 2006, when survey compliance was also lowest, indicating a greater reluctance to provide answers to specific questions in the 2006 survey. This was not the case for the response to the question on dampness in the home, for which the response rate had improved in 2006, concurrent with social improvements in housing in the later survey years. A significant change in the 2006 survey was the higher proportion of employed mothers. As mothers were mostly responsible for completing questionnaires, a busier working lifestyle might explain increased reluctance to respond to time consuming school-questionnaires. The estimated time for completing the school questionnaire was approximately 20 minutes. The proportion of single parent households, and the mean Townsend scores, did not vary between surveys. Similarly, duration of residence at the present address for more than three years did not significantly differ across surveys. This suggests that despite a reduction in compliance in 2006, there were no major changes in household socio-demographic profiles between surveys for parents who returned questionnaires. This is re-assuring in terms of response bias related to social deprivation. Examining this in further detail in relation to mean Townsend scores for responders or non-responders to specific questions, showed scores were slightly lower in 2006 than 1991, but this occurred for both these groups. There was no pattern towards lower scores for households with non-responses to specific core questions.
As characteristics of questionnaire non-respondents were not available it was not possible to have a comparative group of parents who refused to participate. Record linkage to other data sources would be an alternative method to obtain information on non-respondents , but ethical approval for this was not available for these surveys.
Without information on the household characteristics of parents who did not return the questionnaires, it is not possible to determine if these comprised households with different socio-economic profiles. Non-responders have often been shown to differ from responders in terms of a number of socio-demographic and economic variables which are linked to lifestyles, attitudes and beliefs [24, 31]. The pattern of non-response bias is difficult to assess because characteristics of those who are contacted, but refuse to participate will not be available .
These surveys provide the first evidence using a standardised community survey methodology for child health assessment of a major shift in parental questionnaire compliance for an urban population over a 15 year period to 2006. It is unlikely that the methodological differences between surveys explained changes in compliance as the same survey instrument, methodology and schools were used for all the sequential surveys. The fall in response rates to school surveys over the past several years has occurred at the same time as a number of important changes in the compulsory education system in United Kingdom (UK) . The decreased parental compliance may relate to increasing frequency of questionnaire surveys occurring in schools related to various audits, monitoring and evaluation activities, lack of available time for employed parents, the length of questionnaires. Minor changes in demographic characteristics of the surveyed sample, and changing attitudes of respondents to sensitive questions may be contributory. Heightened concern about airborne dust pollution between 1991 and 1993 was an important stimulus to questionnaire compliance at that time, and the removal of these exposures may have reduced community interest in health assessments. The present analysis provides evidence for response representativeness over the survey periods, despite the parallel changes in compliance.
Parental compliance is an emerging major problem for cross-sectional surveys of childhood health in urban areas. This limitation must be considered in community survey designs and requires better capture of socio-demographic data on non-respondents, and inclusion of in built methods which allow for assessment of response representativeness.
Acknowledgement and funding
The support from Dr Jane Richardson, Kirby Health Protection Agency with Optical reading and scanning of questionnaires and the co-operation of Jean Taylor from the Liverpool School of Tropical Medicine are gratefully acknowledged. We are grateful for the assistance of Drs A. Delpisheh and S Rizwan. The 2006 survey was funded by the Children’s Research Fund and the analysis was supported by the Delves Charitable Trust.
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.