Abstract
A large number of studies have reported on the validity of autism spectrum disorder (ASD) screening procedures. An overall understanding of these studies’ findings cannot be based solely on the level of internal validity of each, since screening instruments might perform differently according to certain factors in different settings. Europe has led the field with the development of the first screening tool and first prospective screening study of autism. This paper seeks to provide an overview of ASD screening studies and ongoing programmes across Europe, and identify variables that have influenced the outcomes of such studies. Results show that, to date, over 70,000 children have been screened in Europe using 18 different screening procedures. Differences among findings across studies have enabled us to identify ten factors that may influence screening results. Although it is impossible to draw firm conclusions as to which screening procedure is most effective, this analysis might facilitate the choice of a screening method that best fits a specific scenario, and this, in turn, may eventually improve early ASD detection procedures.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Avoid common mistakes on your manuscript.
Introduction
In the past few decades, many studies have documented behavioural manifestations of ASD during the first 2 years of life [1–5]. Nevertheless, there is still a large delay between the first parental concerns, the first consultation, and the age at which the diagnosis is made [6–8]. Early identification and subsequent intervention lead to a better prognosis for the child. Intervention may prevent secondary developmental disturbances [9–11] and reduce family stress [6, 12] and societal costs [13–15]. Thus, there is a need to develop methods and instruments for early identification of ASD.
The first attempt to develop a prospective screening instrument for ASD was made in Europe by Baron-Cohen and his colleagues in the UK with the Checklist for Autism in Toddlers (CHAT; [16]). In over 20 years that have elapsed since the CHAT was presented, much progress has been made, with more than 20 ASD screening instruments currently available at international level (Table 1). It remains to be seen, however, whether current screening instruments fulfil the criteria for large-scale implementation [41]. Although a number of studies have shown that early ASD screening is feasible, there are still several issues to be addressed. Experts have noted that few screening instruments are well-evaluated and that it is important for both clinical and research purposes to collect more structured, in-depth information on existing screening procedures [42].
Novel screening instruments have been developed in Europe over the past decade, including the Early Screening of Autistic Traits in The Netherlands (ESAT; [22, 43]) and the Checklist for Early Signs of Developmental Disorders in Belgium (CESDD; [24]). Screening instruments have also been translated, culturally adapted and tested in countries other than those where they were originally developed, e.g. the Modified-Checklist for Autism in Toddlers (M-CHAT; [19]) in Spain [44] and in Sweden [27]. Other European countries, such as France, Italy and Finland, are currently engaged in evaluating other screening procedures for which results are still to be published.
To date there has been little exchange of information among researchers across Europe regarding the details of the screening procedures used and the difficulties encountered during screening. There are very few studies that report on rigorous direct comparisons of different screening procedures in similar circumstances [45, 46]. Rather than developing new screening instruments, a careful look at previous and ongoing ASD screening programmes in Europe might instead provide key insight for improving current and future screening procedures. Examination of the same screening procedures in different samples and contexts may be a good way of identifying strengths and weaknesses. In addition, evaluating the effectiveness of different adaptations of existing screening procedures may contribute to identifying the factors that influence screening outcomes.
The COST Action ‘Enhancing the Scientific Study of Early Autism’ (ESSEA) has brought together a group of European researchers who use screening instruments to identify ASD prospectively at an early age [47]. One of the aims of this collaboration is to identify which screening instruments perform best in a given context. Current health care, social and educational systems across Europe vary greatly in terms of expertise and capacity to identify children with ASD at a young age, often leading to marginalisation and disparities between social classes on the mean age of diagnosis [48, 49]. The positive effects of early screening to reduce racial/ethnic and socio-economic status inequalities in age of first diagnosis are promising [50] although these effects have to be further explored [51]. Indeed, there are no European ASD screening guidelines. Even within individual countries, societal, demographic and service factors might affect how screening works, and yet these factors do not tend to be well described in studies. The purpose of this paper is thus to describe the procedures used in ASD screening studies conducted across Europe, and to summarise the respective factors and methodological issues which might have influenced the results of the different studies.
Current situation of ASD screening studies in Europe
To obtain a complete picture of the status of ASD screening in Europe, we used a two-pronged search process (See Fig. 1). A search of the scientific literature was made covering the PubMED and PsycINFO databases and using the following search terms: ‘autism’ OR ‘autism spectrum disorder’ AND ‘screening’ or ‘identification’ or ‘detection’, with “1992–2012 Pub-date” and “English language” as advanced filters. This search retrieved over 700 citations. Perusal of the titles, authors and abstracts of these citations to discard any study that had been not undertaken in Europe, yielded a net total of 16 papers. When reviewing these papers, the following additional selection criteria were applied for their final inclusion: (a) design: population based; (b) participants: children under the age of 4 years at first screening and with no prior diagnosis of developmental delay (no school-age tool); and, (c) gold-standard diagnostic procedure: DSM-IV-TR criteria for pervasive developmental disorders (PDDs), also known as autism spectrum disorders (ASDs) [52] and the autism diagnostic observation schedule (ADOS; [24]). The reference lists of all relevant studies were checked to identify any additional publications. Using these selection criteria, papers reporting screening at school age, as in Finland [53, 54] and the UK [55–60], were excluded. Similarly excluded were the study conducted in Ireland [61] because it did not use the DSM-IV as standard diagnostic procedure, and the study undertaken by Allison et al. [20] because it was not population based. Eight studies reporting 15 screening procedures for young pre-schoolers with ASD in Europe were retained for review.
Searching strategy for ASD screening studies in Europe. Letter a indicates new literature review and consultation of ESSEA-COST members have been carried out just before March 2014 but none new ASD screening studies in Europe have been published either communicated to main authors apart from the already included
Secondly, researchers within the ESSEA COST action network were approached to ascertain whether there might be any other ongoing, as yet unpublished screening programmes. As a result, a further three screening procedures were identified in France, Italy and Finland, and preliminary data were incorporated into this review, leading to a total of 18 different screening procedures. Where published studies failed to provide data on sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV), these measures were estimated from the data, if available (to be taken with caution since different protocol adaptations are used). In addition, all main authors were asked to provide clarification regarding the procedures and results of their studies, as well as verification of the information to be included in this paper. An overview can be found in Table 2.
This table shows information on the number of completed and ongoing ASD screening studies across Europe. Over 70,000 children have been screened in Europe to date. Nine of the 28 European Union Member States (32 %) have conducted or are conducting ongoing ASD screening studies (although some were one-off research studies, as in the UK). Italy and Spain are the only Southern European countries which have reported any ASD screening experience (ongoing health surveillance programmes in both cases). Belgium is the only country where the screening study was set in child day-care centres rather than in primary care. Five countries have used or are using the M-CHAT as their screening instrument of choice (sometimes together with another ASD screening tool). A contemporary map of Europe with the information compiled through the ESSEA COST network in 2012 is depicted in Fig. 2.
Through the ESSEA-COST network, we also gathered first-hand information about ASD screening in Norway. The Autism Birth Cohort (ABC), a sub study of the Norwegian Mother and Child Cohort Study (MoBa) has included several ASD checklists on the 18-month questionnaire, i.e. M-CHAT, ESAT and the Non-Verbal Communication Checklist (NVCC) (Schjolberg, submitted). At age 36 months, the 40-item Social Communication Questionnaire (SCQ) has been used to screen for ASD in the complete MoBa cohort (N ~ 100,000). Screen-positive children underwent a full-day diagnostic evaluation using ADI-R and ADOS. The entire MoBa cohort is followed up at 8 years with the complete SCQ enabling researchers to examine ASD symptom patterns from early age to 8 years. Linkage to the Norwegian National Patient Registry (NPR) makes it possible to identify false negatives from the early screening. This study represents the largest sample of children screened for ASD in Europe (approximately 100,000), though it is not an ASD screening programme per se and indices on the screening tools are not yet published. The study is described in Stoltenberg et al. [65], and the relationship between screen positivity at 36 months and subsequent ASD diagnosis at assessment are being prepared for publication (Bresnahan et al., in prep.). Beuker et al. [66] have examined whether ASD symptoms in 18-month-old children fit the 3-factor structure, as described in DSM-IV. Characteristics of M-CHAT at 18 months compared to later diagnostic status based on clinical assessment or NPR (ASD vs non-ASD) are in preparation for publication (Stenberg et al., in review).
A second reading of the full text of the selected papers was completed by the main authors of this paper (PGP and AH). Study methodologies were thoroughly reviewed to identify differences among screening procedures, as well as the main factors that might influence screening programme results. As a result, a list was drawn up containing ten critical factors to be considered when assessing screening studies. To contextualise these factors, additional information from both European and non-European studies was included, where appropriate.
Factors to be considered when evaluating screening studies
The ten factors to be borne in mind when assessing screening studies are: (1) broad-based analysis of validity indices; (2) prevalence rates and PPV interpretation; (3) age of screening; (4) level of functioning and autism severity; (5) selection and formulation of items; (6) cut-off criteria; (7) protocol adherence; (8) informants; (9) parental non-compliance rate; and (10) setting characteristics: organisation of services, as shown in Table 3. Each of these methodological issues will now be addressed in turn.
Broad-based analysis of validity indices
Studies report several parameters that assess the efficacy of screening instruments. Sensitivity and specificity are often considered the most important criteria of validity. A major challenge, however, is the interpretation of these values. Although interpretation is facilitated by the establishment of quantitative criteria, with values of 0.70 or higher being acceptable for developmental disorders [67], a more comprehensive approach to interpreting these parameters is called for. A trade-off between sensitivity and specificity is common. A screening procedure with a high sensitivity will often have a high false-positive rate, thereby lowering its specificity. Screening methods with a high specificity will usually sacrifice sensitivity by increasing the false-negative rate. This is also demonstrated by some of the screening procedures in Table 2. For instance, the CHAT-1 + CHAT-2 (second administration of CHAT after a high-risk result in CHAT-1) has an excellent specificity of 1.00 combined with a very poor sensitivity of 0.21 [62]. It has been suggested that sensitivity is the measure of greatest concern [68, 69]. The drawback of many false negatives (low sensitivity) is that many children who will go on to develop ASD are missed. This precludes early diagnosis and early initiation of treatment and family support for such children and their families. On the other hand, a low specificity also has negative implications. False positive cases are evaluated through costly assessment procedures, not to mention the possible stigmatisation of the child and the additional family stress caused by falsely alarming parents [70]. These consequences resulting from an erroneous positive identification could be considered as negative side effects of a screening programme with insufficient specificity. However, when interpreting the false-positive rate, it is crucial to consider the proportion of false-positive cases that have another developmental delay or disorder. Dietz et al. [43] reported that 25 % of all ESAT false-positive cases had a language disorder, and 18 % of the false-positive cases were diagnosed with intellectual disability. These findings raise questions as to whether screening procedures should target ASD specifically or developmental disorders and delays in general [70]. Instead of immediately rejecting a screening procedure with a high false-positive rate, a more in-depth look may indicate that the screening procedure is helpful in detecting children who benefit from further diagnostic assessment and treatment at an early age. The amount of false-positive cases having another developmental disorder justifies the need to examine developmental trajectories, to gain insight into which early signs are specific for ASD [71]. Performing screening through a two-stage process before any diagnosis referral (which is characteristic of most procedures in Table 2) may help to narrow down false-positive rate and thereby reduce the above-mentioned possible side effects of screening.
Prevalence rates and PPV interpretation
A high degree of variation in ASD prevalence has been reported. Age, diagnostic criteria and region have been found to be associated with ASD prevalence rates [72]. Although the PPV is often considered to be the most useful information for the clinician [73], its value depends on the prevalence rate in the population screened. This might explain why the PPV was lower in the Spanish M-CHAT study than in other M-CHAT studies [44]. The frequency of ASD cases observed in the Spanish study (0.92 % in Stage 1; and 0.29 % in Stage 2 based only on a general population sample) was much lower than that reported by other M-CHAT studies (e.g. 2,7 % in Kamio et al. [74]; 2.66 % in Robins et al. [19], 3.03 % in Kleinman et al. [75] and 2 % in Pandey et al. [76], in which most ASD cases came from their referred early intervention sample rather than from their general paediatric practices. These considerations highlight the importance of knowing the prevalence of ASD in the population targeted for screening, instead of relying on the PPV reported by another study with another prevalence rate in, say, a different age range [77]. One method for calculating the validity of a screening instrument which takes into account ASD prevalence is Bayes Theorem. According to this theorem, the chance of a disease being truly present depends on both the prevalence of the disease and the properties of the test, essentially the likelihood ratio [77, 78]. Rather than using the prevalence in a specific sample, e.g. by examining the clinicians’ records within that specific context, as recommended by Camp [73], some authors have instead used prevalence rates drawn from a different sample to estimate validity properties [73]. For instance, Groen et al. [78] used the prevalence rates reported by Baird et al. [62] to evaluate the validity of the ESAT [78]. When clinicians use these numbers to support their choice of the ESAT, it should be borne in mind that there might be a difference in prevalence rates between populations. This underscores the importance of clarity as regards the prevalence rate used in validity studies and the usefulness of pre-test odds and likelihood ratios. Since prevalence of autism in the general, unselected population is very low [79], Groen et al. [78] suggest that one possibility of increasing the post-test odds is to increase the pre-test odds by applying screening instruments solely to selected children who are either found to have a deviant developmental path in routine developmental surveillance, or found to have high-risk status by other means.
Age of screening
Several studies show that parents have concerns about children who later develop ASD within the first 2 years of life: De Giacomo and Fombonne [80] report an average age of 19 months, while Chawarska et al. [81] report an age of 14 months. In the presence of intellectual disability, an older sibling, concerns for medical problems, or a delay in developmental milestones, the age of parental concern were lower [80]. Yet, detecting ASD at a very early age is not exempt from considerable difficulties, since it may be difficult to differentiate ASD from other developmental disorders [82], or even to differentiate ASD from typical development [83]. For example, repetitive behaviours are also present in young children with typical development [84]. Moreover, many behaviours that capture joint attention skills, such as gaze monitoring and protodeclarative pointing, develop gradually from age 9 to 18 months in typically developing children [85], and are only a clear clinical sign when they have not appeared after the age of 18 months. Difficulties in differentiating ASD from other developmental disorders at a very early age are consistent both with findings from the ESAT screening at 14 months which resulted in a high number of false positives, though none of these children had typical development [43], and with the CESDD study [24]. Dereu et al. [86] report many false positives, specifically in the younger age group. Moreover, the false-negative rate might also be higher at a young age due either to late onset of ASD or to the fact that about 30 % of children show regression after a period of typical development [81]. It is also plausible that milder variants of ASD, and children with a higher level of cognitive development could be missed at a young age [43]. Thus, when interpreting validity indices, it is important to consider the age of the sample during screening and diagnostics.
Level of functioning and autism severity
Since ASDs are associated with a broad range of intellectual and language skills that change over time, level of functioning and autism severity are important factors to consider when evaluating screening methods. Children who were not identified by the CHAT but were later diagnosed with ASD were found to be higher functioning in a variety of areas and were rated as less severe on autism assessment measures [87]. A study by Kleinman et al. [75] showed that this was similar for M-CHAT, with false-negative cases being higher functioning than positive M-CHAT ASD cases. The SCQ showed better discriminative validity in toddlers with intellectual disability than in those without intellectual disability, and also showed that IQ significantly predicted SCQ scores [88]. This may reflect the fact that higher functioning toddlers with ASD are more difficult to distinguish from their high-risk, non-spectrum peers than are low functioning toddlers. Since screening instruments are intended for broad use, an effect of IQ is a problem. In a different study, Oosterling et al. [88] reported that, after a screening procedure with the ESAT, about 75–85 % of the children referred before 36 months with narrowly defined autism had intellectual disability. Difficulties in screening for ASD in young children, and difficulties with diagnostic discrimination in high-risk children in particular, are issues that are not necessarily specific to the screening tool, especially with regard to specificity, but rather to the IQ or risk status of the children [88]. Hence, clarity regarding the characteristics of the sample used is very important when interpreting the psychometric properties of the instruments under investigation.
Selection and formulation of items
ASD screening procedures vary in the items included to identify children at risk. Social-communicative impairments are considered to be central to ASD [52] and are therefore always part of screening procedures. The item ‘lack of following joint attention’ was indeed one of the items that was most effective in distinguishing ASD from non-ASD cases when using the CESDD [88], and the CHAT mainly consists of items on initiating and following joint attention [16]. Social-communicative items in the ESAT, including ‘shows interest in people’, ‘smiles directly’ and ‘reacts when spoken to’ also discriminated best between children with and without ASD [43]. Even so, many studies have shown that screening procedures which focus exclusively on social-communicative impairments might overlook other early signs of ASD. In a familial, high-risk sibling sample, Zwaigenbaum et al. [4] showed that early behavioural markers for ASD include atypical markers in visual tracking, disengagement of visual attention and sensory-oriented behaviours. Gillberg [89] reported that ‘does not play like other children’ was among the three most discriminating items and further suggested that abnormal perceptual responses are important for identification of ASD. Other studies have supported the existence of abnormalities in play and sensory-motor behaviours at an early age [3, 90]. The results of these studies have broadened the focus of screening instruments for ASD, and this has been effective. Among the items with the highest odds ratio in the CESDD study were ‘lack of symbolic play’ and ‘unusual sensory behaviour’ [24]. In addition to the CESDD, many other screening instruments (ESAT and M-CHAT) have included items focused on play and sensory-motor behaviours. Baird et al. [62] suggest that specifically the combination of failing joint attention and pretend play at 18 months indicates risk of developing ASD. The fact that sensory and motor items have not been included in all screening tools might be due to the fact that parents do not mention these items spontaneously. However, when parents have been questioned about these items specifically, they report having noticed such abnormalities from an early age [22]. At a young age it might be useful to take play-related behaviours into account, while at an older age, impairments in social interaction and communication might become more specific behavioural markers for ASD. In the ESAT study some items, such as ‘gaze following’, had a relatively high proportion of negative answers for children younger than 12 months because this trait is still developing in the first year of life [43]. For instance, the First Year Inventory (FYI) [23] developed to assess behaviours in 12-month-old infants and the ESAT [43] developed for 14-month-old infants include more play-related and sensory-motor behaviours than does the SCQ [91], which was originally developed for individuals aged 4 years and over. On the other hand, the SCQ includes items such as ‘pronoun reversal’, ‘verbal rituals’ and ‘no friends’, which are more appropriate for somewhat older children. Differences in the formulation of items might also affect the responses. The CESDD, for example, includes the item ‘lack of showing objects to others to indicate interest’, which was recognised in 64.52 % of children with ASD. In contrast, the item ‘absence of showing’ in the ESAT and M-CHAT was recognised in only 26.67 and 28.57 % of children with ASD, respectively, while ‘no showing’ in the SCQ was recognised in only 13.04 % [86]. Baird et al. [62] also point to the fact that in the CHAT parents were asked to report whether their child had ‘ever’ produced certain behaviour, while if they had been asked if their children had only ‘rarely’ produced such behaviours, the instrument’s sensitivity might have been higher, though at the cost of its PPV and specificity.
Cut-off criteria
Instead of continuing to develop new screening methods for ASD, a more elaborate evaluation of current screening methods might be helpful. One way of achieving this is to explore different criteria within the same screening procedure, using different cut-off scores for different purposes and populations. Comparing the validity indices of the CESDD in combination with an SCQ cut-off of 11 to those of the CESDD in combination with an SCQ cut-off of 15 demonstrated that lowering the SCQ cut-off to 11 improved sensitivity from 0.42 to 0.70 while maintaining good specificity (Dereu et al., unpublished data). Oosterling et al. [63] also explored different criteria of the SCQ (cut-off 11 vs. 15) and the CHAT (high or high + medium risk considered positive). This study showed that, whereas sensitivity was higher for the SCQ cut-off of 11 as found in Wiggins et al. [92], specificity was higher for the SCQ cut-off of 15. In the case of CHAT validity, the high-risk + medium-risk criterion improved sensitivity considerably (from 0.18 to 0.48) while keeping specificity high, i.e. 0.99 for the high-risk criterion and 0.87 for the high-risk + medium-risk criterion. In addition, Scambler et al. [87] described how a slight change in CHAT criteria to allow parents to endorse either of two critical items, improved CHAT sensitivity by 20 % while maintaining specificity of 100 % in a group of children with developmental disabilities. In the Spanish M-CHAT study, false-positive cases were found to be reduced if the M-CHAT was only deemed to be positive after five [44] as opposed to three failed items [19].
Protocol adherence
Another factor that may cause variation in screening results is the fact that the same screening procedure is often implemented in different ways. Administration is not consistent across different studies. Researchers and clinicians adapt the original protocol of the screening procedure to their own needs and circumstances. The M-CHAT, for instance, comprises a 23-item yes/no parent report and a follow-up telephone interview. This interview was added to the initial M-CHAT protocol to reduce the number of false positives [19]. Kleinman et al. [75] found that by adding a telephone interview to the screening procedure, the PPV was improved from 0.36 to 0.74. This was especially important in the low-risk general population. Both Nygren et al. and Canal-Bedia et al. [27, 44] indicate that the interview is necessary because items are sometimes misunderstood. Although adding the phone interview proved effective, it should be noted that some researchers have adapted this procedure. Dereu et al. [86] did not include the telephone interview, so that positive screens on the M-CHAT were based exclusively on parent report. This may have affected the PPV, which was 0.29, for the procedure, which consisted of the CESDD with the M-CHAT but without the telephone interview. In some cases, however, it may be more effective to forget the interview. In a case where children fail seven or more items in M-CHAT initial screening, a follow-up interview may not be necessary [93]. Such children can be immediately referred for further evaluation. An alternative way of conducting the follow-up interview is to be seen in Spain, where the M-CHAT interview is computer-based and performed directly by the paediatrician after a positive result, by asking the parents about the failures, an approach that obviously facilitates administration of the follow-up process [64] or implementing the M-CHAT entirely in electronic format [94]. Another example of alternative administration can be found in the study by Oosterling et al. [63]: instead of using the CHAT as a separate instrument, items from the SCQ and CSBS-DP were combined to represent CHAT items, which probably influenced the results. When implementing a study protocol, adherence and deviation should be balanced, bearing in mind the specific purpose and resources of the study. It needs to be specified here that a revised version of the M-CHAT (M-CHAT-R/F; [95]) with an algorithm based on three risk levels has been recently published and recommended for primary care settings.
Informants and training
The information extracted from the studies reviewed shows that many different informants are used in ASD screening. Filipek et al. [96] noted that parents are often correct in their concerns about their child’s development. Although parents may not be as accurate when it comes to specific ASD deficits, they are almost always accurate in detecting a developmental problem [67]. Since parental checklists, such as the M-CHAT, are easy to administer, they are often used for screening purposes. Yet, parents may not know exactly what skills to expect at a certain age and are not able to compare their child with peers [86]. Furthermore, parents may also over- or under-report problems in their child. In the ESAT study [43], ASD experts evaluated children’s behaviour more negatively than did their parents, to the extent that 3 out of 18 children diagnosed with ASD would have scored below threshold on the 14-item ESAT if only parent rating had been used. Accordingly, parental information should be combined with observations by a professional, such as a physician. Physicians, and paediatricians in particular, possess knowledge about typical child development [88, 97] and are able to compare the behaviour of the child to that of his/her peers. It should be noted, however, that physicians have to base their clinical judgment on a brief observation of the child and a short conversation with the parents. Moreover, the behaviour of the child when examined by the physician or another clinician may not represent the child’s typical behaviour in a natural context. To prevent the problems posed by only parents’ or physicians’ reports, child care workers might also be very useful as informants; since they can compare behaviour and the development of the child directly to that of other children and are educated in typical development. In addition, children may behave more typically in a child care setting than at a medical practice, since children often visit child care on a regular basis [24].
Other authors have also suggested the possible contribution of child care workers to ASD screening in young children [98]. In the UK, the NICE guidelines recommend training professionals in early signs of ASD at pre-school and school ages [99]. It is important to understand that training physicians and professionals in recognising early signs of ASD might make a crucial difference in the results of screening. The DIANE Project in The Netherlands [88] is a good example of health care professional training, in which small groups of primary care workers attended a compulsory course of interactive training sessions. The main part of the training sessions included a review of early signs of autism and all ESAT items, illustrated by video clips showing children with abnormal or absent behaviour and others showing typically developing children, to clarify what could be expected of a young child at a certain age. In general, the results of this controlled study support the fact that the availability of an early identification tool, coupled with training for primary care workers in the early signs of ASD and their ongoing involvement in a screening programme can lead to earlier detection, referral and diagnosis of ASD. Lack of training could lead to disagreement over ‘cookbook’ guidelines, unfamiliarity with screening instruments and procedures, as well as inconsistent knowledge of ASD and fear of positive results among primary care providers [88].
Parental non-compliance rate
Parental non-compliance is an essential problem in many screening studies. It is, therefore, imperative to examine the differences between parents who are compliant and non-compliant with the screening instrument and to provide explanations for non-compliance. Firstly, parents are known to be more inclined to participate in cases where the atypical development of their child is more apparent. Screening scores have been shown to be higher in the children of compliant parents than in those of parents who declined further assessment [43]. Secondly, children of compliant parents were somewhat older at the time when their parents completed the questionnaire [86]. This may be related to the above factor. Parents may not comply because they do not have any concerns about the development of their child at very young ages, or alternatively, because the symptoms may not yet be apparent at this stage [43]. A possible solution could be to ask parents again the following year when their child is slightly older, something that may serve to increase the response rate. Dereu et al. [24] suggest that a more personal approach might improve parental compliance. This might explain why the response rate was lower for returning parent questionnaires than for further developmental assessment [24]. Another factor to facilitate compliance might be to limit the number of assessments requiring parents to come in person to the university or health centre with their child. In the study by Dietz et al. [43], the effort of undergoing a minimum of two, but preferably, five examinations at the department was an important obstacle to participation. Dereu et al. [24] also report that parents did not wish to subject their child to the burden of assessments, and for some parents it was just not feasible to come to the university. Socio-economic and ethno-cultural factors may also have an effect on compliance, i.e. Reznick et al. [23] report that Afro-American families and less-educated parents more often refuse to participate. One reason for this might be the fear of the stigma attached by some cultural groups for receiving a diagnosis [100].
Setting characteristics: organisation of services
A screening procedure cannot be implemented without taking the setting characteristics into account. The presence of a preventive health system, such as the well-baby clinics in The Netherlands and the well-baby check-up programme in Spain, offers the opportunity to screen at a population level as opposed to screening high-risk children alone [43, 44]. One advantage of the presence of such a system is also the high attendance rate, often related to compulsory vaccinations. Even where such a system is available, it is still relevant to examine whether the system is available to all residents and whether it covers families from all socio-economic and ethno-cultural groups. Canal-Bedia et al. [44] also note the need for coordination between the health system and early intervention units in Spain. Needless to say, when implementing a screening procedure, post-screening intervention in the form of diagnostic assessment and intervention programmes should also be made available. Coordination with such services is also crucial for identifying possible false-negative cases [64]. Another factor to be considered is that there might be many differences in physician training and education in the respective countries. This is something that should be assessed when implementing a screening procedure which relies on physicians as informants. In addition, when choosing the CESDD as a screening procedure, it is important to bear in mind that this instrument might not be as effective in countries where only few children attend child care facilities, either because of the expense involved or because only a minority of women work. Child care in such countries might also be provided by the extended family instead of professional child care workers. In these cases it might be better to choose another procedure, since the CESDD’s advantages (i.e. the ability of child care workers to compare the child’s development to that of peers) are not applicable.
Other methodological concerns about ASD screening studies
A major issue in studies that evaluate the validity of ASD screening procedures is that not all children were followed up. In particular, information on screen-negative cases is missing in many screening studies in Table 2. Some studies have attempted to ‘solve’ this problem by calculating the sensitivity and specificity based on general prevalence rates, e.g. Groen et al. [78] calculated validity indices for several screening instruments, using ASD prevalence numbers reported by Baird et al. [62]. As mentioned earlier, however, the prevalence rates of the populations studied may differ, particularly as prevalence estimates are age dependent, since some children might not clearly manifest the full range of ASD symptoms until social demands outstrip capacity, as recognised by the new DSM-5 diagnostic criteria [101]. Oosterling et al.’s study [63] reported sensitivity and specificity based on the percentage of children who had already been the focus of some concern about ASD, a very specific group: true validity indices cannot be ascertained in this case. Future studies should devote more effort to the follow-up of screen-negative cases to calculate the true validity indices in that specific sample, though it should be noted that following up such cases could be expensive since a majority may prove to be genuinely screen negative [44]. On the other hand, it is plausible that some screen-negative cases will receive a diagnosis. Higher functioning children, children with less severe autism, and children who exhibit regression have a high probability of being missed in screening procedures [96]. Extending the inclusion criteria by, say, also including children who fail language items may improve estimates of validity indices by detecting false-negative cases (Dereu et al. [24]). It is likewise important to continue monitoring screen-positive cases, to establish the validity of the screening procedure in terms of a clinical diagnosis over a longer period of time. For screening studies it is critical that the follow-up of children be envisaged in advance. This idea has also been supported in a recent study examining over twenty different ASD screening programmes in the USA. One of main conclusions is the importance of methodological rigour and the quality of measures in the screening studies [51]. In the CHAT study, only half the children in the medium-risk group were not further evaluated due to lack of resources [62].
In addition, future studies should be designed in such a way that makes it possible to examine the influence of sample-specific factors on screening results. Thus, a sample should include different age, socio-economic and ethno-cultural groups. Similarly, the study population should preferably include children across the whole range of intellectual functioning. Although this was done in the ESAT studies (Dietz et al. [43]), the original CHAT study excluded children with a clear developmental delay (Baird et al. [62]). Some studies did examine the influence of sample-specific factors on sensitivity and specificity, by examining the screening results for specific age, IQ and diagnostic group [62, 68]. In general, a sample size should also be large enough to ensure that the validity indices of a screening method can be reliably calculated.
Conclusions and implications for future research
The aim of this review was to provide an overview of the screening procedures that have been evaluated in research studies across Europe, and the issues and methodological concerns associated with these. Currently, only the screening procedure with M-CHAT in Spain is still being used in routine practice. The other screening instruments that have been evaluated in research studies, such as the ESAT and the CESDD, are available for use by professionals but are not part of routine practice.
We trust that this analysis will, not only inform the drafting of recommendations for early identification of ASD, but will also prove especially important to European countries with no experience in ASD screening when it comes to making the correct choices about how to implement a screening programme in a specific setting.
Although there is consensus on the importance of early detection from both a research and clinical point of view, choosing a screening procedure that fits a certain context may be still difficult. This choice has to be based on arguments beyond validity indices. As this review has shown, findings regarding screening should be interpreted with caution. It is critical that clinicians understand how to interpret data from published studies [102]. It should be noted that screening outcomes are influenced by several factors. Therefore, a more expansive and balanced way of evaluating screening methods, which takes into account all the factors that may influence the results of the screening, is recommended. In addition, methodological issues should also be considered. The fact that in many studies screened-negative cases are not followed up, may have distorted screening outcomes. It is important to identify missed cases. This may be done by longitudinal population studies which screen children from an early age until an age at which ASD is likely to be detected or is, at least, likely to be detected with a second measurement at a later age [75]. However, due to parental non-compliance and limited resources, this is often difficult to achieve [62, 75]. Screening information should be carefully communicated to parents [102]. The need of motivational strategies to ensure that families will participate longitudinally and will follow-up treatment recommendations has also been highlighted in recently published manuscripts. They support the usage of rigorous methodology and evaluation of further variables when screening, such as rates of referral and uptake of services which have been rarely documented in screening studies [51, 103].
In USA, M-CHAT-R/F has demonstrated to be an effective tool for screening low-risk toddlers, reducing the age of diagnosis by 2 years [95]. New possibilities stimulated by these findings could be assessed towards widespread ASD screening in Europe. Recent recommendations from American Academy of Child and Adolescent Psychiatry (AACAP) maintain the support to ASD screening to young children and in some instances also relevant to older children [104]. There are also now new doors opened with concrete suggestions about how to conduct cluster randomised trials of ASD early screening [105].
Our review has attempted to analyse the current situation of early detection of ASD in Europe. Although the issues surrounding screening are relevant for any screening procedure to be implemented in Europe and beyond, greater in-depth knowledge of inter-country differences is still required. The diversity in government policy, health care, educational, and social-care settings and cultures across Europe means that screening procedures cannot be fully standardised. Joining efforts towards screening populations in lower income countries that usually access later to the intervention services should be prioritised. For instance, a preventive care system with a high attendance, such as the well-baby clinic, may not be available in every European country, making it more difficult to implement routine developmental surveillance. Thus, implementation of routine screening for ASD and/or other developmental disorders may require a reorganisation of the health care system in many countries. Screening is only effective for clinical purposes when diagnostic centres and interventions are also available.
A detailed characterisation of the samples of participants in the different screening studies, taking into account important variables such as ethnicity and socio-economic status, is needed if further conclusions are to be drawn. Additionally, a pooled data analysis of the items shared by the different screening instruments used in the European context aims to yield interesting results (Maganto, in prep).
At the moment, as part of this ESSEA-COST Action, one of the four working groups (WG3: testing how well screening instruments work in prospectively identifying cases [47]) is carrying out ongoing survey whose main goal is to compare the current status of early developmental surveillance across the 28 Member States of the European Union. Thus far, over 17 countries have responded, including at least two different informants per country. The information collected will, not only show how ASD detection and diagnosis is approached in each country, but will also provide objective data for calculating screening programme performance indicators in those countries where a system for early detection of autism exists or has existed as compared to those where no such system is or has ever been in place.
To date, a wealth of ASD screening procedures is available in Europe. While knowledge is shared through international publications and conferences, collaborations, such as the ESSEA COST Action Network, contribute to sharing knowledge among researchers and clinicians in a more direct way. Future challenges for this network lie in raising awareness about early signs of ASD among parents, child care professionals and physicians across Europe, evaluating and adapting the use of current screening procedures for different countries, providing an accessible platform for sharing knowledge and resources among European researchers and clinicians, and, most importantly, improving developmental outcomes for children with ASD and their families. Notwithstanding encouraging experiences, there is still much to be done.
References
Bryson SE, Zwaigenbaum L, McDermott C et al (2008) The autism observation scale for infants: scale development and reliability data. J Autism Dev Disord 38:731–738. doi:10.1007/s10803-007-0440-y
Osterling J, Dawson G (1994) Early recognition of children with autism: a study of first birthday home videotapes. J Autism Dev Disord 24:247–257
Ozonoff S, Macari S, Young GS et al (2008) Atypical object exploration at 12 months of age is associated with autism in a prospective sample. Autism Int J Res Pract 12:457–472. doi:10.1177/1362361308096402
Zwaigenbaum L, Bryson S, Rogers T et al (2005) Behavioral manifestations of autism in the first year of life. Int J Dev Neurosci Off J Int Soc Dev Neurosci 23:143–152. doi:10.1016/j.ijdevneu.2004.05.001
Maestro S, Muratori F, Barbieri F et al (2001) Early behavioral development in autistic children: the first 2 years of life through home movies. Psychopathology 34:147–152. doi:10.1159/000049298
Renty J, Roeyers H (2006) Satisfaction with formal support and education for children with autism spectrum disorder: the voices of the parents. Child Care Health Dev 32:371–385. doi:10.1111/j.1365-2214.2006.00584.x
Wiggins LD, Baio J, Rice C (2006) Examination of the time between first evaluation and first autism spectrum diagnosis in a population-based sample. J Dev Behav Pediatr JDBP 27:S79–S87. doi:10.1097/00004703-200604-002-00005
Daniels AM, Mandell DS (2013) Explaining differences in age at autism spectrum disorder diagnosis: a critical review. Autism Int J Res Pract. doi:10.1177/1362361313480277
Dawson G (2008) Early behavioral intervention, brain plasticity, and the prevention of autism spectrum disorder. Dev Psychopathol 20:775–803. doi:10.1017/S0954579408000370
Mundy P, Sullivan L, Mastergeorge AM (2009) A parallel and distributed-processing model of joint attention, social cognition and autism. Autism Res 2:2–21
Reichow B, Barton EE, Boyd BA, Hume K (2012) Early intensive behavioral intervention (EIBI) for young children with autism spectrum disorders (ASD). Cochrane Database Syst Rev 10:CD009260. doi:10.1002/14651858.CD009260.pub2
Hall HR, Graff JC (2012) Maladaptive behaviors of children with autism: parent support, stress, and coping. Issues Compr Pediatr Nurs 35:194–214. doi:10.3109/01460862.2012.734210
Peters-Scheffer N, Didden R, Korzilius H, Matson J (2012) Cost comparison of early intensive behavioral intervention and treatment as usual for children with autism spectrum disorder in The Netherlands. Res Dev Disabil 33:1763–1772. doi:10.1016/j.ridd.2012.04.006
Jarbrink K (2007) The economic consequences of autistic spectrum disorder among children in a Swedish municipality. Autism 11:453–463. doi:10.1177/1362361301005001002
Sanchez-Valle E, Posada M, Villaverde-Hueso A et al (2008) Estimating the burden of disease for autism spectrum disorders in Spain in 2003. J Autism Dev Disord 38:288–296. doi:10.1007/s10803-007-0393-1
Baron-Cohen S, Allen J, Gillberg C (1992) Can autism be detected at 18 months? The needle, the haystack, and the CHAT. Br J Psychiatry J Ment Sci 161:839–843. doi:10.1192/bjp.161.6.839
Baron-Cohen S, Cox A, Baird G et al (1996) Psychological markers in the detection of autism in infancy in a large population. Br J Psychiatry J Ment Sci 168:158–163
Berument SK, Rutter M, Lord C et al (1999) Autism screening questionnaire: diagnostic validity. Br J Psychiatry J Ment Sci 175:444–451
Robins DL, Fein D, Barton ML, Green JA (2001) The Modified Checklist for Autism in Toddlers: an initial study investigating the early detection of autism and pervasive developmental disorders. J Autism Dev Disord 31:131–144
Allison C, Baron-Cohen S, Wheelwright S et al (2008) The Q-CHAT (Quantitative Checklist for Autism in Toddlers): a normally distributed quantitative measure of autistic traits at 18–24 months of age: preliminary report. J Autism Dev Disord 38:1414–1425. doi:10.1007/s10803-007-0509-7
Wetherby AM, Brosnan-Maddox S, Peace V, Newton L (2008) Validation of the Infant-Toddler Checklist as a broadband screener for autism spectrum disorders from 9 to 24 months of age. Autism Int J Res Pract 12:487–511. doi:10.1177/1362361308094501
Swinkels SHN, Dietz C, van Daalen E et al (2006) Screening for autistic spectrum in children aged 14 to 15 months. I: the development of the Early Screening of Autistic Traits Questionnaire (ESAT). J Autism Dev Disord 36:723–732. doi:10.1007/s10803-006-0115-0
Reznick JS, Baranek GT, Reavis S et al (2007) A parent-report instrument for identifying one-year-olds at risk for an eventual diagnosis of autism: the first year inventory. J Autism Dev Disord 37:1691–1710. doi:10.1007/s10803-006-0303-y
Dereu M, Warreyn P, Raymaekers R et al (2010) Screening for autism spectrum disorders in Flemish day-care centres with the checklist for early signs of developmental disorders. J Autism Dev Disord 40:1247–1258. doi:10.1007/s10803-010-0984-0
Honda H, Shimizu Y, Nitto Y et al (2009) Extraction and Refinement Strategy for detection of autism in 18-month-olds: a guarantee of higher sensitivity and specificity in the process of mass screening. J Child Psychol Psychiatry 50:972–981. doi:10.1111/j.1469-7610.2009.02055.x
Barbaro J, Dissanayake C (2010) Prospective identification of autism spectrum disorders in infancy and toddlerhood using developmental surveillance: the social attention and communication study. J Dev Behav Pediatr JDBP 31:376–385. doi:10.1097/DBP.0b013e3181df7f3c
Nygren G, Sandberg E, Gillstedt F et al (2012) A new screening programme for autism in a general population of Swedish toddlers. Res Dev Disabil 33:1200–1210
Gray KM, Tonge BJ (2005) Screening for autism in infants and preschool children with developmental delay. Aust N Z J Psychiatry 39:378–386. doi:10.1111/j.1440-1614.2005.01585.x
Stone WL, Coonrod EE, Ousley OY (2000) Brief report: screening tool for autism in two-year-olds (STAT): development and preliminary data. J Autism Dev Disord 30:607–612
Persson B, Nordstrom B, Petersson K et al (2006) Screening for infants with developmental deficits and/or autism: a Swedish pilot study. J Pediatr Nurs 21:313–324. doi:10.1016/j.pedn.2005.07.004
Eaves RC, Milner B (1993) The criterion-related validity of the Childhood Autism Rating Scale and the Autism Behavior Checklist. J Abnorm Child Psychol 21:481–491
Ward-King J, Cohen IL, Penning H, Holden JJA (2010) Brief report: telephone administration of the autism diagnostic interview—revised: reliability and suitability for use in research. J Autism Dev Disord 40:1285–1290. doi:10.1007/s10803-010-0987-x
Krug DA, Arick J, Almond P (1980) Behavior checklist for identifying severely handicapped individuals with high levels of autistic behavior. J Child Psychol Psychiatry 21:221–229
Schopler E, Reichler RJ, Renner BR (1986) The Childhood Autism Rating Scale (CARS): for diagnostic screening and classification of autism. Irvington, New York
Young RL (2007) Autism detection in early childhood (ADEC) manual. ACER Press, Camberwell, Australia
Matson JL, Fodstad JC, Dempsey T (2009) What symptoms predict the diagnosis of autism or PDD-NOS in infants and toddlers with developmental delays using the Baby and Infant Screen for aUtIsm Traits. Dev Neurorehabil 12:381–388. doi:10.3109/17518420903029501
Matson JL, Fodstad JC, Mahan S (2009) Cutoffs, norms, and patterns of comorbid difficulties in children with developmental disabilities on the Baby and Infant Screen for Children with aUtIsm Traits (BISCUIT-Part 2). Res Dev Disabil 30:1221–1228. doi:10.1016/j.ridd.2009.04.004
Matson JL, Boisjoli JA, Hess JA, Wilkins J (2010) Factor structure and diagnostic fidelity of the Baby and Infant Screen for Children with aUtIsm Traits-Part 1 (BISCUIT-part 1). Dev Neurorehabil 13:72–79. doi:10.3109/17518420903213576
Matson JL, Fodstad JC, Mahan S, Rojahn J (2010) Cut-offs, norms and patterns of problem behaviours in children with developmental disabilities on the Baby and Infant Screen for Children with aUtIsm Traits (BISCUIT-Part 3). Dev Neurorehabil 13:3–9. doi:10.3109/17518420903074887
Oner P, Oner O, Munir K (2013) Three-item direct observation screen (TIDOS) for autism spectrum disorder. Autism Int J Res Pract. doi:10.1177/1362361313487028
Al-Qabandi M, Gorter JW, Rosenbaum P (2011) Early autism detection: are we ready for routine screening? Pediatrics 128:e211–e217. doi:10.1192/bjp.161.6.839
Charman T, Gotham K (2013) Measurement Issues: screening and diagnostic instruments for autism spectrum disorders—lessons from research and practice. Child Adolesc Ment Health 18:52–63. doi:10.1111/j.1475-3588.2012.00664.x
Dietz C, Swinkels S, van Daalen E et al (2006) Screening for autistic spectrum disorder in children aged 14-15 months. II: population screening with the Early Screening of Autistic Traits Questionnaire (ESAT). Design and general findings. J Autism Dev Disord 36:713–722. doi:10.1007/s10803-006-0114-1
Canal-Bedia R, Garcia-Primo P, Martin-Cilleros MV et al (2011) Modified checklist for autism in toddlers: cross-cultural adaptation and validation in Spain. J Autism Dev Disord 41:1342–1351. doi:10.1007/s10803-010-1163-z
Norris M, Lecavalier L (2010) Screening accuracy of Level 2 autism spectrum disorder rating scales. A review of selected instruments. Autism Int J Res Pract 14:263–284. doi:10.1177/1362361309348071
Sunita, Bilszta JLC (2013) Early identification of autism: a comparison of the Checklist for Autism in Toddlers and the Modified Checklist for Autism in Toddlers. J Paediatr Child Health 49:438–444. doi:10.1111/j.1440-1754.2012.02558.x
Cost Action project COST Action BM1004: enhancing the Scientific Study of Early Autism (ESSEA). http://www.cost-essea.com/wg3.html. Accessed 28 Nov 2013
Begeer S, Bouk SE, Boussaid W et al (2009) Underdiagnosis and referral bias of autism in ethnic minorities. J Autism Dev Disord 39:142–148. doi:10.1007/s10803-008-0611-5
Samms-Vaughan ME (2014) The status of early identification and early intervention in autism spectrum disorders in lower- and middle-income countries. Int J Speech Lang Pathol 16:30–35. doi:10.3109/17549507.2013.866271
Herlihy LE, Brooks B, Dumont-Mathieu T et al (2014) Standardized screening facilitates timely diagnosis of autism spectrum disorders in a diverse sample of low-risk toddlers. J Dev Behav Pediatr JDBP 35:85–92. doi:10.1097/DBP.0000000000000014
Daniels AM, Halladay AK, Shih A et al (2014) Approaches to enhancing the early detection of autism spectrum disorders: a systematic review of the literature. J Am Acad Child Adolesc Psychiatry 53:141–152. doi:10.1016/j.jaac.2013.11.002
American Psychiatric Association (2000) Diagnostic and statistical manual of mental disorder: DSM-IV-TR, 4th edn. (text rev.), APA
Mattila ML, Jussila K, Kuusikko S et al (2009) When does the Autism Spectrum Screening Questionnaire (ASSQ) predict autism spectrum disorders in primary school-aged children? Eur Child Adolesc Psychiatry 18:499–509. doi:10.1007/s00787-009-0044-5
Posserud B, Lundervold AJ, Steijnen MC et al (2008) Factor analysis of the Autism Spectrum Screening Questionnaire. Autism 12:99–112. doi:10.1177/1362361307085268
Charman T, Baird G, Simonoff E et al (2007) Efficacy of three screening instruments in the identification of autistic-spectrum disorders. Br J Psychiatry 191:554–559. doi:10.1192/bjp.bp.107.040196
Chandler S, Charman T, Baird G et al (2007) Validation of the social communication questionnaire in a population cohort of children with autism spectrum disorders. J Am Acad Child Adolesc Psychiatry 46:1324–1332. doi:10.1097/chi.0b013e31812f7d8d
Scott FJ, Baron-Cohen S, Bolton P, Brayne C (2002) The CAST (Childhood Asperger Syndrome Test): preliminary development of a UK screen for mainstream primary-school-age children. Autism 6:9–31
Williams J, Scott F, Stott C et al (2005) The CAST (Childhood Asperger Syndrome Test): test accuracy. Autism 9:45–68. doi:10.1177/1362361305049029
Auyeung B, Baron-Cohen S, Wheelwright S, Allison C (2008) The autism spectrum quotient: children’s version (AQ-child). J Autism Dev Disord 38:1230–1240. doi:10.1007/s10803-007-0504-z
Williams J, Allison C, Scott F et al (2006) The Childhood Asperger Syndrome Test (CAST): test-retest reliability. Autism 10:415–427. doi:10.1177/1362361306066612
VanDenHeuvel A, Fitzgerald M, Greiner B, Perry IJ (2007) Screening for autistic spectrum disorder at the 18-month developmental assessment: a population-based study. Ir Med J 100:565–567
Baird G, Charman T, Baron-Cohen S et al (2000) A screening instrument for autism at 18 months of age: a 6-year follow-up study. J Am Acad Child Adolesc Psychiatry 39:694–702. doi:10.1097/00004583-200006000-00007
Oosterling IJ, Swinkels SH, van der Gaag RJ et al (2009) Comparative analysis of three screening instruments for autism spectrum disorder in toddlers at high risk. J Autism Dev Disord 39:897–909. doi:10.1007/s10803-009-0692-9
García Primo P, Santos Borbujo J, Martín Cilleros MV et al (2013) Pervasive developmental disorders screening program in the health areas of Salamanca and Zamora in Spain. An Pediatr Barc Spain 2003. doi:10.1016/j.anpedi.2013.06.030
Stoltenberg C, Schjolberg S, Bresnahan M, Hornig M, Hirtz D, Dahl C et al (2010) The autism birth cohort (ABC): a paradigm for gene-environment-timing research. Mol Psychiatry 15(7):676–680. doi:10.1038/mp.2009.143
Beuker KT, Schjølberg S, Kveim Lie K et al (2013) The structure of autism spectrum disorder symptoms in the general population at 18 months. J Autism Dev Disord 43:45–56. doi:10.1007/s10803-012-1546-4
Glascoe FP (1997) Parents’ concerns about children’s development: prescreening technique or screening test? Pediatrics 99:522–528. doi:10.1542/peds.99.4.522
Coonrod EE, Stone WL (2005) Screening for autism in young children. In: Volkmar FR, Paul R, Klin A, Cohen D (eds) Handbook of autism and pervasive developmental disorder, 3rd edn. John Wiley, Hoboken, NJ, pp 707–729
Pinto-Martin J, Levy SE (2004) Early diagnosis of autism spectrum disorders. Curr Treat Options Neurol 6:391–400
Charman T, Gotham K (2013) Measurement Issues: screening and diagnostic instruments for autism spectrum disorders—lessons from research and practice. Child Adolesc Ment Health 18:52–63. doi:10.1111/j.1475-3588.2012.00664.x
Yirmiya N, Charman T (2010) The prodrome of autism: early behavioral and biological signs, regression, peri- and post-natal development and genetics. J Child Psychol Psychiatry 51:432–458. doi:10.1111/j.1469-7610.2010.02214.x
Williams JG, Higgins JPT, Brayne CEG (2006) Systematic review of prevalence studies of autism spectrum disorders. Arch Dis Child 91:8–15. doi:10.1136/adc.2004.062083
Camp BW (2006) What the clinician really needs to know: questioning the clinical usefulness of sensitivity and specificity in studies of screening tests. J Dev Behav Pediatr JDBP 27:226–230
Kamio Y, Inada N, Koyama T et al (2013) Effectiveness of Using the Modified Checklist for Autism in Toddlers in two-stage screening of autism spectrum disorder at the 18-month health check-up in Japan. J Autism Dev Disord. doi:10.1007/s10803-013-1864-1
Kleinman JM, Robins DL, Ventola PE et al (2008) The modified checklist for autism in toddlers: a follow-up study investigating the early detection of autism spectrum disorders. J Autism Dev Disord 38:827–839. doi:10.1007/s10803-007-0450-9
Pandey J, Verbalis A, Robins DL et al (2008) Screening for autism in older and younger toddlers with the Modified Checklist for Autism in Toddlers. Autism 12:513–535
Akobeng AK (2007) Understanding diagnostic tests 2: likelihood ratios, pre- and post-test probabilities and their use in clinical practice. Acta Paediatr Oslo Nor 1992(96):487–491. doi:10.1111/j.1651-2227.2006.00179.x
Groen WB, Swinkels SH, van der Gaag RJ, Buitelaar JK (2007) Finding effective screening instruments for autism using Bayes theorem. Arch Pediatr Adolesc Med 161:415–416. doi:10.1001/archpedi.161.4.415
Baird G, Simonoff E, Pickles A et al (2006) Prevalence of disorders of the autism spectrum in a population cohort of children in South Thames: the Special Needs and Autism Project (SNAP). Lancet 368:210–215
De Giacomo A, Fombonne E (1998) Parental recognition of developmental abnormalities in autism. Eur Child Adolesc Psychiatry 7:131–136
Chawarska K, Paul R, Klin A et al (2007) Parental recognition of developmental problems in toddlers with autism spectrum disorders. J Autism Dev Disord 37:62–72. doi:10.1007/s10803-006-0330-8
Charman T, Baird G (2002) Practitioner review: diagnosis of autism spectrum disorder in 2- and 3-year-old children. J Child Psychol Psychiatry 43:289–305
Willemsen-Swinkels SH, Buitelaar JK, van Engeland H (2001) Is 18 months too early for the CHAT? J Am Acad Child Adolesc Psychiatry 40:737–738. doi:10.1097/00004583-200107000-00002
Thelen E (1981) Kicking, rocking, and waving: contextual analysis of rhythmical stereotypies in normal human infants. Anim Behav 29:3–11
Carpenter M, Nagell K, Tomasello M (1998) Social cognition, joint attention, and communicative competence from 9 to 15 months of age. Monogr Soc Res Child Dev 63:1–143
Dereu M, Raymaekers R, Warreyn P et al (2012) Can child care workers contribute to the early detection of autism spectrum disorders? A comparison between screening instruments with child care workers versus parents as informants. J Autism Dev Disord 42:781–796. doi:10.1007/s10803-011-1307-9
Scambler D, Rogers SJ, Wehner EA (2001) Can the checklist for autism in toddlers differentiate young children with autism from those with developmental delays? J Am Acad Child Adolesc Psychiatry 40:1457–1463. doi:10.1097/00004583-200112000-00017
Oosterling IJ, Wensing M, Swinkels SH et al (2010) Advancing early detection of autism spectrum disorder by applying an integrated two-stage screening approach. J Child Psychol Psychiatry 51:250–258. doi:10.1111/j.1469-7610.2009.02150.x
Gillberg C (1989) Early symptoms in autism. In: Gillberg C (ed) Diagnosis and treatment of autism. Plenum Press, New York, pp 23–32
Baranek GT (1999) Autism during infancy: a retrospective video analysis of sensory-motor and social behaviors at 9–12 months of age. J Autism Dev Disord 29:213–224. doi:10.1023/A:1023080005650
Rutter M, Bailey A, Lord C (2003) The Social Communication Questionnaire (SCQ), Western Psychological Services
Wiggins LD, Bakeman R, Adamson LB, Robins DL (2007) The Utility of the Social Communication Questionnaire in screening for autism in children referred for early intervention. Focus Autism Dev Disabil 22:33–38. doi:10.1177/10883576070220010401
Chlebowski C, Robins DL, Barton ML, Fein D (2013) Large-scale use of the modified checklist for autism in low-risk toddlers. Pediatrics 131:e1121–e1127. doi:10.1542/peds.2012-1525
Harrington JW, Bai R, Perkins AM (2013) Screening children for autism in an urban clinic using an electronic M-CHAT. Clin Pediatr (Phila) 52:35–41. doi:10.1177/0009922812463957
Robins DL, Casagrande K, Barton M et al (2014) Validation of the Modified Checklist for Autism in Toddlers, revised with follow-up (M-CHAT-R/F). Pediatrics 133:37–45. doi:10.1542/peds.2013-1813
Filipek PA, Accardo PJ, Baranek GT et al (1999) The screening and diagnosis of autistic spectrum disorders. J Autism Dev Disord 29:439–484
Dumont-Mathieu T, Fein D (2005) Screening for autism in young children: the Modified Checklist for Autism in Toddlers (M-CHAT) and other measures. Ment Retard Dev Disabil Res Rev 11:253–262. doi:10.1002/mrdd.20072
Branson D, Vigil DC, Bingham A (2008) Community childcare providers’ role in the early detection of autism spectrum disorders. Early Child Educ J 35:523–530. doi:10.1007/s10643-008-0243-6
National Institute for Health and Clinical Excellence (2011) (NICE) Autism: recognition, referral and diagnosis of children and young people on the autism spectrum
Dyches TT, Wilder LK, Sudweeks RR et al (2004) Multicultural issues in autism. J Autism DevDisord 34:211–222. doi:10.1023/B:JADD.0000022611.80478.73
American Psychiatric Association (2013) Diagnostic and statistical manual of mental disorders: DSM-5. American Psychiatric Association, Arlington
Charman T (2014) Early identification and intervention in autism spectrum disorders: some progress but not as much as we hoped. Int J Speech Lang Pathol 16:15–18. doi:10.3109/17549507.2013.859732
Kasari C (2014) Are we there yet? The state of early prediction and intervention in autism spectrum disorder. J Am Acad Child Adolesc Psychiatry 53:133–134. doi:10.1016/j.jaac.2013.11.007
Volkmar F, Siegel M, Woodbury-Smith M et al (2014) Practice parameter for the assessment and treatment of children and adolescents with autism spectrum disorder. J Am Acad Child Adolesc Psychiatry 53:237–257. doi:10.1016/j.jaac.2013.10.013
Fernell E, Wilson P, Hadjikhani N et al (2014) Screening, intervention and outcome in autism and other developmental disorders: the role of randomized controlled trials. J Autism Dev Disord. doi:10.1007/s10803-014-2070-5
Acknowledgments
The work of Patricia Garcia-Primo and Annika Hellendoorn was supported by a Short Term Scientific Mission (STSM) grant from COST Action BM1004. We wish to thank all ESSEA COST members and the contacted authors of published studies for their invaluable contribution to the collection of data.
Conflict of interest
None.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.
About this article
Cite this article
García-Primo, P., Hellendoorn, A., Charman, T. et al. Screening for autism spectrum disorders: state of the art in Europe. Eur Child Adolesc Psychiatry 23, 1005–1021 (2014). https://doi.org/10.1007/s00787-014-0555-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00787-014-0555-6