Clinical guidelines for severe behavioural problems (SBPs) in children have recently been developed in several European countries. However, questions emerged regarding their applicability to practice. Our study aimed to provide a first European insight into guidelines’ fitness-for-purpose by exploring mental health clinicians’ familiarity with, use and perceived value of guidelines for SBPs in children. Participants included 161 clinicians, primarily psychiatrists, from 24 countries. Clinicians completed a semi-structured qualitative questionnaire on existing SBPs guidelines and development of new guidelines where not available. Clinicians’ responses were mapped against academic experts’ perceptions on SBPs guidelines highlighted in a previous study (Gatej et al. in Eur Psychiatry 57:1–9, 2019). Under half of the clinicians reported being unaware of guidelines. Of these, 37.6% represented countries where guidelines were available according to experts. The remaining half of clinicians who were aware of guidelines on average reported being moderately familiar with their content, perceiving them as moderately useful and using them some of the time. Additionally, 60.8% clinicians agreed that SBPs guidelines need to be developed, as these would create a shared scientific knowledge base and common practice. Guideline improvements included taking a multifactorial approach, creating specific case recommendations, and dissemination efforts. The modest familiarity with and use of guidelines amongst practitioners may highlight guidelines poor fitness-for-purpose, or, alternatively, an underlying confusion around the meaning and purpose of guidelines. Moving forward, efforts should be directed at disseminating clearer definitions of guidelines, addressing existing challenges, and unifying efforts to further develop and audit application of international guidelines for SBPs.
Severe behavioural problems (SBPsFootnote 1) in children aged 6–12 years old, commonly classified as oppositional defiant disorder or conduct disorder, are of great clinical interest, due to their variability in presentation, poor responsiveness to treatment, and impact on functioning . As a result, clinical guidelines for SBPs have been developed across Europe over recent years. Such guidelines intend to facilitate evidence-based clinical decision making and improve practice . One way to evaluate whether guidelines meet their intended purposes is by studying their clinical utility as perceived by the health care clinicians who apply them in practice . In this regard, concerns exist that guidelines provide recommendations that are considered too simplistic or too broad to use in complex individualized care [5,6,7,8]. Consequently, clinicians may either avoid implementing guidelines or, contrarily, abide to guidelines too rigidly and fail to individualize interventions . This article provides a first insight into clinicians’ perspectives on the use and perceived practical value of guidelines for SBPs in children across Europe.
The use and impact of guidelines for common mental health disorders have previously been explored through qualitative interviews with stakeholders, and quantitative reviews on patients’ outcomes and clinicians’ performance. Participants span from community mental health teams [9, 10], to psychiatrists and pediatricians , clinical psychologists , counselling psychologists , and general practitioners [13,14,15]. Overall, use of guidelines appears to be inconsistent [5, 16,17,18]. For instance, Prytys et al.  identified that NICE guidelines for schizophrenia were perceived as difficult to implement by community mental health teams. Reasons included practical limitations such as high caseloads, time pressure, and lack of specialist staff. With regard to the perceived utility of guidelines, clinicians appear to regard them positively, particularly for prioritizing interventions and maintaining high quality of care [5, 10, 19]. However, uncertainty persists over the sustainable clinical benefits of implementing guidelines on patient outcomes [20, 21]. Guidelines’ potential could be maximised if used flexibly to allow for personalized care , and if they accounted for real-world complexities in clinical practice .
The use and perceived utility of guidelines is likely to be influenced by various practitioner and guideline characteristics. Practitioner characteristics include the level of professional training or preferred theoretical frameworks [5, 8, 9, 22,23,24]. Guideline-related factors refer to their definition, availability, dissemination, perceived utility in practice, or comprehensiveness of treatment recommendations [25,26,27,28]. Both practitioner and guideline characteristics have been found to vary across European countries. With regard to the first, differences in duration, content and specialisation pathways of training provided in clinical psychology or psychiatry exist between countries [29,30,31]. Similarly, guidelines are available and perceived as beneficial to different extents across Europe, according to a qualitative study conducted by Gatej et al. . This study explored 28 academic experts’ opinions on guidelines for SBPs across Europe. Academic experts included professors and researchers with either psychiatry or psychology academic backgrounds and a specific professional interest in SBPs. Guidelines for SBPs were identified by experts in 10 out of the 23 European countries included (Fig. 1). Experts highlighted that although numerous guidelines across countries are based on the same evidence, they promote different recommendations, creating confusion amongst clinicians [25, 32]. Critical improvements mentioned by the experts included adding recommendations for complex cases, dissemination, including publicity campaigns and staff training in recommended methods . Experts’ opinions on SBPs guidelines was the first evaluation of this kind for this group of disorders . Inadvertently, this highlights a gap in knowledge on how available guidelines are perceived in clinical practice by professionals who are recommended to use them.
Consequently, as a primary aim, the current study contributes to filling this gap by collecting mental health clinicians’ opinions on the awareness and usability of guidelines. More specifically, we distinguished two groups:
Clinicians who were aware of SBPs guidelines; in this subgroup, their familiarity with, use, perceived utility and critical needs for improvement were explored; and,
clinicians who were not aware of SBPs guidelines; in this subgroup, their perceptions on the need for developing such guidelines in their countries were gathered.
As a secondary aim, clinicians’ awareness of SBPs guidelines was mapped against the preliminary overview of available guidelines constructed through academic experts’ opinions  to provide a broader context on guidelines awareness. Finally, experts’ opinions on guidelines improvement were integrated with clinicians’ perceptions on challenges and needs to summarise key suggestions for improving guidelines.
Recruitment and participants
European mental health clinicians with experience in diagnosing and/or treating SBPs in children were recruited for this study. National and European associations, including Kenniscentrum KJP, the European Society of Child and Adolescent Psychiatry (ESCAP), and the European Association for Forensic Child and Adolescent Psychiatry (EFCAP) were contacted to identify participants. Finally, the first author screened research publications on childhood aggression, online professional websites of child mental health services, and evidence-based programs for SBPs (e.g., The Incredible Years) for suitable clinicians. Over a period of 10 months, 500 clinicians from 30 European countries were directly invited and 14 national networks for child and adolescent psychiatry and allied professionals across Europe (e.g., Royal College of Psychiatrists in the UK) shared a public invitation to the study. Of these, 183 clinicians provided responses, in English. However, 22 clinicians were excluded due to incomplete answers. The final sample consisted of 161 clinicians from 24 European countries (see Online Resource 1; Online Resource 2). Participant characteristics are described in Table 1. Clinicians were included or could self-include if they had experience working with SBPs in children aged 6–12.
A brief semi-structured qualitative questionnaire was developed for this study. First, the authors formulated a definition of SBPs based on descriptions of conduct disorder and childhood aggression in the clinical literature [33,34,35]. A dimensional framework to define SBPs was preferred over categorical diagnoses to account for differences between their conceptualization and diagnostic manual systems used across Europe, a more detailed rationale being presented in our previous paper . Thus, SBPs in childhood (6–12 years) were placed at the severe end of the behavioural disorder continuum, and referred to persistent and severe aggressive, hostile, oppositional, and destructive behaviours, impairing functioning across domains (e.g., family, peer relationships, school). SBPs are virtually equivalent to the more popular ‘disruptive behaviour disorders’ (DBDs) as used up to DSM-5. However, SBPs were preferred for several reasons: they draw focus on the severe end of the spectrum and do not exclude commonly encountered comorbidities (e.g., ADHD, ASD, [36,37,38]). In addition, DSM-5 explicitly no longer combines ODD and CD into DBDs]. Second, the authors discussed current issues in clinical practice in several brainstorming meetings, to inform the content of the questionnaire. The questionnaire was further checked by an independent qualitative research expert from Leiden University Medical Centre. Based on their recommendations, the first author extracted and adapted questions from a generic questionnaire on implementation research developed by Huijg and colleagues . For instance, the “Knowledge” dimension of the questionnaire was adapted to investigate clinicians’ awareness of and familiarity with guidelines for SBPs (e.g., “I am familiar with the content and objectives of [innovation/guideline]”; ). Next, the survey was piloted on nine European clinicians from different countries (41 invited, response rate 21.42%). Their responses reflected good understanding of the content of the questions.
The main section of the questionnaire explored clinicians’ awareness and evaluations of official national guidelines and/or unofficial documents for SBPs. Perceived familiarity with, frequency of use and usefulness of guidelines in practice were rated using a 1–7 Likert point scale (e.g., 1—Not at all familiar, 7—Extremely familiar). An open-ended question explored the critical needs associated with these guidelines. When clinicians were not aware of guidelines, the need for developing such guidelines was explored via an open-ended question. Finally, the questionnaire included a list of demographic questions on the place of work, years of experience, and academic backgrounds. The questionnaire is available as supplementary material (see Online Resource 3).
The online platform NETQ was used to collect and store responses. Clinicians were invited to participate via an email including a link to the electronic questionnaire. Three weekly email reminders were sent if no response was recorded. This was followed by a 2-week break in contact and a final email. Due to initial difficulties in obtaining responses, invitation and reminder emails were subsequently translated in clinicians’ native languages by native-speaking students enrolled in bachelor or master psychology courses. Responses were only seen by the authors and were averaged over many respondents to ensure anonymity. The project was run as part of the ACTION consortium on childhood aggression .
Responses were separated into two categories, based on clinicians’ awareness of guidelines. The first category included clinicians who indicated being aware of guidelines. For this subsample, mean values were calculated for familiarity, use, and perceived utility of guidelines in practice, followed by a correlational analysis in SPSS. Additionally, thematic analysis was conducted to analyse clinicians’ opinions of critical needs related to guidelines . The second category included clinicians who were unaware of guidelines. This subsample only reported on the need for developing guidelines through an open-ended question. The thematic analysis process consisted of several steps. Responses were first screened to subtract themes. All emerging themes were then coded numerically and described briefly (e.g., Code 1: ‘applicability to practice’). Finally, responses were re-evaluated against the identified themes leading to alterations to the description and breadth of the themes until all responses were exhaustively represented. Each occurrence of a sub-theme was then tallied (see  for a more detailed description of the thematic analysis and coding processes). All data were analysed by the first author, and a second author (A.L.) independently reviewed 25% of the open-ended questions data. After reaching a 90% agreement, remaining discrepancies at sub-theme levels were discussed and resolved in a telephone meeting.
As a final analysis, clinicians’ awareness of guidelines was mapped against an inventory on the status of clinical guidelines provided by academic experts in a previous study . Moreover, experts’ suggestions on critical needs about guidelines was added to those of the clinicians to create an overview of essential elements for future guidelines development and improvement. Descriptive statistics were used to analyse demographics.
Responses (N = 161) were divided into two categories based on clinicians’ awareness of guidelines. The first results included clinicians who reported being aware of available guidelines for SBPs their countries (n = 87, 54%). Of these, some named specific official guidelines such as the NICE guidelines in the UK, or translations of the official guidelines into practical working methods by the Kenninscentrum KJP in the Netherlands (n = 19), whereas others referred to the generic term ‘guidelines’ (n = 3). Several clinicians specifically referred to books, treatment protocols, articles, DSM IV and ICD-10 (n = 10). However, guidelines are commonly defined as a set of assessment and treatment recommendations based on systematic evidence reviews and multidisciplinary expert considerations [42, 43]. Books, treatment protocols and diagnostic manuals do not fit within such definition of guidelines. Consequently, these along with their corresponding answers were excluded from further analysis of perceived familiarity, use and critical needs. The second category included the remaining clinicians who reported being unaware of guidelines for SBPs (n = 74, 46%). A distribution of clinicians’ awareness of guidelines within countries across Europe is provided in Fig. 2.
Familiarity with, use and perceived utility of official guidelines
The 77 clinicians who were aware of guidelines indicated they were on average somewhat familiar with their content (4.9, where 1—Not at all familiar, and 7—Extremely familiar), used the guidelines some of the time (4.3, where 1—Never and 7—Always), and perceived them as moderately useful for practice (4.2, where 1—Not useful at all, and 7—Extremely useful; see also Table 2). A strong positive correlation was found between familiarity with and use of guidelines in practice, r = 0.64, p < 0.001. Similarly, familiarity with and perceived utility of guidelines in practice were positively correlated, r = 0.43, p < 0.001 (2-tailed). Finally, use and perceived utility of guidelines were strongly positively correlated, r = 0.60, p < 0.001 (2-tailed). In sum, the more familiar clinicians were with the guidelines, the more often they would implement them in practice, and the more useful they perceive them.
Critical needs and suggestions to improve SBPs guidelines
Of the 77 clinicians aware of guidelines, a third shared their views on needs to improve these guidelines (n = 28). Of these, a minority (n = 3) stated that existing guidelines do not require changes. The remaining clinicians who articulated needs (n = 25) stressed the importance of increasing their applicability to daily practice, using multi-systemic and multi-agency collaboration, revising medication recommendations, adding instructions for specific cases/factors which could be more easily tailored to individual formulations, and adapting them to local resources. An outline of the most frequently mentioned critical needs highlighted by clinicians is included in Table 3. Several critical needs have also been highlighted by a single respondent, including using numerous therapeutic frameworks, a multifactorial approach to conceptualising the complex basis of SBPs, and more funding to improve implementation.
Need for developing guidelines
Of the total of 74 clinicians unaware of guidelines, 60.8% were in support of developing official clinical guidelines (n = 45), 6.7% reported that such guidelines were in process of being developed (n = 5), 12.2% disagreed (n = 9), and 6.7% were unsure (n = 5). The remaining 13.5% clinicians (n = 10) did not provide an answer. Only 15 clinicians provided arguments for and against developing guidelines (Table 4). The most frequently endorsed benefits of developing guidelines included the support offered with diagnosis, standardising conceptualisation and treatment of SBPs and promotion of evidence-based practices. Several benefits mentioned by a single respondent included improving access to treatment, taking responsibility across services and reducing costs at society level. On the other hand, shortcomings of guidelines have also been mentioned, the most common highlighting the complexity of presentations and need for personalised care and limited added value to practice. Other concerns mentioned by individual clinicians included the need for more research and risks of overmedicalisation.
Clinicians’ versus experts’ reports on awareness of and critical improvements for guidelines for SBPs
For the countries where both clinician and expert data were collected, current clinical reports on SBPs guidelines were compared with experts reports gathered in our previous study [1; Table 5; see also Online Resource 4]. This resulted in ten clinicians being excluded from this comparison, as they represented countries where no expert data were collected. Guidelines for SBPs were identified by experts in 10 out of the 23 European countries included. In one of these 10 countries, no clinician data were collected, leading to its exclusion from further comparisons. Mapping the results identified by experts onto the clinicians’ sample, 101 clinicians represented the nine countries where guidelines were previously identified by experts . Of this subsample, 62.4% indicated being aware of guidelines (n = 63, of which n = 4 explicitly referred to documents and reports), and the remaining 37.6% being unaware (n = 38). The remaining 50 clinicians represented countries where guidelines were not identified by experts in the previous report . Of these clinicians, 42% reported being aware of existing guidelines in their countries (n = 21). Table 5 highlights existing differences between clinicians within the same country on knowledge about available guidelines. Finally, clinical and expert opinions on future critical needs and improvements of SBPs guidelines were merged and are illustrated in Fig. 3.
The primary aim of this study was twofold: (1) exploring mental health clinicians’ awareness, use, perceptions and critical needs of guidelines for SBPs in children where clinicians were aware of guidelines in their country; and (2) collecting perceptions on the need for developing guidelines where not yet available. As a secondary aim, the paper studied a broad, multi-informant perspective on awareness and action plan for improvement of guidelines by mapping answers from clinicians onto previously collected views from experts. A total of 161 clinicians across Europe completed a semi-structured questionnaire. When clinicians indicated that guidelines were available, they provided self-ratings of their awareness, familiarity with, perceived utility and use of such guidelines, as well as reported on critical needs and improvements through open-ended questions. When unavailable, clinicians reported on the advantages and disadvantages of developing such guidelines through an additional open-ended question. Finally, clinician responses were merged with reflections on guidelines expressed by academic experts in our previous study. In line with the primary aim, two key sets of findings are highlighted:
46% of the clinicians were unaware of guidelines existing in their countries, and of the ones that were aware, 37.6% did not use them in practice. Familiarity, use, and perceived utility of guidelines were rated within the moderate range. Higher familiarity was associated with more frequent use and higher perceived utility. Moreover, clinicians identified several critical needs to improve guidelines’ applicability to practice. Content-related needs included specific case recommendations, discussing a range of therapeutic and theoretical frameworks (e.g., pharmacological, behavioural etc.), and promoting use of a multifactorial approach to assessment/treatment. At implementation level, more focus on systemic, multi-agency work, more tailoring to local practices, and increased funding were called for.
60.8% of the clinicians agreed for national guidelines to be developed, while only 12.2% disagreed. These were believed to support diagnosis, create a shared scientific base for prevention and treatment, lower society costs, and standardise treatment. Barriers to completing this process stemmed from the variability in symptoms, causes and factors defining and leading to SBPs which argue for a personalised approach to treatment.
The first key findings highlight that that 46% of clinicians were unaware of guidelines. This percentage is higher than in previously reported studies (e.g., 9% of mental health clinicians reported as being unaware of guidelines in the Netherlands; ). Moreover, implementation issues emerged in this study, with 37.6% of the clinicians not using guidelines despite being aware of them. This reflects existing concerns about inconsistent guideline implementation amongst community mental health teams (e.g., on schizophrenia , depression ), clinical psychologists , psychiatrists and paediatricians , general practitioners [13, 14] and by guideline development groups .
The lower awareness rate observed in this study could be explained through different lenses. First, it may indicate an actual lack of guidelines for SBPs around Europe, an issue that has also been highlighted by academic experts in our previous study . Similarly, it could be an artefact of the complex nature of SBPs, as awareness of guidelines rates seems to vary across mental health conditions. For example, previous research identified that general practitioners awareness of guidelines depended on the targeted condition: post-traumatic stress disorder: 55%, ; obsessive compulsive disorders: 49%, ; depression: 95%, [14, 45]. Alternatively, given the large number of diagnostic groups and therapeutic guidelines available in the literature, it is likely that clinicians are unable to stay informed over the most recent developments on all guidelines available. Moreover, as more clinicians stir away from current DSM 5 or ICD-11 diagnostic classifications towards transdiagnostic and formulation-driven approaches to treatment [46, 47], which may be particularly helpful in accounting for the multifactorial basis of SBPs, they may drive away from using diagnostic-targeted guidelines. To this end, efforts could be directed at disseminating incorporation of guidelines into formulations and increasing access to or training in user-friendly, summarised guidelines. Another explanation for the low rates of awareness observed in this study may point to clinicians’ approaches and incompatibility with guidelines, as highlighted in past research [5, 8, 9, 22,23,24]. However, the low awareness level may also be caused by a lack of clear understanding of what guidelines are and how they can be used effectively. Indeed, our further findings highlight that guidelines need adjustments such as more specific case recommendations and taking a more systemic, multi-agency work implementation approach to maximise their use. This finding matches previous research which identified that features of the guidelines themselves such as clarity, or comprehensiveness of treatment recommendations may influence clinicians’ uptake of guidelines [25,26,27,28]. Given the positive correlations found between familiarity with, use and perceived utility of guidelines, clinicians may thus need longer time to familiarize themselves with implementing guidelines [5, 48].
The second key set of findings focuses on arguments in favour of and barriers to developing national guidelines, where such guidelines are not yet available, as reported by clinicians in this study. Most clinicians were in favour of developing national guidelines for SBPs. Advantages highlighted by clinicians included the support offered with diagnosis, standardising conceptualisation and treatment of SBPs and promotion of evidence-based practices. However, clinicians emphasised challenges this process would need to address, including improving guidelines’ content and implementation to increase practical value (e.g., see also [8, 10, 11]). Simple, summarised guidelines containing recommendations on multifactorial, multi-systemic, interagency work would more closely, resemble daily practice and allow for needs-tailored patient care, critical challenges emphasised both by clinicians in this study and in previous reports [8, 19, 26, 49].
In line with the secondary aim, we merged clinician and expert reports to compare guidelines’ awareness between the two groups and highlight shared and unique critical improvements for already-existing guidelines. Findings indicated that 37.6% of the clinicians were unaware of guidelines where these were available according to experts’ knowledge. In reverse, another 42% of the clinicians were aware of guidelines where these were not available according to experts . Moreover, clinicians have endorsed diagnostic manuals such as DSM IV and ICD-10 as guidelines. Contradictions in awareness between experts and clinicians as well as diagnostic manuals being endorsed could indicate that professionals across Europe may have different understandings of what clinical practice guidelines are. Nevertheless, some consensus was reached on challenges to current guidelines, particularly about further inclusion of recommendations on specific cases, funding, and training/dissemination.
Overall, where SBPs guidelines are available, it becomes apparent that experts and clinicians alike perceive them to be valuable to practice. Similarly, both groups of respondents called for improvements with regard to their content and implementation. Where SBPs guidelines are not available, enthusiasm has been expressed over developing new guidelines. Learning from models of international standards for clinical research , one critical next step may be the development of European or international guidelines for SBPs, using expertise built in several countries, supervision from wider agencies such as WHO or ESCAP, and action plans for improvements such as the one presented in Fig. 3. Such guidelines would improve harmonisation of recommendations as they would draw on a ‘meta’ summary of all research available on the topic and international expertise. Developing international guidelines could particularly benefit clinicians in small or low-income countries where lack of resources and expertise may limit the development of national guidelines . However, developing such guidelines is only the first step towards solving existing challenges. What needs to follow is translation and dissemination of guidelines recommendations amongst countries, particularly to address the potential lack of consensus over the definition of guidelines highlighted in this study. Dissemination should be accompanied by national audits and service evaluations on uptake in practice which would further shape revisions of recommendations and perhaps inform the development of national guidelines, tailored to local practices, cultures, legal and medical systems. Developing guidelines that are simultaneously informed by ‘global’ expertise and applicable to ‘local’ contexts is thus a stepped process that requires unified and collaborative transactions between professionals involved in managing SBPs, negotiations between countries, and commitment from all stakeholders to maintain the cycle of disseminating, applying, evaluating and tailoring guidelines to the ever-changing climate of conceptualising and treating emotional and behavioural disorders. Whether this plan is feasible given the variability in presentations and complex biopsychosocial nature of SBPs is yet to be explored.
Nevertheless, this study has several limitations. First, most clinicians did not provide names for the guidelines referring to and some mentioned diagnostic manuals or articles. This indicates that clinicians may have different understandings of guidelines, some of which are not correct, calling for professionalisation on what guidelines are and how they can be used. Future studies could provide definitions of guidelines prior to data collection, more explicitly seek to source the documents clinicians evaluate, or provide a guideline prototype for clinicians to assess. As no comprehensive audit of guidelines was conducted in this study, the comparison between academic experts and clinician reports is only indicative of potential guidelines’ use as it relies heavily on subjective knowledge. Second, this study involved clinicians with different professional backgrounds. This may have masked discrepancies between professions over their uptake and use of guidelines in practice [8, 9, 23, 24]. Finally, the study highlighted existing challenges in identifying and recruiting clinicians working with SBPs. Using volunteers and taking a cross-cultural approach increases selection bias due to barriers such as language skills, querying whether the identified awareness and use estimates truly reflect rates amongst practitioners less involved in research and posing threats to the representativeness of the outcomes. Audits assessing clinicians’ awareness of guidelines conducted locally could feed into large-scale audits to provide more realistic rates of such awareness and use of guidelines in practice.
To conclude, awareness and familiarity with guidelines for SBPs in children are at best modest amongst mental health clinicians. Moreover, of those who know about their availability, a substantial number do not use them. This may reflect guidelines being poorly applicable to daily practice. Alternatively, it may reveal an underlying confusion around the meaning and purpose of guidelines. To this end, clear definitions of what guidelines are and how they can be effectively used should be disseminated amongst clinicians. Feedback and current challenges identified by clinicians and academic experts should be addressed to improve guidelines fitness-for-purpose or shall international guidelines be developed.
Severe behavioural problems (SBPs) in this study referred to persistent and severe aggressive, hostile, oppositional, and destructive behaviours, impairing functioning across domains (e.g., family and peer relationships). The definition was formulated by the authors as described in a previous study  and is used as an alternative to descriptions such as ‘disruptive behaviour disorders’ to draw focus on the severe end of the behaviour disorders spectrum and allow for a broader inclusion of behaviours characterising a range of diagnostic categories (ie., ODD, CD, ADHD).
Gatej A-R, Lamers A, Van Domburgh L, Crone M, Ogden T, Rijo D et al (2019) Awareness and perceptions of clinical guidelines for the diagnostics and treatment of severe behavioural problems in children across Europe: a qualitative survey with academic experts. Eur Psychiatry 57:1–9. https://doi.org/10.1016/j.eurpsy.2018.12.009
Lahey BB, Waldman ID (2012) Annual research review: phenotypic and causal structure of conduct disorder in the broader context of prevalent forms of psychopathology. J Child Psychol Psychiatry 53:536–557
National Institute for Health and Clinical Excellence (2013) Antisocial behaviour and conduct disorders in children and young people: recognition, intervention and management. Nice Clinical Guideline. https://www.nice.org.uk/guidance/cg158. Accessed 18 Mar 2018
Carr A (2016) Clinical child psychology. In: APA handbook of clinical psychology: roots and branches, vol 1. pp 59–80
Court AJ, Cooke A, Scrivener A (2017) They’re NICE and neat, but are they useful? A grounded theory of clinical psychologists’ beliefs about and use of NICE guidelines. Clin Psychol Psychother 24(4):899–910
Kung J, Miller RR, Mackowiak PA (2012) Failure of clinical practice guidelines to meet Institute of Medicine Standards: two more decades of little, if any, progress. Arch Intern Med 172(21):1628–1633
Scott IA, Guyatt GH (2014) Suggestions for improving guideline utility and trustworthiness. Evid Based Med 19:41–46
Franx G, Niesink P, Swinkels J, Burgers J, Wensing M, Grol R (2011) Ten years of multidisciplinary mental health guidelines in the Netherlands. Int Rev Psychiatry 23:371–378
Rhodes L, Genders R, Owen R, O’Hanlon K, Brown JSL (2010) Investigating barriers to implementation of the NICE guidelines for depression: a staff survey with community mental health teams. J Psychiatr Ment Health Nurs 17(2):147–151
Prytys M, Garety PA, Jolley S, Onwumere J, Craig T (2011) Implementing the NICE guideline for schizophrenia recommendations for psychological therapies: a qualitative analysis of the attitudes of CMHT staff. Clin Psychol Psychother 18(1):48–59
Kovshoff H, Williams S, Vrijens M, Danckaerts M, Thompson M, Yardley L et al (2012) The decisions regarding ADHD management (DRAMa) study: uncertainties and complexities in assessment, diagnosis and treatment, from the clinician’s point of view. Eur Child Adolesc Psychiatry 21(2):87–99
Hemsley C (2013) An enquiry into how counselling psychology in the UK is constructed as a profession within discipline-orientated publications. Couns Psychol Rev 28(1):8–23. https://search.ebscohost.com/login.aspx?direct=true&db=a9h&AN=91893869&site=ehost-live
Ehlers A, Gene-Cos N, Perrin S (2009) Low recognition of post-traumatic stress disorder in primary care. Lond J Prim Care (Abingdon) 1:36–42
Gyani A, Pumphrey N, Parker H, Shafran R, Rose S (2012) Investigating the use of NICE guidelines and IAPT services in the treatment of depression. Mental Health Fam Med 9(3):149–160
Gyani A, Shafran R, Rose S (2012) Are the NICE guidelines for obsessive compulsive disorder being used in primary care? Prim Health Care Res Dev 13(1):92–97
Leng G, Baillie N, Raj T (2008) NICE guidance and mental health: Supporting change. Psychol Psychother Theory Res Pract. 81(4):351–364
Lewis C, Buffham K, Evenson E (2012) The implementation of the psychological recommendations in the NICE guideline for schizophrenia (2009) across two CMHT’s: a service evaluation. Clin Psychol Forum 237:31–35
Pawel D, Mankiewicz PD, Turner C (2012) Do assertive outreach clients with experiences of psychosis receive the NICE recommended cognitivebehavioural interventions? An audit. Clin Psychol Forum 240:32–37
Smolders M, Laurant M, Van Duin D, Wensing M, Grol R (2006) Werken met richtlijnen Beïnvloedende factoren bij het handelen volgens de multidisciplinaire richtlijnen angststoornissen en depressie. [Working with guidelines: factors influencing professional performance according to the multidisciplinary guidelines fo. MGV 61:1018–1030
Bighelli I, Ostuzzi G, Girlanda F, Cipriani A, Becker T, Koesters M, et al (2016) Implementation of treatment guidelines for specialist mental health care. Cochrane Database Syst 15:60. https://doi.org/10.1002/14651858.CD009780.pub3
Barbui C, Girlanda F, Ay E, Cipriani A, Becker T, Koesters M (2014) Implementation of treatment guidelines for specialist mental health care. Schizophr Bull 40(4):737–739
Association AP (2002) Criteria for evaluating treatment guidelines. Am Psychol 57(12):1052–9. https://www.apa.org/practice/guidelines/index.aspx%5Cnfile://s/Research and Academics/PROGRAM DEPARTMENTAL ADMINISTRATION/Reference Materials/Laura’s References/APA 2002 Guideline Evaluation REPORT.pdf%5Cnfile://s/Research and Academics/PROGRAM DEPARTMENTA
Ince P, Haddock G, Tai S (2016) A systematic review of the implementation of recommended psychological interventions for schizophrenia: Rates, barriers, and improvement strategies. Psychol Psychother Theory Res Pract 89:324–350
Morriss R (2008) Implementing clinical guidelines for bipolar disorder. Psychol Psychother 81(Pt 4):437–58. https://www.ncbi.nlm.nih.gov/pubmed/18215339
Saddichha S, Chaturvedi SK (2014) Clinical practice guidelines in psychiatry: more confusion than clarity? A critical review and recommendation of a unified guideline. ISRN Psychiatry 2014:828917. https://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=4003831&tool=pmcentrez&rendertype=abstract
Samalin L, Guillaume S, Auclair C, Llorca PM (2011) Adherence to guidelines by French psychiatrists in their real world of clinical practice. J Nerv Ment Dis 199(4):239–243
Solberg LI, Brekke ML, Fazio CJ, Fowles J, Jacobsen DN, Kottke TE et al (2000) Lessons from experienced guideline implementers: attend to many factors and use multiple strategies. Jt Comm J Qual Improv 26(4):171–188
Nakayama T, Budgell B, Tsutani K (2003) Confusion about the concept of clinical practice guidelines in Japan: on the way to a social consensus. Int J Qual Health Care 15(4):359–360
Brittlebank A, Hermans M, Bhugra D, Pinto da Costa M, Rojnic-Kuzman M, Fiorillo A et al (2016) Training in psychiatry throughout Europe. Eur Arch Psychiatry Clin Neurosci 266(2):155–164
Huey DA, Britton PG (2002) A portrait of clinical psychology. J Interprofessional Care 16(1):69–78
Gama Marques J, Pantovic Stefanovic M, Mitkovic-Voncina M, Riese F, Guloksuz S, Holmes K et al (2016) Equal access for all? Access to medical information for European psychiatric trainees. Psychiatry Res 238:150–152
Moriana JA, Gálvez-Lara M, Corpas J (2017) Psychological treatments for mental disorders in adults: a review of the evidence of leading international organizations. Clin Psychol Rev 54:29–43
American Psychiatric Association, Of M, Disorders M (2013) Diagnostic and statistical manual of mental disorders: DSM-5. Arlington. https://www.sciencetheearth.com/uploads/2/4/6/5/24658156/dsm-v-manual_pg490.pdf
Carr A (2016) The handbook of child and adolescent clinical pscyhology: a contextual approach, 3rd edn. Routledge, New York
World Health Organization (1992) The ICD-10 classification of mental and behavioural disorders. Int Classif 10:1–267
Connor DF, Steeber J, McBurnett K (2010) A review of attention-deficit/hyperactivity disorder complicated by symptoms of oppositional defiant disorder or conduct disorder. J Dev Behav Pediatr 31(5):427–40. https://www.ncbi.nlm.nih.gov/pubmed/20535081
Schoorl J, Van Rijn S, De Wied M, Van Goozen SHM, Swaab H (2016) Variability in emotional/behavioral problems in boys with oppositional defiant disorder or conduct disorder: the role of arousal. Eur Child Adolesc Psychiatry 25(8):821–830
Pijper J, de Wied M, van Rijn S, van Goozen S, Swaab H, Meeus W (2018) Executive attention and empathy-related responses in boys with oppositional defiant disorder or conduct disorder, with and without comorbid anxiety disorder. Child Psychiatry Hum Dev 49(6):956–965
Huijg JM, Gebhardt WA, Crone MR, Dusseldorp E, Presseau J (2014) Discriminant content validity of a theoretical domains framework questionnaire for use in implementation research. Implement Sci 9(1):11–26
Mauri M, Montis M. Aggression in Children: unravelling gene-environment interplay to inform Treatment and InterventiON Strategies. https://www.action-euproject.eu/
Maguire M, Delahunt B (2017) Doing a thematic analysis: a practical, step-by-step guide for learning and teaching scholars. Irel J Teach Learn High Educ 9(3):3351–3354
Kredo T, Bernhardsson S, Machingaidze S, Young T, Louw Q, Ochodo E et al (2016) Guide to clinical practice guidelines: the current state of play. Int J Qual Health Care 28(1):122–128
Graham R, Mancher M, Miller Wolman D, Greenfield S, Steinberg E (2011) Guidelines C on S for DTCP, et al. Clinical practice guidelines we can trust. Clin Pract Guidel Trust. https://www.ncbi.nlm.nih.gov/pubmed/24983061
Sinnema H, Franx G, van ’t Land H, Trendrapportage GGz (2009) Multidisciplinaire richtlijnen in de GGz. Themarapportage. [Reporting Trends in Mental Healthcare 2009. Multidisciplinary Guidelines in Mental Healthcare. Utrecht; 2009
Toner R, Snape C, Acton S, Blenkiron P (2010) Do general practitioners adhere to NICE guidelines for depression? Systematic questionnaire survey. Prim Health Care Res Dev 11(2):123–131
Johnstone L (2018) Psychological formulation as an alternative to psychiatric diagnosis. J Humanist Psychol 58:30–46
Vanheule S (2017) Psychiatric diagnosis revisited: from DSM to clinical case formulation. Palgrave Macmillan, Cham
Forsner T, Hansson J, Brommels M, Wistedt AA, Forsell Y (2010) Implementing clinical guidelines in psychiatry: a qualitative study of perceived facilitators and barriers. BMC Psychiatry 10:8. https://www.ncbi.nlm.nih.gov/pubmed/20089141%5Cn. https://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=PMC2822755
Keuken DG, Haafkens JA, Moerman CJ, Klazinga NS, Ter Riet G (2007) Attention to sex-related factors in the development of clinical practice guidelines. J Women’s Health 16(1):82–92
Ravinetto R, Tinto H, Diro E, Okebe J, Mahendradhata Y, Rijal S et al (2016) It is time to revise the international good clinical practices guidelines: recommendations from non-commercial North–South collaborative trials. BMJ Glob Health 1:e0001222
We would like to thank Dr. Matty Crone for her contribution to the revision of the questionnaire, as an independent academic. This work was supported by ACTION (Aggression in Children: unravelling gene-environment interplay to inform Treatment and InterventiON strategies), funded under the European Union Seventh Framework Program (FP7/2007-2013) [Grant number 602768].
Conflict of interest
The authors declare that they have no conflict of interest. The manuscript does not contain clinical studies or patient data.
Electronic supplementary material
Below is the link to the electronic supplementary material.
About this article
Cite this article
Gatej, AR., Lamers, A., van Domburgh, L. et al. Perspectives on clinical guidelines for severe behavioural problems in children across Europe: a qualitative study with mental health clinicians. Eur Child Adolesc Psychiatry 29, 501–513 (2020). https://doi.org/10.1007/s00787-019-01365-x
- Conduct disorder
- Childhood aggression
- Clinical practice guidelines
- Mental health clinicians
- Qualitative study
- European survey