Monitoring quality and coverage of harm reduction services for people who use drugs: a consensus study
Background and aims
Despite advances in our knowledge of effective services for people who use drugs over the last decades globally, coverage remains poor in most countries, while quality is often unknown. This paper aims to discuss the historical development of successful epidemiological indicators and to present a framework for extending them with additional indicators of coverage and quality of harm reduction services, for monitoring and evaluation at international, national or subnational levels. The ultimate aim is to improve these services in order to reduce health and social problems among people who use drugs, such as human immunodeficiency virus (HIV) and hepatitis C virus (HCV) infection, crime and legal problems, overdose (death) and other morbidity and mortality.
Methods and results
The framework was developed collaboratively using consensus methods involving nominal group meetings, review of existing quality standards, repeated email commenting rounds and qualitative analysis of opinions/experiences from a broad range of professionals/experts, including members of civil society and organisations representing people who use drugs. Twelve priority candidate indicators are proposed for opioid agonist therapy (OAT), needle and syringe programmes (NSP) and generic cross-cutting aspects of harm reduction (and potentially other drug) services. Under the specific OAT indicators, priority indicators included ‘coverage’, ‘waiting list time’, ‘dosage’ and ‘availability in prisons’. For the specific NSP indicators, the priority indicators included ‘coverage’, ‘number of needles/syringes distributed/collected’, ‘provision of other drug use paraphernalia’ and ‘availability in prisons’. Among the generic or cross-cutting indicators the priority indicators were ‘infectious diseases counselling and care’, ‘take away naloxone’, ‘information on safe use/sex’ and ‘condoms’. We discuss conditions for the successful development of the suggested indicators and constraints (e.g. funding, ideology). We propose conducting a pilot study to test the feasibility and applicability of the proposed indicators before their scaling up and routine implementation, to evaluate their effectiveness in comparing service coverage and quality across countries.
The establishment of an improved set of validated and internationally agreed upon best practice indicators for monitoring harm reduction service will provide a structural basis for public health and epidemiological studies and support evidence and human rights-based health policies, services and interventions.
KeywordsSubstance abuse People who use drugs/PWUD People who inject drugs/PWID Injecting drug users/IDU Best practice Harm reduction Knowledge exchange Interventions Indicators Coverage Epidemiology HIV HCV Monitoring Evidence-based Drug services
European Monitoring Centre for Drugs and Drug Addiction
Global Research Network
Hepatitis B virus
Hepatitis C virus
Human immunodeficiency virus
Methicillin-resistant staphylococcus aureus
National Institute on Drug Abuse
Needle and syringe programmes
Nomenclature of Territorial Units for Statistics
Opioid agonist therapy
People who inject drugs
People who use drugs
Réseau Européen d́Information sur les Drogues et les Toxicomanies
The Joint United Nations Programme on HIV/AIDS
World Health Organization
Important advances in interventions for people who use drugs (PWUD), in particular those who use opioids and people who inject drugs (PWID), have occurred over recent decades. Harm reduction services such as needle and syringe programmes (NSP) and opioid agonist therapy (OAT)  have been increasingly established, with 90 countries having NSP to some degree and 80 at least one OAT programme operational by 2016 . This has contributed to reductions in viral infections (e.g. human immunodeficiency virus (HIV), hepatitis C virus (HCV)) and bacterial infections (e.g. tuberculosis (TB), sexually transmissible infections, skin infections), crime, overdose and mortality among PWUD. Health cost savings are being achieved globally, where harm reduction is in place, especially where these services are combined with antiretroviral therapy (ART), allowing millions of people living with HIV to stay healthy [3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15]. The provision of naloxone, a drug to reverse overdose, has expanded from paramedics to drug workers and to PWUD themselves and their peers [16, 17, 18]. Treatments for infectious diseases (e.g. HIV, hepatitis B virus (HBV)) and new direct-acting antiviral (DAA) treatments for HCV, when available, are having large effects on survival and quality of life and have opened new avenues for effective prevention [19, 20, 21, 22]. Evidence on intervention best practice is mounting and is increasingly based on larger and better designed studies [23, 24].
Drug policies have also started to shift, even if the translation of evidence into policy remains difficult [25, 26, 27, 28]. In some countries, there is cooperation between judicial and health authorities to mitigate harms associated with the criminalisation of drug use  and explicit or de facto decriminalisation of drug use [30, 31, 32]—these may often go together —or even legalisation, in the case of cannabis [34, 35, 36, 37]. Human rights-based approaches to drug treatment, incorporating harm reduction and social integration, have been implemented in a number of countries despite universal, national and global drug prohibition policies [38, 39, 40]. Despite such positive progress, however, many countries still have very low implementation levels of evidence-based programmes, exposing PWUD and the wider society to unnecessary health risks [13, 15, 41]. Above all, interventions appear to be frequently lacking for some of the most socially deprived groups, such as homeless, migrants, sex workers and prisoners [42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52]. Harm reduction and drug policy more widely have not been high on the international political agenda, with the United Nations General Assembly Special Session on the World Drug Problem in 2016 being the first high-level meeting after many years with the aim to debate drug policy. Also, the global target to reduce new HIV infections by 50% by 2015 was missed, and the latest UNAIDS (The Joint United Nations Programme on HIV/AIDS) report suggests that HIV infections among this group actually increased by one third between 2011 and 2015 .
Critically, there are still continuous gaps in information on how effectively interventions are actually being provided; their coverage, quality, client characteristics and the degree to which they fulfil the needs of different populations of drug users [13, 15, 54, 55, 56]. While in many countries there are regular—often costly—epidemiological studies on the characteristics and behaviours of drug users, the collection of comparable and reliable monitoring data on the extent and quality of routine interventions (for example NSP) and service implementation remains rare. Epidemiological studies and routine analysis of health indicator data are key to evaluating drug service effectiveness, but they are infrequently extended to and combined with detailed information on intervention characteristics [15, 41, 57, 58, 59]. A tight nexus between indicators of quality and drug service provision and health outcomes has been documented [60, 61, 62]. Despite the wide range of quality standards and best practice guidelines for drug services on the national and international level [6, 23, 24, 56], research has shown that adherence to these guidelines should not be taken for granted, and there is a need for data that reflect the reality of actual practice ‘on the ground’ [63, 64]. There is increasing interest in the quality and coverage of harm reduction services for people who use drugs and in the development of methodologies for measuring these [6, 56, 65]. An understanding of what services are being provided, in what form and the extent to which they are provided to individual users, including their views on the provision (where possible extending to enumeration of costs and if possible—in separate studies by specialist researchers—modelling of cost-effectiveness) is critical to the analysis of public health needs and whether these are adequately addressed.
This paper aims to identify which standardised data are needed—and why—for monitoring both the coverage and quality of harm reduction services . This is not the type of research question that can be readily addressed through standard epidemiological methods. Rather, useful approaches may include analysis of historical developments in the area, critical discussion of current best practices (i.e. indicators in use that have proved successful) and data gap analysis.
As a first step, we describe the historical development of established international monitoring systems and indicators in the field of drugs and health. We then propose a framework for further indicator development and evaluation in the area of harm reduction (and potentially other drug services, for examples see the footnotes below Table 3). This framework was developed using consensus methods, including nominal group meetings and email discussions [66, 67] reviewing existing quality standards [6, 56, 68], to capture and analyse the opinion and experience from a broad range of professionals/experts. The participating experts provided different perspectives and expertise (international and national monitoring system specialists, researchers, harm reduction professionals, government representatives) and included members of civil society organisations representing PWUD and people living with HIV/HCV. The framework lists candidate indicators for OAT, NSP and generic cross-cutting indicators for harm reduction (and potentially other drug) services. The framework with candidate indicators was developed in an iterative process of multiple commenting rounds until a stable consensus list of potential indicators (and areas for future indicator development) emerged. We discuss constraints (e.g. funding, ideology) and conditions for potential successful development of the suggested candidate indicators.
Historical development of existing drug use monitoring systems
The global development of indicators in the drugs field was spearheaded in the area of HIV/AIDS. In 1989, one of the first common sets of indicators (behavioural) for people who inject drugs (PWID) was applied across countries by the World Health Organization (WHO) ‘13 cities study of drug injecting and HIV infection’ . In 1998, the National Institute on Drug Abuse (NIDA), WHO and UNAIDS formed the ‘Global Research Network on HIV Prevention in Drug-Using Populations’ (GRN) to help control the HIV epidemic among PWID  by discussing best practice and exchanging national study methods and results in international meetings. The GRN was succeeded in 2004 by the ‘Reference Group to the United Nations on HIV and Injecting Drug Use’, a network funded by UNODC, WHO and UNAIDS, to estimate the global spread of HIV among PWID [71, 72, 73] and intervention coverage  using common methodology, which culminated in UN guidance for countries to set targets for intervention coverage [6, 74] and implementation . Ongoing global monitoring has more recently been taken up by UN reporting systems [76, 77] and non-governmental and academic organisations [2, 78].
Epidemiological indicators for people who use drugs being used at European Union level
Countries, out of 30, reporting in 2011–2015b
Prevalence of drug use in the general populationa
Prevalence of lifetime use, last year use, last month use
Representative (household) surveys with breakdowns by drug, age, gender, complemented by school surveys in 15-16 year old students (ESPAD) http://www.espad.org/
High-risk drug use/problem drug usea,c
Population size estimates of high-risk PWUD including hidden populations (all, opioids, stimulants, PWID)
Confidence intervals, estimation methods
Clients entering treatment
Breakdowns by ever previously treated, treatment type, prison, main drug, sex, age at treatment, age at first use, referral source, living status, education, labour status, route of administration, frequency of use
Number of deaths, average age
Breakdowns by gender, toxicology, ICD code
Notifications and prevalence of HIV/AIDS, HBV, HCV among PWID
Prevalence: HIV 29 HCV 25, HBV 18–16; notifications: HIV/AIDS 30/29
Prevalence among young and new PWID
Seizures of drugs
Number, quantity in kg
Seizures by drug class, cannabis plants, tablets/doses
Euro/g, % (%THC)e
Sample size, summary statistics, composition (% MDMAd/(meth)amphetamines)
Drug use in prison
Prevalence of lifetime use, last year use, last month use
Breakdowns by: before/in prison, drug class
Drug law offences
Number of: offences, offenders, either
25, 21, 30
Breakdowns by type (use, supply), drug class
Health and social intervention indicators for people who use opioids and people who inject drugs being used at European Union level
Countries, out of 30, reporting in 2011–2015a
Drug treatment (total)
All clients, by OAT medication
Syringes provided, clients, contacts, fixed sites, outreach sites
25, 19, 20, 28, 26
Estimated reporting coverage (%), NUTS2/3 levelb
OAT clients divided by the estimated number of opioid users (Fig. 1)
Confidence intervals, estimation methods
Syringes provided divided by the estimated number of PWID (Fig. 2)
Confidence intervals, estimation methods
Rates of drug use or drug injection differ strongly between countries, and thus, the comparability and interpretability of the simpler provision indicators (as counts, or rates per general population) may be seriously compromised with regard to the target populations of people who use opioids or PWID. Nevertheless, coverage indicators clearly also have limitations, for example uncertainty intervals around central estimates are often large and estimation methods not uniform, in addition to the lower reporting rates .
Results of the expert group consultation
Framework for the development of indicators for quality monitoring of harm reduction services, with a focus on opioid agonist therapy (OAT) and needle and syringe programmes (NSP); priority indicators are in italics
Specific OAT indicators may includea:
Coverage of estimated opioid user population (%, see Fig. 1 )
Waiting time to first treatment admission (months)
Methadone/buprenorphine dosage (grams)
OAT available (including new initiation) in prisons (in all /in some /no)
OAT medicine covered by state /health insurance (yes /partly /no)
Illicit drug consumption tolerated (after dose induction phase) (yes /no)
Diagnosis or detailed assessment of current substance use, individualised treatment planning (yes /no)
Take home OAT available (yes /no)
Counselling required (yes /no)
Specific NSP indicators may includea:
Coverage of estimated PWID population (syringes /PWID /year, see Fig. 2 )
Annual number of needles /syringes distributed and collected (administrative data, and /or estimated by weight) b
Provision of drug use equipment and injecting paraphernalia (including for non-injected use e.g. foils for heroin chasing, stems and filters for crack smoking) (in all /in some /no)
NSP available in prisons (in all /in some /no)
Coverage of all undertaken injections (syringes /100 injections)
Restrictions in numbers of syringes distributed per contact (yes /no)
Type of syringes (% low dead space, acceptance by users)
Modality (specialised NSP, outreach, pharmacy, other, e.g. drug treatment service)
Brief opportunistic motivational interventions provided (yes /no)
Generic cross-cutting indicators for harm reduction (and other drug services) may includea:
Infectious diseases counselling, testing, vaccination and referrals (e.g. HIV, HCV, HBV, TB) (in all /in some /no)
Take away naloxone provided (in all /in some /no)
Information provided on safer use, injecting and safer sex (in all /in some /no)
Condoms provided (in all /in some /no)
Accessibility: opening times and geographic coverage, outreach activities, costs to clients, no age limits, no parental consent requirements, targeted programmes for special populations (e.g. (pregnant) women, sex workers, underage users) (to construct overall index score: high /medium /low)
Integration /cooperation with other services and continuity of care: e.g. shared location /referrals to NSP, OAT, infectious diseases counselling and testing, antiviral and other medical treatment and care, overdose prevention, social support, housing, education, employment services (in all /in some /no)
Regular consultation with law enforcement /community /neighbourhood: avoiding nuisance and conflict, improving safety for both clients and community (index: high /medium /low)
Regular consultation with the users of the service: feedback, evaluation, client satisfaction (index: high /medium /low)
Assessment procedures: risk behaviours, needs, health status, informed consent, data confidentiality, written client records (index: high /medium /low)
Psycho-social interventions provided (with or without medication): (yes /no)
Frequency of contact with a counsellor /social worker (times per month)
Staff qualification, multidisciplinarity, education and (ongoing) training (index: high /medium /low)
Case /contact management follows protocol /guidelines (yes /no, specify which)
Type of funding source: private /public; national /international, etc.; and security of funding (per client, grant-based, etc.), utilisation monitoring (treatment slots used), peer support /aid (to construct an overall index score on funding continuity and reliability: high /medium /low)
Framework of potential indicators and areas for consideration
As expected, two main interventions were indicated by the experts as central to harm reduction (mainly, prevention of infectious diseases such as HIV and viral hepatitis and of opiate-related overdose), namely, NSP and OAT. Other areas in harm reduction for further consideration of indicator development, but for practical reasons not included among the recommended indicators, included ART (both for HIV and viral hepatitis), consumption rooms and heroin-assisted treatment (Table 3). Under the specific OAT indicators, priority indicators included ‘coverage’, ‘waiting list time’, ‘dosage’ and ‘availability in prisons’. For the specific NSP indicators, the priority indicators included ‘coverage’, ‘number of needles/syringes distributed/collected’, ‘provision of other drug use paraphernalia’ and ‘availability in prisons’. Among the generic or cross-cutting indicators proposed for harm reduction services (and potentially other drug services), the priority indicators were ‘infectious diseases counselling and care’, ‘take home naloxone’, ‘information on safe use/sex’ and ‘condoms’ (for details, see Table 3).
This consensus study provides a basis for the development and implementation of indicators of harm reduction quality and coverage and highlights further areas of potential monitoring of best practice intervention. Twelve priority candidate indicators were identified, on OAT, NSP and generic service quality aspects. Most of these seem relatively easy to monitor, consisting of simple ‘yes/no’ responses or a basic statistic. We propose conducting a pilot study to test the feasibility and applicability of the proposed indicators before their scaling up, to evaluate their effectiveness in comparing service quality across countries. From the experience in Europe, we suggest that this development should be collaborative (‘bottom-up’) making use of national and local experience and involving a broad range of experts and stakeholders (e.g. professionals, policymakers, representatives of people who use drugs and/or drug services, harm reduction organisations) across countries .
Important services were not included for monitoring, e.g. ART, mainly due to difficulties in finding a simple operationalisation or a key statistic from routine data that is readily available for all countries to be reported (such data may be obtained by special surveys; however, these are costly). While NSP and OAT are services that are specific for people who use opioids or PWID, respectively, and thus client numbers can be interpreted more easily, for ART this is not the case and in practice it is harder to come by reliable numbers for specific at-risk groups in treatment, e.g. PWID or men who have sex with men. Other services that are important but were not included are heroin-assisted treatment, drug consumption rooms/safer injection facilities, drug testing and water provision at rave parties, police interactions with drug users and interventions in special settings such as prisons. Again, their non-inclusion resulted not because they were considered unimportant but rather they were thought to be harder to monitor (e.g. police interactions) or to be partly overlapping with other indicators (e.g. safer injection rooms with NSP). However, indicators not included here might still be considered for implementation by individual countries depending on national context and priorities. For example, in many Latin American and Caribbean countries, stimulant use is more important than opioids, which might require adapting the indicators [2, 112]. Our approach might be extended to areas surrounding the actual implementation of drug services. For example, drug policy indicators could be considered for monitoring, e.g. sentencing practices and minimum quantities of drugs allowed for personal use, decriminalisation/liberalisation of drug laws or drug treatment regulations may have profound impact on health and well-being of PWUD. A recent study proposed a framework to classify countries by their models of ‘governance of addictions’ from an analysis of national drug strategies . Monitoring both drug policies and their actual implementation and practice might reveal important discrepancies between the two, providing key policy relevant information [113, 114].
Indicators for the quality of drug services must be closely linked to epidemiological data and methods. The development of OAT and NSP coverage indicators (Figs. 1 and 2) was made possible by the increased availability of routine epidemiological monitoring data and the increased use of statistical modelling methods. The methods to estimate population sizes of PWUD/PWID originated in biology and continue to be improved for epidemiological application even if they have not essentially changed [97, 102, 105, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129]. Mathematical and statistical modelling has more generally been useful to improve our understanding of intervention effectiveness and cost-effectiveness as well as to give insight in potential epidemic courses and processes, thus providing some basis to evaluate interventions [95, 96, 97, 130, 131, 132, 133, 134]. Different types of intervention have been studied using mathematical models, such as impact of needle exchange programmes [135, 136], impact of behavioural changes  and impact of treatment on transmission [138, 139]. Recent studies suggest that molecular analyses of infectious diseases may also provide added value to epidemiological surveillance as a basis for evaluating interventions [48, 140, 141, 142, 143]. Moreover, comprehensive reviews of epidemiological data (and intervention effectiveness and implementation) have been carried out to estimate the burden of disease and quality of life, providing a means to compare health and societal impact of interventions across different diseases including through cost-effectiveness analyses [144, 145, 146, 147, 148]. Indicators should not be limited to national-level data only. Having subnational breakdowns—by city or region—would be critical to understand within-country variation in epidemiological trends and intervention impact [149, 150, 151, 152].
Apart from using the proposed indicators individually, they might be used for system-level evaluation to monitor and guide service integration and referral at national level. For example, it is important to use these indicators together to assess the comprehensiveness of harm reduction programming, given the evidence that harm reduction interventions are most effective when used in combination [138, 153]. Another example of a combined approach may be provided by a ‘harm reduction cascade’ model, similar to the recently proposed HIV or HCV care cascades [19, 154, 155], where the ‘flow’ of people who use drugs would be modelled through a tailored set of services, ranging from catering the needs of incidental or recreational users to those who inject drugs or are heavily dependent, and/or may have a range of health and social problems. The HIV and HCV cascade model enables the identification of gaps in health system performance by estimating the percentage of infected who know their status, percentage of those in care, percentage of those on ART and percentage of those with undetectable viral load/sustained virologic response. Care cascade indicators relate to the timely provision of ART for HIV and best medical practices for HBV, HCV and other diseases (endocarditis, methicillin-resistant staphylococcus aureus (MRSA), anthrax, TB, etc.) and might similarly be developed for drug prevention, treatment and harm reduction measures. Another example focuses on the interface between judicial and public health interventions. This includes the analysis of police interactions with drug users in the context of their service utilisation, policy indicators (e.g. minimum quantities of drugs allowed for personal use, sentencing practice, medical use of cannabis, decriminalisation/liberalisation of drug laws ) and the continuity of care following prison release [156, 157].
The feasibility of monitoring drug service implementation will depend on resources in countries and may therefore be more limited in low and middle income countries. However, where a country lacks the resources to implement and further develop these indicators, the proposed framework may be useful to document the absence of data in specific areas, even if in a rudimentary form (e.g. a binary ‘yes/no’ checklist). Monitoring performance should be evaluated only after several years of data collection using performance indicators such as the number of countries providing data and assessments of the credibility of the methods and sources behind the available data. In practice it may take many years to arrive at a high reporting rate with good quality data, and maintaining a long-term perspective is necessary. With respect to clinical services performance, which is evaluated by health insurance systems and/or national health authorities , monitoring drug services may pose specific difficulties due to their multi-disciplinary nature and as they may depend on different government and private entities and multiple funding sources. Service provision may thus depend on the type of service providers (public, private, non-governmental organizations including peer-driven initiatives, general medical practitioners), funding sources (central government, local and regional governments, social health insurance, private and other sources) and funding mechanisms (grants, treatment case, daily costs, fee for service or payment by result) . Other aspects of funding might also impact on service performance, quality and outcomes—such as the way providers are chosen and the ways services are paid for, e.g. block grant, capitation, payment for activity or payment for outcome , although the evidence of how the funding provisions influence outcomes is mixed [161, 162, 163]. Additionally, disaggregated spending records could indicate whether programmes invest in adequate numbers of well-trained staff and procure quality commodities that meet the needs of the people accessing the service—all related to the quality of service provision. While we recommend monitoring harm reduction funding, this did not make it into the 12 priority indicators, as our focus has been on the service coverage and quality per se. While investment in itself would not denote quality, whether a programme is funded by government or an international donor can have implications for its sustainability that are important to monitor. There are several countries in Europe, as well as globally, facing issues with harm reduction sustainability and funding. It would be timely to consider a separate pilot study on the use of indicators relating to harm reduction spending.
There are several limitations to this analysis. While we were able to identify a set of priority candidate indicators using a consensus approach, we cannot at this stage present empirical evidence on the potential problems or advantages associated with implementation of these indicators. However, with the established, mostly epidemiological, indicators (Tables 1 and 2), this was a process of trial and error where a number of countries start jointly piloting such data collection using an agreed protocol, exchange experiences in regular working group meetings and improve quality and comparability of data collection practice, adjusting the protocol if necessary. A prior step could be to carry out specific literature reviews on each of the indicators; however, this was beyond the scope of our study. Also, we were unable to grade the information and suggestions obtained from our expert group by levels of evidence quality , again this was beyond the scope of our study, and given the broad area we cover would have not been feasible. If in a future step specific reviews are carried out on each indicator it would be important to attempt grading the evidence for each of them, although such evidence is likely to be scarce and in need of being generated. Our consensus approach was not a formal Delphi study and could as such be criticised. However, we did include various consensus methods (expert meetings, repeated email commenting rounds) [66, 67]. We believe it is unlikely the results would have differed much depending on the exact consensus approach, given that all participants agreed with the final version of framework and indicators. We have also not been able to identify clear candidate indicators for monitoring patient values and preferences regarding harm reduction services, although further work might well be able to define such indicators, as has been already attempted in drug treatment research [165, 166, 167, 168, 169, 170]. Finally, the services here discussed and for which we propose to develop indicators are ‘services’ in the form of programmes that are established by governments or private professional organisations and run for the benefit of ‘society’ or, at least putatively, in the benefit of clients or patients. In organisational terms, these are top-down services. What is not discussed in this article is the array of self-financed or funded users’ groups and their activities both in helping each other and also in providing useful and needed critique of the top-down services and policies. There is clearly a need for further work on this area with strong involvement of the target populations and their organisational representatives that services are serving.
We propose a framework for the further development of indicators of coverage and quality of harm reduction services, as a first step to improving best practice implementation in the drug field. This is based on the successful development of established monitoring systems and indicators, and an international consensus exercise. This framework might be especially of use for professionals in charge of monitoring and/or funding service implementation and quality at higher (e.g. national, international) levels of aggregation, in addition to providing some guidance at the local and individual service levels. From the framework, 12 priority candidate indicators emerge that are conceptually simple, likely suitable to be collected on a routine basis, and should provide comparable key evidence on the quality and coverage of opioid agonist therapy, needle and syringe programmes and generic drug service aspects. We propose conducting a pilot study to test the feasibility and applicability of the proposed indicators before their scaling up and routine implementation, to evaluate their effectiveness in comparing service quality across countries. The implementation of a limited set of validated and internationally agreed indicators for monitoring harm reduction service best practice will provide a stronger basis for future public health and epidemiological studies, in order to advance evidence-based health policy.
The authors would like to acknowledge the additional collaborators in the EUBEST working group: Sabrina Molinaro, Michela Franchini, Valeria Siciliano, Elisa Benedetti (Institute of Clinical Physiology (CNR), Pisa, Italy); Marco Perduca (Associazione Luca Coscioni, Rome, Italy); Alban Ylli (Foundation Our Lady of Good Counsel–Catholic University Our Lady of Good Counsel, Tirana, Albania); Gregorio Barrio Anta (National School of Public Health; Carlos III Health Institute; Addictive Disorders Network (RTA); Madrid, Spain); Maria José Bravo Portela (National Centre of Epidemiology; Carlos III Health Institute; Consortium for Biomedical Research in Epidemiology and Public Health (CIBERESP); Madrid, Spain), Iciar Indave (National Centre of Epidemiology, Carlos III Health Institute, Madrid, Spain); József Rácz (Eötvös Loránd University, Institute of Psychology; Semmelweis University, Faculty of Health Sciences; Blue Point Drug Counselling and Outpatient Centre; Budapest, Hungary); Tomáš Zábranský (Department of Addictology, First Faculty of Medicine, Charles University and General University Hospital; ResAd–Research and Development; AdRes Institute; Prague, Czech Republic); Michaela Štefunková (Institute of Criminology and Social Prevention; AdRes Institute; Prague, Czech Republic); Percy Fernandez Dávila (Stop Sida, Barcelona, Spain); Maris Salekesin, Sigrid Vorobjov (National institute for health development, Infectious Diseases and Drug Monitoring Department, Tallinn, Estonia); Monica Dan, Cristina Fierbinteanu, Dan Popescu, Ludmila Verdes (ARAS - the Romanian Association Against AIDS, Bucharest, Romania); Adrian-Octavian Abagiu (National Institute for Infectious Diseases Prof. Dr. Matei Bals, Department for OMT–ARENA); Angelos Hatzakis (Dept. of Hygiene, Epidemiology and Medical Statistics, National and Kapodistrian University of Athens, Athens, Greece); Maria Moudatsou, Tzanetos Antypas (NGO Praksis, Athens, Greece); Agnes Cadet-Tairou (French Monitoring Centre for Drugs and Drug Addiction (OFDT), Saint-Denis, France); Anne Marie Collins (Consultant, Barcelona, Spain); David Liddell (Scottish Drug Forum, Glasgow, UK).
Viktor Mravčík was supported by the institutional support no. PRVOUK-P03/LF1/9 and the Project Nr. LO1611 with a financial support from the Czech Ministry of Youth and Sport under the NPU I program. Sam Friedman was supported by the National Institute on Drug Abuse Grants R01 DA13336 (Community Vulnerability and Response to IDU-Related HIV); DP1 DA034989 (HIV Transmission by Recently-Infected Drug Users); and P30 DA11041 (Center for Drug Use and HIV Research). Ana Sarasa-Renedo, Jeffrey V. Lazarus and Viktor Mravčík were supported by the joint action ‘677085/HA-REACT’ (‘The Joint Action on HIV and Co-infection Prevention and Harm Reduction’), which has received funding from the European Union’s Health Programme (2014–2020).
Availability of data and materials
Data and material are available from the EMCDDA.
LW, MF, CC and CR conceived the paper. LW wrote all the versions. All co-authors provided comments on the draft and final versions and approved the final version.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
- 2.Harm Reduction International. The global state of harm reduction 2016. Edited by Stone K. London: Harm Reduction International; 2016. https://www.hri.global/files/2016/11/14/GSHR2016_14nov.pdf. Accessed 20 Mar 2017.
- 3.Committee on the Prevention of HIV Infection among Injecting Drug Users in High-Risk Countries. Preventing HIV infection among injecting drug users in high risk countries: an assessment of the evidence. Washington: Institute of Medicine of the National Academies; 2006.Google Scholar
- 4.WHO. Evidence for action series—technical papers and policy briefs on HIV/AIDS and injecting drug users. Geneva: WHO; 2015. http://www.who.int/hiv/pub/idu/evidence_for_action/en/. Accessed 20 Mar 2017.
- 5.ECDC, EMCDDA. Prevention and control of infectious diseases among people who inject drugs. Stockholm: ECDC/EMCDDA; 2011. https://goo.gl/2rQBzv. Accessed 20 Mar 2017.
- 6.WHO, UNODC, UNAIDS. WHO, UNODC, UNAIDS technical guide for countries to set targets for universal access to HIV prevention, treatment and care for injecting drug users—2012 revision. Geneva: WHO; 2012. http://apps.who.int/iris/bitstream/10665/77969/1/9789241504379_eng.pdf?ua=1. Accessed 20 Mar 2017.
- 9.Palmateer N, Kimber J, Hickman M, Hutchinson S, Rhodes T, Goldberg D. Evidence for the effectiveness of sterile injecting equipment provision in preventing hepatitis C and human immunodeficiency virus transmission among injecting drug users: a review of reviews. Addiction. 2010;105:844–59.PubMedCrossRefGoogle Scholar
- 15.Wiessing L, Likatavicius G, Klempova D, Hedrich D, Nardone A, Griffiths P. Associations between availability and coverage of HIV-prevention measures and subsequent incidence of diagnosed HIV infection among injection drug users. Am J Public Health. 2009;99:1049–52. http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2679784/. Accessed 20 Mar 2017.
- 16.Strang J, Manning V, Mayet S, Titherington E, Offor L, Semmler C, et al. Family carers and the prevention of heroin overdose deaths: unmet training need and overlooked intervention opportunity of resuscitation training and supply of naloxone. Drugs Educ Prev Policy. 2008;15:211–8.CrossRefGoogle Scholar
- 18.Minozzi S, Amato L, Davoli M. Preventing fatal overdoses: a systematic review of the effectiveness of take-home naloxone. Office of the European Union: Luxembourg; 2015. http://www.emcdda.europa.eu/attachements.cfm/att_234376_EN_TDAU14009ENN.web_.pdf. Accessed 20 Mar 2017.
- 23.EMCDDA. Best practice portal. Lisbon: EMCDDA; 2017. http://www.emcdda.europa.eu/best-practice. Accessed 20 Mar 2017.
- 27.Mravcik V. (De)criminalisation of possession of drugs for personal use—a view from the Czech Republic. Int J Drug Policy. 2015;26:705–7Google Scholar
- 28.Jolley E, Rhodes T, Platt L, Hope V, Latypov A, Donoghoe M et al. HIV among people who inject drugs in Central and Eastern Europe and Central Asia: a systematic review with implications for policy. BMJ Open. 2012;2:pii=e001465. http://bmjopen.bmj.com/content/bmjopen/2/5/e001465.full.pdf. Accessed 20 Mar 2017.
- 30.Eastwood N, Fox E, Rosmarin A. A quiet revolution: drug decriminalisation across the globe. London: Release; 2016.Google Scholar
- 32.Csete J. A balancing act: policymaking on illicit drugs in the Czech Republic. New York: Open Society Foundations; 2012. http://www.opensocietyfoundations.org/sites/default/files/A_Balancing_Act-03-14-2012.pdf. Accessed 20 Mar 2017.
- 35.Wilkinson ST, Yarnell S, Radhakrishnan R, Ball SA, D’Souza DC. Marijuana legalization: impact on physicians and public health. Annu Rev Med. 2016;67:453–66.Google Scholar
- 38.Comiskey CM. We need to decriminalise small amounts of drugs and open safe heroin injecting centres. Int Bus Times. 2015. http://www.ibtimes.co.uk/we-need-decriminalise-small-amounts-drugs-open-safe-heroin-injecting-centres-1527421. Accessed 20 Mar 2017.
- 39.Duncan DF, Nicholson T, White JB, Ellis-Griffith G. A brief history of prohibition and treatment solutions for substance abusers. Int J Criminol Sociol. 2014;3:186–99.Google Scholar
- 40.Levine HG. The secret of worldwide drug prohibition. Indep Rev. 2002;7:165–80. http://www.independent.org/pdf/tir/tir_07_2_levine.pdf. Accessed 20 Mar 2017.
- 41.EMCDDA. European Drug Report 2016. Lisbon: EMCDDA; 2016. http://www.emcdda.europa.eu/system/files/publications/2637/TDAT16001ENN.pdf. Accessed 20 Mar 2017.
- 45.UNODC, ILO, UNDP, WHO, UNAIDS. Prevention, treatment and care in prisons and other closed settings: a comprehensive package of interventions. Vienna: United Nations Office on Drugs and Crime; 2013. https://www.unodc.org/documents/hiv-aids/HIV_comprehensive_package_prison_2013_eBook.pdf. Accessed 20 Mar 2017.
- 46.Sypsa V, Paraskevis D, Malliori M, Nikolopoulos GK, Panopoulos A, Kantzanou M, et al. Homelessness and Other Risk Factors for HIV Infection in the Current Outbreak Among Injection Drug Users in Athens, Greece. Am J Public Health. 2015;105:196–204.Google Scholar
- 48.Paraskevis D, Nikolopoulos G, Tsiara C, Paraskeva D, Antoniadou A, Lazanas M, et al. HIV-1 outbreak among injecting drug users in Greece, 2011: a preliminary report. Euro Surveill. 2011;16:pii=19962. http://www.eurosurveillance.org/ViewArticle.aspx?ArticleId=19962. Accessed 20 Mar 2017.
- 52.Blondell SJ, Kitter B, Griffin MP, Durham J. Barriers and Facilitators to HIV Testing in Migrants in High-Income Countries: A Systematic Review. AIDS Behav. 2015;19:2012–24.Google Scholar
- 53.UNAIDS. Get on the fast-track—the life-cycle approach to HIV. Geneva: UNAIDS; 2016. http://www.unaids.org/sites/default/files/media_asset/Get-on-the-Fast-Track_en.pdf. Accessed 20 Mar 2017.
- 54.Ferri M, Bo A, Amato L, Correia Guedes I, Esteves CS, Wiessing L et al. What is needed in future drug treatment research? A systematic approach to identify gaps on effectiveness of drug treatment from the EMCDDA. Drugs Educ Prev Policy. 2014;22:86–92. http://www.tandfonline.com/doi/pdf/10.3109/09687637.2014.954988?needAccess=true. Accessed 20 Mar 2017.
- 57.Nikolopoulos GK, Fotiou A, Kanavou E, Richardson C, Detsis M, Pharris A, et al. National income inequality and declining GDP growth rates are associated with increases in HIV diagnoses among people who inject drugs in Europe: a panel data analysis. PLoS ONE. 2015;10:e0122367.PubMedPubMedCentralCrossRefGoogle Scholar
- 59.Pharris A, Wiessing L, Sfetcu O, Hedrich D, Botescu A, Fotiou A et al. Humanimmunodeficiency virus in injecting drug users in Europe following a reported increase of cases in Greece and Romania, 2011. Euro Surveill. 2011;16:pii=20032. http://www.eurosurveillance.org/ViewArticle.aspx?ArticleId=20032. Accessed 20 Mar 2017.
- 65.Eurasian Harm Reduction Network. Methodology to assess and monitor access to harm reduction services. Vilnius: EHRN; 2014. http://www.harm-reduction.org/sites/default/files/pdf/4_modules_glaossary_and_preface.zip. Accessed 20 Mar 2017.
- 67.Delbecq AL, Van de Ven AH, Gustafson DH. Group techniques for program planning: a guide to nominal group and Delphi processes. Glenview: Scott Foresman; 1975.Google Scholar
- 68.Council of the European Union. Council conclusions on the implementation of the EU Action Plan on Drugs 2013–2016 regarding minimum quality standards in drug demand reduction in the European Union. Brussels: Council of the European Union; 2015. https://goo.gl/l7NZK4. Accessed 20 Mar 2017.
- 69.Ball A, Des Jarlais DC, Donoghoe MC, Friedman SR, Goldberg D, Hunter GM, et al. Multi-city study on drug injecting and risk of HIV infection: a report prepared on behalf of the WHO International Collaborative Group. Geneva: World Health Organization; 1994. Programme on Substance Abuse. https://extranet.who.int/iris/restricted/bitstream/10665/62037/1/WHO_PSA_94.4.pdf. Accessed 20 Mar 2017.
- 70.Cire B. Global network will promote information exchange on HIV prevention in drug-using populations. NIDA Notes. National Institute on Drug Abuse; 1999. http://archives.drugabuse.gov/NIDA_Notes/NNVol13N5/Global.html. Accessed 20 Mar 2017.
- 72.Aceijas C, Friedman SR, Cooper HL, Wiessing L, Stimson GV, Hickman M. Estimates of injecting drug users at the national and local level in developing and transitional countries, and gender and age distribution. Sex Transm Infect. 2006;82 Suppl 3:iii10–7. http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2576733/pdf/iii10.pdf. Accessed 20 Mar 2017.
- 74.WHO, UNODC, UNAIDS. Technical Guide for countries to set targets for universal access to HIV prevention, treatment and care for injecting drug users. Geneva: WHO; 2009. http://www.who.int/hiv/pub/idu/idu_target_setting_guide.pdf. Accessed 20 Mar 2017.
- 75.WHO. Consolidated guidelines on HIV prevention, diagnosis, treatment and care for key populations, Consolidated guidelines on HIV prevention, diagnosis, treatment and care for key populations. Geneva: WHO; 2014. https://goo.gl/QxWY3m. Accessed 20 Mar 2017.
- 76.UNODC. World Drug Report 2015. Vienna: UNODC; 2015. http://www.unodc.org/documents/wdr2015/World_Drug_Report_2015.pdf. Accessed 20 Mar 2017.
- 77.UNAIDS. Global AIDS Monitoring 2017—indicators for monitoring the 2016 United Nations political declaration on HIV and AIDS. Geneva: UNAIDS; 2017. http://www.unaids.org/sites/default/files/media_asset/2017-Global-AIDS-Monitoring_en.pdf. Accessed 20 Mar 2017.
- 78.ICPR. World prison brief. London: Institute for Criminal Policy Research (ICPR); 2015. http://www.prisonstudies.org/world-prison-brief. Accessed 20 Mar 2017.
- 84.Schlumberger MG, Desenclos JC, Papaevangelou G, Richardson SC, Ancelle-Park R. Knowledge of HIV serostatus and preventive behaviour among European injecting drug users: second study. European Community Study Group on HIV in injecting drug users. Eur J Epidemiol. 1999;15:207–15.PubMedCrossRefGoogle Scholar
- 85.Wiessing LG, Toet J, Houweling H, Koedijk PM, van den Akker R, Sprenger MJW. Prevalentie en risicofactoren van HIV-infectie onder druggebruikers in Rotterdam. [Prevalence and risk factors of HIV infection among drug users in Rotterdam]. Bilthoven: RIVM; 1995. http://www.rivm.nl/bibliotheek/rapporten/213220001.pdf. Accessed 20 Mar 2017.
- 90.Stover H, Casselman J, Hennebel L. Substitution treatment in European prisons: a study of policies and practices in 18 European countries. Int J Prison Health. 2006;2:3–12. http://www.drogenforschung.de/pdf/volltexte_pdf/nr18/subst_treatm_eupris.pdf. Accessed 20 Mar 2017.
- 91.Griffiths P, Mounteney J, Lopez D, Zobel F, Gotz W. Addiction research centres and the nurturing of creativity. Monitoring the European drug situation: the ongoing challenge for the European Monitoring Centre for Drugs and Drug Addiction (EMCDDA). Addiction. 2012;107:254–8.PubMedCrossRefGoogle Scholar
- 92.Mounteney J, Griffiths P, Sedefov R, Noor A, Vicente J, Simon R. The drug situation in Europe: an overview of data available on illicit drugs and new psychoactive substances from European monitoring in 2015. Addiction. 2016,111:34–48.Google Scholar
- 93.Wiessing L, Ncube F, Hedrich D, Griffiths P, Hope V, Gill N et al. Surveillance of infectious diseases in IDUs across the EU: information from the EU expert network. Euro Surveill. 2004;8:pii=2368. http://www.eurosurveillance.org/ViewArticle.aspx?ArticleId=2368. Accessed 20 Mar 2017.
- 94.Wiessing L. New EMCDDA toolkit for monitoring infectious diseases. Drugnet Europe. 2014;85:2. http://www.emcdda.europa.eu/system/files/publications/785/Drugnet_85_weboptimised_461952.pdf. Accessed 20 Mar 2017.
- 95.Jager J, Limburg W, Kretzschmar M, Postma M, Wiessing L (eds). Hepatitis C and injecting drug use: impact, costs and policy options. EMCDDA: Lisbon; 2004. https://goo.gl/WgRoSB. Accessed 20 Mar 2017.
- 96.Wiessing L, Kraus L, Hay G, Rossi C, Frischer M, Jager J, et al. European network to develop policy relevant models and socio-economic analyses of drug use: consequences and interventions. Lisbon: EMCDDA; 2002. http://www.emcdda.europa.eu/html.cfm/index1376EN.html. Accessed 20 Mar 2017.
- 97.Godfrey C, Wiessing L, Hartnoll R (eds). Modelling drug use: methods to quantify and understand hidden processes. EMCDDA: Lisbon; 2000. http://www.emcdda.europa.eu/system/files/publications/922/Monograph6_159816.pdf. Accessed 20 Mar 2017.
- 98.Hartnoll RL. Drug epidemiology in the European institutions: historical background and key indicators. UN Bull Narc. 2003;55:53–72. http://www.unodc.org/pdf/bulletin/bulletin_2003_01_01_1.pdf#page=60. Accessed 20 Mar 2017.
- 99.Wiessing L, Hartnoll R, Rossi C. The epidemiology of drug use at the macro level: indicators, models and policy-making. UN Bull Narc. 2001;53:119–33. http://www.unodc.org/unodc/en/data-and-analysis/bulletin/bulletin_2001-01-01_1_page011.html. Accessed 20 Mar 2017.
- 100.Hartnoll R. Drug trends in the European Union. 1999. Epidemiologic trends in drug abuse. International epidemiology work group on drug abuse June 1999. Proceedings. p. 49–58. https://archives.drugabuse.gov/pdf/cewg/IEWG699.pdf. Accessed 20 Mar 2017.
- 104.UNODC. Global Assessment Programme on Drug Abuse (GAP). 2003; UNODC. http://www.unodc.org/unodc/en/GAP/. Accessed 20 Mar 2017.
- 105.Hickman M, Taylor C, Chatterjee A, Degenhardt L, Frischer M, Hay G, et al. Estimating the prevalence of problematic drug use: a review of methods and their application. UN Bull Narc. 2002;54:15–32. https://www.unodc.org/pdf/bulletin/bulletin_2002_01_01_Art2.pdf. Accessed 20 Mar 2017.
- 108.Wiessing LG, Denis B, Guttormsson U, Haas S, Hamouda O, Hariga F, et al. Estimating coverage of harm-reduction measures for injection drug users in Europe. 2001. Global Research Network On HIV Prevention In Drug-Using Populations - Third Annual Meeting.July 5-7, 2000, Durban. Bethesda: NIDA; 2001. https://goo.gl/BWHjSN. Accessed 20 Mar 2017.
- 109.EMCDDA. 2001 annual report on the state of the drugs problem in the European Union. Lisbon: EMCDDA; 2001. http://www.emcdda.europa.eu/attachements.cfm/att_37276_EN_ar01_en.pdf. Accessed 20 Mar 2017.
- 111.Blystad H, Wiessing L. Guidelines for testing HIV, viral hepatitis and other infections in injecting drug users. EMCDDA manuals no 6. EMCDDA: Lisbon; 2010. http://www.emcdda.europa.eu/publications/manuals/testing-guidelines. Accessed 20 Mar 2017.
- 112.Goltzman PM. Intervenciones desde la Reducción de Daños. Perspectivas y desafíos actuales. Memoria de encuentro, Buenos Aires 21-22 de junio 2016. Buenos Aires: Intercambios; 2016. http://intercambios.org.ar/wp-content/uploads/2016/10/RD-perspectivas-y-desafios-2016-Intercambios.pdf. Accessed 20 Mar 2017.
- 114.Belackova V, Ritter A, Shanahan M, Hughes CE. Assessing the concordance between illicit drug laws on the books and drug law enforcement: comparison of three states on the continuum from “decriminalised” to “punitive”. Int J Drug Policy. 2017;41:148–57.Google Scholar
- 116.Jones HE, Welton NJ, Ades AE, Pierce M, Davies W, Coleman B et al. Problem drug use prevalence estimation revisited: heterogeneity in capture-recapture and the role of external evidence. Addiction. 2016;111:438–47.Google Scholar
- 117.Hay G, McKeganey N, Wiessing L, Bello PY, D’Ippoliti D, Domingo-Salvany A, et al. Methodological guidelines to estimate the prevalence of problem drug use on the local level. Lisbon: EMCDDA; 1999. https://goo.gl/9RK1hz. Accessed 20 Mar 2017.
- 122.Cooper HL, Brady JE, Friedman SR, Tempalski B, Gostnell K, Flom PL. Estimating the prevalence of injection drug use among black and white adults in large U.S. metropolitan areas over time (1992–2002): estimation methods and prevalence trends. J Urban Health. 2008;85:826–56.PubMedPubMedCentralCrossRefGoogle Scholar
- 129.Stimson GV, Hickman M, Quirk A, Frischer M, Taylor C (eds.). Estimating the prevalence of problem drug use in Europe. Lisbon: EMCDDA/Pompidou Group; 1997. http://old.ntakd.lt/files/leidiniai/emcdda/6-Monographs/5-Estimating.pdf. Accessed 20 Mar 2017.
- 133.Kretzschmar M, Wiessing L. New challenges for mathematical and statistical modelling of HIV and HCV in IDUs. AIDS. 2008;22:1527–37.Google Scholar
- 135.Kaplan EH, O’Keefe E. Let the needles do the talking! Evaluating the New Haven needle exchange. Interfaces. 1993;23:7–26. https://goo.gl/50mafW. Accessed 20 Mar 2017.
- 140.Paraskevis D, Paraschiv S, Sypsa V, Nikolopoulos G, Tsiara C, Magiorkinis G, et al. Enhanced HIV-1 surveillance using molecular epidemiology to study and monitor HIV-1 outbreaks among intravenous drug users (IDUs) in Athens and Bucharest. Infect Genet Evol. 2015;35:109–21.PubMedCrossRefGoogle Scholar
- 142.Paraskevis D, Nikolopoulos G, Fotiou A, Tsiara C, Paraskeva D, Sypsa V, et al. Economic recession and emergence of an HIV-1 outbreak among drug injectors in Athens metropolitan area: a longitudinal study. PLoS ONE. 2013;8:e78941. http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0078941. Accessed 20 Mar 2017.
- 147.Wiessing L, Ferri M, Grady B, Kantzanou M, Sperle I, Cullen KJ, et al. Hepatitis C virus infection epidemiology among people who inject drugs in Europe: a systematic review of data for scaling up treatment and prevention. PLoS ONE. 2014;9:e103345. http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0103345. Accessed 20 Mar 2017.
- 152.Wiessing L, Likatavicius G, Hedrich D, Guarita B, van de Laar MJ, Vicente J. Trends in HIV and hepatitis C virus infections among injecting drug users in Europe, 2005 to 2010. Euro Surveill. 2011;16:pii=20031 http://www.eurosurveillance.org/ViewArticle.aspx?ArticleId=20031. Accessed 20 Mar 2017.
- 153.van den Berg C, Smit C, van Brussel G, Coutinho R, Prins M. Full participation in harm reduction programmes is associated with decreased risk for human immunodeficiency virus and hepatitis C virus: evidence from the Amsterdam Cohort Studies among drug users. Addiction. 2007;102:1454–62.CrossRefGoogle Scholar
- 155.Yehia BR, Schranz AJ, Umscheid CA, Lo Re III V. The treatment cascade for chronic hepatitis C virus infection in the United States: a systematic review and meta-analysis. PLoS ONE. 2014;9:e101554. http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0101554. Accessed 20 Mar 2017.
- 158.OECD. OECD health statistics 2015—definitions, sources and methods. Paris: OECD; 2015. http://stats.oecd.org/wbos/fileview2.aspx?IDFile=587d7574-6ed6-4408-9c32-481d322936e6. Accessed 20 Mar 2017.
- 159.EMCDDA. Cost and financing of drug treatment services in Europe: an exploratory study. Lisbon: EMCDDA; 2011. http://www.emcdda.europa.eu/attachements.cfm/att_143682_EN_TDSI11001ENC.pdf. Accessed 20 Mar 2017.
- 166.Gossop M, Marsden J, Stewart D. NTORS After Five Years. The National Treatment Outcome Research Study - Changes in substance use, health and criminal behaviour during the five years after intake. London: National Addiction Centre; 2001.Google Scholar
- 168.McKeganey N, Bloor M, McIntosh J, Neale J. Key findings from the Drug Outcome Research in Scotland (DORIS) study. Glasgow: University of Glasgow - Centre for Drug Misuse Research; 2008. http://substanceuseresearch.org/wp-content/uploads/2016/02/DORIS-Key.pdf. Accessed 20 Mar 2017.
- 169.Donmall M, Jones A, Davies L, Barnard M. Summary of key findings from the Drug Treatment Outcomes Research Study (DTORS). Research Report 23 (summary). UK: Home Office; 2009. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/116599/horr23.pdf. Accessed 20 Mar 2017.
- 170.Jones A, Donmall M, Millar T, Moody A, Weston S, Anderson T, et al. The drug treatment outcomes research study (DTORS): final outcomes report - 3rd edition. UK: Home Office; 2009. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.604.904&rep=rep1&type=pdf. Accessed 20 Mar 2017.
- 171.Mant J. Process versus outcome indicators in the assessment of quality of health care. Int J Qual Health Care. 2001;13:475–80. http://intqhc.oxfordjournals.org/content/13/6/475.full-text.pdf. Accessed 20 Mar 2017.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.