Four formative studies were conducted in Europe and the USA to collect feedback from patients, caregivers and HCPs on the lanreotide autogel/depot syringe on the market at the time, and on successive prototypes designed specifically for this purpose. The process for developing the new syringe included retaining attributes of the previous lanreotide autogel/depot delivery system that were already well received (prefilled/ready-to-use syringe, automatic needle guard and overall transparency of the delivery system) [3]. A validation study was conducted to evaluate the final syringe and confirm that it could be used effectively and safely in the intended environment, by the intended users, for the intended purpose.
All participants were required to be 18 years or older (no upper age limit), have the capacity to understand study risks, and be available and willing to participate in the study (including a willingness to be video-recorded during the study). Recruitment throughout all studies allowed a mix of genders, hand size and hand dominance (more right than left) in order to reflect the general population of users. Participants were excluded from the study if they were employed by the sponsor (Ipsen) or a pharmaceutical company. Further exclusion criteria included participants with uncorrected sensory, cognitive or physical disabilities that would preclude the participant from attempting to administer an injection.
As the prevalence of acromegaly and gastroenteropancreatic (GEP)-NET is rare, it would have been logistically difficult to recruit sufficient participants with experience for these studies. Therefore, patients, caregivers and HCPs were also represented via surrogates which, in addition to the criteria above, had the same injection experience and relevant clinical conditions and attributes of each group that would impact the syringe use (detailed below).
Formative Studies
Formative studies were conducted in France, Germany, the UK and the USA between 17 June 2015 and 29 September 2016.
All formative studies were face-to-face interviews with patients with GEP-NETs or acromegaly, lay caregivers of patients with these conditions and HCPs. Some of the formative studies also included patient and/or caregiver representatives. Representatives of patients with acromegaly were individuals with conditions that mimic the dexterity problems (e.g. large fingers, pain in joints) experienced by patients with acromegaly, e.g. those with a diagnosis of diabetic neuropathy, carpal tunnel syndrome or arthritis and self-described “large” or “very large” hands and “thick” or “very thick” fingers. Representatives of patients with GEP-NETs were defined as those willing to administer injections, as patients with GEP-NETs did not have any specific characteristics expected to affect use of the syringe. Caregiver representatives were defined as individuals willing to administer injections. Vision-related ailments were allowed in patients and patient representatives, but not in caregivers or caregiver representatives.
Formative Study 1
Formative study 1 included patients with GEP-NETs, patients with acromegaly and HCPs from France, Germany, the UK and the USA. It assessed the user experience of the current on-the-market lanreotide autogel/depot syringe and also provided a comparison with the octreotide LAR syringe to identify challenges and areas of improvement for the lanreotide autogel/depot syringe. As such, participants were only eligible for inclusion if they had injected lanreotide autogel/depot or octreotide LAR in the month prior to the study. HCPs were required to have administered either product to at least five patients. Patients and HCPs were excluded if they had recently taken part in marketing research on NETs or acromegaly.
Participants were also asked to provide feedback on four new early prototypes (developed via 3D printing), each with a set of unique attributes related to the body of the syringe, the thumb position, finger flanges and completion indicator, to understand which features were important for patients and their HCPs.
Formative Study 2
Formative study 2 was conducted in the UK and included a subset of the HCPs that participated in formative study 1. The aim was to gather feedback on a prototype that had been developed using results from formative study 1. On the basis of the results, five different colour prototypes were then developed for formative study 3.
Formative Study 3
Formative study 3 was carried out in France, Germany, the UK and the USA, in patients with acromegaly or GEP-NETs and HCPs. All were real-life users of lanreotide autogel/depot or octreotide LAR. HCPs were required to have administered either product to at least four patients.
Participants provided feedback on the five prototypes and the instructions for use (IFU). They also evaluated the impact of colour and the presence of rubber on the finger flanges/overcap on the participants’ experience. Patients and HCPs in Europe could administer a simulated injection to assess the potential for self-injection, demonstrate the level of understanding of the IFU, and identify potential use errors and areas for improvement.
Formative Study 4
Formative study 4 was conducted in the USA (HCPs only) and Europe (patients with acromegaly and GEP-NETs or patient representatives and caregivers or their representatives). The latest versions of the prototype were presented, with the aim of evaluating each updated syringe–user interface. Participants conducted a simulated injection, then were asked a series of knowledge task questions and were interviewed to determine the root causes of any misuses that occurred. They then provided subjective feedback of their experience with syringes, to confirm whether any further changes needed to be incorporated in the syringe design (specifically focusing on the plunger support and the overcap).
Validation Study
A simulated-use validation study was conducted in May and June 2017 in the USA (HCPs only) and in Germany (with representatives of patients with acromegaly, patients with GEP-NETs and caregiver representatives). HCPs were required to have prior injection experience, though not necessarily with lanreotide autogel/depot. It was not compulsory for patients with GEP-NETs to have experience with lanreotide autogel/depot or other somatostatin therapies. In the USA, the study aimed to include mostly nurses (although other HCPs including physicians, physician assistants, nursing and medical assistants were recruited) and preferentially chose HCPs employed at an endocrinology practice (although HCPs from other practices were also included). Individuals involved in any prior formative testing of the syringe were excluded.
The validation study assessed the misuses associated with preparing and administering an injection using the updated syringe according to a critical task list (Supplementary Table S1). Possible misuses were identified during a risk assessment using the Failure Mode and Effect Analysis (FMEA) tool, conducted to evaluate and analyse all hazard situations related to use of the syringe. Projected risks were rated following the International Organization for Standardization (ISO) 14971:2013 (“Medical devices—Application of risk management to medical devices”).
Participants in the acromegaly, GEP-NET and caregiver groups in Germany followed a training session of 30 min under the supervision of a nurse. This consisted of reviewing the IFU and warnings and precautions, and administering their first simulated injection under nurse supervision. Some of the HCPs in the US study also received a 30-min training session that included reviewing the IFU, familiarising themselves with the syringe, receiving answers to any questions they may have had and watching a nurse demonstrate an injection (if requested).
Following training, all participants (including untrained HCPs) were presented with a use scenario requiring preparation and administration of the drug to evaluate all the misuses that participants had with the product. During each session, participants administered two injections (one dose of 60 mg and one of 120 mg, the order of which was evenly distributed between participants) of a simulated gel (designed to mimic the characteristics of lanreotide autogel/depot) into an injection pad placed on their chosen injection site on a mannequin. The injection site was dependent on whether the participant would self-administer the injection (not approved in the USA following the extension indication for NET, it was initially permitted for the acromegaly indication) or whether they would be injecting someone else. Therefore, HCPs (enrolled in the US study) were expected to place the pad on the upper, outer, external quadrant of the buttock of the mannequin (the site for injecting someone else) before making the injection, whilst participants in the acromegaly group were expected to place the pad on the upper outer thigh of the mannequin (self-injection site) before injecting. Participants in the GEP-NET and caregiver group injected in both sites; one injection mimicked self-injection whilst the other simulated injecting someone else.
Two different environments were created to help simulate the injection experience: a clinical environment for HCPs, and a home environment for patients self-administering the injections and for caregivers. Requirements for the environments included the area being well lit, quiet, 18–24 °C and with a humidity between 15% and 85%.
Data Analyses
For the validation study, the number of participants in each group (minimum of 15) was determined according to Annex B from the Food and Drug Administration (FDA) guidance, Applying Human Factors and Usability Engineering to Medical Devices. Demographic information collected for the validation study included gender, age, professional title (for HCPs), experience with lanreotide autogel/depot, hand size and handedness. Descriptive analyses are presented and categorical variables are presented as frequency counts. The numbers of misuses are compared between trained and untrained HCPs, and between HCPs and patients/representatives/caregivers.
Ethics
All participants provided written informed consent prior to enrolment in any of the studies. As they were not interventional clinical studies and the injections were simulated, no ethics review or committee approval was required. The validation studies were conducted in accordance with FDA draft guidance, Human Factors Studies and Related Clinical Study Considerations in Combination Product Design and Development, issued February 2016 and European Standard: Application of usability engineering to medical devices EN62366–1:2015.