Abstract
Background
Cognitive problems affect up to 70% of people with multiple sclerosis (MS), which can negatively impact mood, ability to work, and quality of life. Addressing cognitive problems is a top 10 research priority for people with MS. Our ongoing research has systematically developed a cognitive screening and management pathway (NEuRoMS) tailored for people with MS, involving a brief cognitive evaluation and rehabilitation intervention. The present study aims to assess the feasibility of delivering the pathway and will inform the design of a definitive randomised controlled trial (RCT) to investigate the clinical and cost-effectiveness of the intervention and eventually guide its clinical implementation.
Methods
The feasibility study is in three parts. Part 1 involves an observational study of those who receive screening and support for cognitive problems, using routinely collected clinical data. Part 2 is a two-arm, parallel group, multicentre, feasibility RCT with a nested fidelity evaluation. This part will evaluate the feasibility of undertaking a definitive trial comparing the NEuRoMS intervention plus usual care to usual care only, amongst people with MS with mild cognitive problems (n = 60). In part 3, semi-structured interviews will be undertaken with participants from part 2 (n = 25), clinicians (n = 9), and intervention providers (n = 3) involved in delivering the NEuRoMS cognitive screening and management pathway. MS participants will be recruited from outpatient clinics at three UK National Health Service hospitals.
Discussion
Timely screening and effective management of cognitive problems in MS are urgently needed due to the detrimental consequences of cognitive problems on people with MS, the healthcare system, and wider society. The NEuRoMS intervention is based on previous and extant literature and has been co-constructed with relevant stakeholders. If effective, the NEuRoMS pathway will facilitate timely identification and management of cognitive problems in people with MS.
Trial registration
ISRCTN11203922. Prospectively registered on 09.02.2021.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Background
Multiple sclerosis (MS) is a progressive condition, often diagnosed in young adulthood or early middle age, and is a leading cause of neurological disability in young adults [1]. Up to 70% of people with MS experience cognitive problems [2], which can impact adversely on quality of life, daily activities, and employment [3,4,5,6]. Cognitive deficits can manifest as an inability to pay attention, forgetfulness, and problem-solving difficulties. The economic impact of cognitive impairment in MS is felt by the people with MS, their families, and wider society [7] and is likely to escalate with more people being diagnosed and with lower mortality rates. A national survey found cognitive problems were the most debilitating and distressing MS symptoms [8], so addressing cognitive problems, unsurprisingly, is identified as a James Lind Alliance/MS Society ‘top 10’ research priority for people with MS [9].
For people with MS, neuropsychological management (e.g. psychoeducation, internal and external compensatory strategies) can ameliorate the effects of cognitive problems (e.g. loss of independence) and improve mood, employment prospects, quality of life, activities of daily living, and DMT adherence [3, 10, 11]. Clinicians’ and patients’ knowledge of cognitive screening results can also facilitate shared decision-making regarding dose or choice of MS disease-modifying therapies (DMTs).
In the UK, almost 45% of MS specialists report that existing neuropsychological services are insufficient [12,13,14,15]. Currently, most UK MS clinics do not routinely screen for cognitive problems and provide insufficient support for most patients with MS who present with these problems [12,13,14,15,16]. By not intervening early, people with MS are less likely to benefit from rehabilitation [17]. Therefore, there is a need for MS services to identify and triage people with MS for timely cognitive assessment and develop and deliver appropriate, resource-efficient interventions, making full use of technological advances.
This feasibility study is part of a larger programme of research: the neuropsychological evaluation and rehabilitation in multiple sclerosis (NEuRoMS; www.neuroms.org) project [18]. NEuRoMS aims to develop and evaluate a pathway for routine screening of cognitive problems and includes a brief cognitive intervention programme for people with MS with mild cognitive problems. In earlier stages of the project, we systematically designed a blueprint of the cognitive screening and management pathway based on extant literature and stakeholder consultation [19, 20] and refined it through implementing it at three NHS hospitals [21, 22].
Prior to testing the pathway in a definitive randomised controlled trial (RCT), we need to assess key feasibility parameters of delivering the cognitive screening and management pathway in MS. This stage is in accordance with Medical Research Council (MRC) guidelines for development and evaluation of ‘complex interventions’ [23]. We will, therefore, determine these parameters, identify any operational issues in delivering the pathway, develop intervention fidelity tools, and produce a framework for cost-effectiveness analyses. We will also examine ‘usual care’ further (adding to data from our earlier work packages [19, 20]) and explore the potential for contamination when delivering the intervention. In addition, the logic model and underlying programme theory [20] will be further developed to move incrementally towards a well-established pathway founded on explicit application to real-world clinical settings.
Methods
Aim and objectives
The aim is to assess the feasibility of conducting a definitive RCT to investigate the clinical and cost-effectiveness of the NEuRoMS intervention in reducing the impact of cognitive problems in daily life amongst people with MS and the acceptability of the intervention.
The specific objectives, mapped onto different parts of the study, are listed in Table 1.
Study design
This is a multicentre mixed-methods feasibility study and fidelity evaluation. The study is in three parts. Part 1 is an observational study of those who receive screening and support for cognitive problems, using routinely collected clinical data. In part 2, we will evaluate the feasibility of undertaking a definitive trial comparing NEuRoMS intervention plus usual care to usual care only, amongst people with MS with mild cognitive problems, using a parallel group, multicentre, feasibility RCT with a nested fidelity evaluation. In part 3, semi-structured interviews will be undertaken with participants in the feasibility RCT, and clinicians and intervention providers involved in delivering the NEuRoMS cognitive screening and management pathway. A SPIRIT figure (Table 2) and study flowchart (Fig. 1) outline the study flow; a completed SPIRIT checklist is available as an additional file.
Participating centres
Participants will be recruited from MS outpatient clinics within three UK NHS hospitals: (1) Barts Health NHS Trust, (2) Cardiff and Vale University Health Board, and (3) Nottingham University Hospitals NHS Trust.
Study population
Participants for the feasibility study comprise people with MS, intervention providers, and clinicians.
Inclusion criteria
In part 1, we will include people identified by the clinical team as having a diagnosis of MS. In part 2, people with MS will be considered eligible if they completed cognitive screening (part 1) and were identified as having mild cognitive problems using pre-determined cut-offs [24, 25] and data from previous work [21]. In part 3, individual participants to be included should meet the following criteria: (1) people with MS who participated in part 2 feasibility RCT, (2) intervention providers (e.g., assistant psychologists/research nurses/assistant occupational therapists) delivering the NEuRoMS intervention to people with MS in part 2 feasibility RCT, and (3) clinicians (e.g., neurologists, MS nurse specialists, psychologists, occupational therapists) delivering the NEuRoMS screening and management pathway to people with MS.
All participants are required to be (1) aged 18 years or above, (2) able and willing to give consent, and (3) able to communicate in English.
Exclusion criteria
In part 2, participants will be excluded if they (1) are currently receiving neuropsychological intervention for cognitive problems and (2) previously received NEuRoMS intervention during a previous study [22].
Participant identification and consent procedures
All patient participants will be initially approached by their clinical team. Study sites will have an intervention provider working at their hospital, who will form part of the MS clinical care team and will assist with participant identification. All participants will provide informed consent before they enter the study.
In part 1, patients at the study sites will be approached by their clinical team ahead of their routine appointment at the MS clinic to complete the online screening. Contact will typically be initiated approximately 1 month before the scheduled appointment but may vary based on how appointments are arranged at each site. Patients will receive a weblink (by post, text message, or email) requesting them to access this link to complete the online cognitive screening at home (with telephone support from the site if required) or in-person in the clinic. Consent to use their screening data in part 1 will be obtained online from patients.
At the scheduled clinic appointment, eligible participants identified as having mild cognitive problems in part 1 will be invited by a member of the clinical care team to participate in the part 2 feasibility RCT following discussions regarding their cognitive screening results. Those agreeing to discuss the study with the intervention providers or research team will be contacted by phone, letter, or email to introduce the study, assess eligibility, answer questions, provide a copy of the participant information sheet, and obtain informed consent. Participants will receive a gift voucher for completing the questionnaires at each follow-up time point (3 months, 6 months) to thank them for their time.
In part 3, patients participating in part 2 who provide consent to be approached by the research team will be invited to part 3 interviews. Clinicians and intervention providers will be approached by the research team. All participants will receive a copy of the participant information sheet and consent form online or by post. Patient participants will also receive a copy of the interview guide. Informed consent will be obtained from all participants via phone or videoconferencing, by post, in-person, or online. Patient participants will receive a gift voucher for participating in interviews at each follow-up time point (3 months, 6 months) to thank them for their time.
Sample size
Based on reduced screening throughput at each site during the pandemic, and which now persists, we estimate that 930 patients will receive the cognitive screening link as part of their newly introduced clinical care (part 1) in 6 months.
We will recruit 60 participants to the part 2 feasibility RCT. Recommended sample size for feasibility RCTs range between 24 and 50 [26]. We believe 60 participants will enable us to optimally address the aims of this study and provide us with parameter estimates to confirm our sample size calculations for the definitive trial.
In part 3, we will interview 25 patient participants from the feasibility trial (10 from control group and 15 from intervention group) at two time points: after 3-month follow-up (time point no. 1) and after 6-month follow-up (time point no. 2). Additional interviewees will be recruited at time point no. 2 if there are dropouts. We will also interview 9 clinicians (three from each site) and the 3 intervention providers (one from each site). Sample sizes for the interviews are based on extant literature, which suggest these numbers will offer ‘theoretical sufficiency’ to answer specific questions [27] and inform the ongoing development of NEuRoMS. The sample size for the intervention providers is limited because there will only be three providers.
Randomisation and blinding
In the feasibility RCT, once the participant has been recruited, consented, and completed the baseline questionnaires, we will individually randomise them to control or intervention groups (ratio 1:1, stratified by study site), using an online dynamic adaptive algorithm [28], developed and maintained by the North Wales Organisation for Randomised Trials in Health (NWORTH) Clinical Trials Unit (CTU).
Blinding will not be possible for the participants and intervention providers due to the nature of the intervention. Research staff who are analysing the data will remain blind to allocation. Most outcome data will be self-reported and collected using online or postal questionnaires. Questionnaires collected over the phone will be collected by an independent researcher who will request participants not to reveal their group allocation or discuss their study involvement. At each assessment time point, the independent researcher will be asked to record if they were unblinded to group allocation, and if so, the reasons for this.
Intervention and usual care groups
All participants will have completed the online cognitive screening process (part 1) pre-randomisation. Cognitive screening is a new clinical procedure at each site involving a self-administered, brief online screening tool (completed at home prior to clinic visit or completed in clinic prior to routine neurology appointment) that can be administered with minimal support from clinical staff. The screening tool consists of computerised tasks (e.g. symbol substitution task which is a version of the Symbol Digit Modalities Test and/or word colour test which is a version of the Stroop test) that capture cognitive functions (information processing and attention) and brief questionnaires, assessing mood, fatigue, and self-reported cognitive function from the Multiple Sclerosis Quality of Life Inventory [29]. Test and questionnaire scores will be automatically calculated by the online system and transferred to the clinical team. This new clinical procedure will form part of routine care and will help identify cognitive problems and facilitate discussions between patients and clinicians, to encourage joint decisions about appropriate management for these problems.
In part 2, the intervention group will receive usual care plus the NEuRoMS cognitive management intervention. The control group will receive usual care only. The NEuRoMS intervention is a therapist-led, manualised, and multi-faceted programme, involving various components (e.g. information provision, goal setting) and a range of strategies and techniques (e.g. psychoeducation, compensatory strategies, boosting cognitive reserve). The intervention is person centred, tailored to the needs and lifestyle of each participant, and aims to help people with MS cope with and manage cognitive problems by establishing strategies that can be maintained once the intervention sessions are completed.
The intervention will be delivered by a trained therapist (i.e. intervention provider), under the supervision of a clinical psychologist or occupational therapist. In-person, videoconferencing, and telephone delivery options will be available. The duration of the intervention will be up to 4 h, spread across up to 6 sessions. We anticipate these sessions to occur over a 2-month period, based on patient availability.
The content of usual care, based on our knowledge of these sites, is our online cognitive screening plus signposting to the MS Society/MS Trust websites. We will document usual care received through a service-use questionnaire, clinical notes, and part 3 interviews.
Outcomes
The key outcomes of interest relate to the feasibility of proceeding to a definitive trial. The primary endpoints are therefore based on part 2, and the secondary endpoints relate to part 1 and part 3. Table 3 presents the primary endpoints, and Table 4 presents the secondary endpoints, including the method of assessment, assessment timepoints, and the corresponding study objective.
In addition to feasibility outcomes, the following measures will also be used to capture information about the part 2 participants at baseline and 3 and 6 months after randomisation:
-
Cognitive impairment assessed using Perceived Deficits Questionnaire [30]
-
Quality of life assessed using Multiple Sclerosis Impact Scale [31] and EQ-5D-5L [32]
-
Mood assessed using Patient Health Questionnaire-9 [33], Generalised Anxiety Disorder-7 scale [34], and Whooley Questions for depression screening [35]
-
Functional ability assessed using Nottingham Extended Activities of Daily Living Scale [36]
-
Self-efficacy assessed using Multiple Sclerosis Self-efficacy Scale [37]
-
Service-use questionnaire, based on a measure used in other MS trials [38] and adapted for use in the NEuRoMS project
-
Work-related issues assessed using Multiple Sclerosis Work Difficulties Questionnaire Short Form [39]
-
The extent to which work and medication adherence have been impacted by cognitive problems assessed using two single bespoke questions
-
Capability and wellbeing for health economics evaluation assessed using the ICEpop CAPability measure for Adults (ICECAP-A) [40].
We chose these measures because they (i) tap the domains of interest identified by our patient and public involvement (PPI) group (ii), were endorsed by our PPI partners, (iii) have good psychometric properties and are routinely applied in MS research, and (iv) are brief and easy to complete.
Data collection
Part 1 involves an observational study of those who receive cognitive screening and support, using routinely collected screening data. Observations of how people use and interact with screening will include anonymised usage data (e.g. duration, mode of completion, frequency and type of support received to aid completion, and the reminders required to complete screening) and screening scores from the completed screening tasks from those who gave consent.
Monthly teleconferences/videoconferences between a member of the research team and clinicians at the three MS clinics will also be documented with detailed notes recorded by the researcher and used as a data source. These conversations will explore any problems with implementation, possible solutions, and what is working well and why.
In part 2, once the participant has been recruited and consented, they will complete the demographics form and baseline questionnaires either online, over the phone with a member of the research team, or using postal paper copies. Participants will complete the same questionnaires at 3- and 6-month post-randomisation. Independent researchers, blinded to treatment allocation, will support participants who require help completing the questionnaires over the telephone and will contact participants to complete any missing questionnaire data.
We will keep a record of any intervention contamination. Contamination will be minimised by having only specific intervention providers deliver the intervention for the trial. Intervention providers will be specifically trained to deliver the intervention, and only they will have access to the intervention tools via a password-protected website. The intervention providers will only provide care to intervention group participants and not to control group participants. We acknowledge some contamination may occur if people with MS share information with others, but as the intervention is individually tailored and delivered one to one, the potential for contamination at a participant level is small. Therefore, we will assess to what extent all participants in both control and intervention groups received the NEuRoMS intervention by reviewing clinical notes and service-use questionnaire and through monthly supervision and mentoring sessions and part 3 interviews.
In part 3, semi-structured interviews will be undertaken with part 2 participants, clinicians involved in delivering the NEuRoMS cognitive screening and management pathway, and intervention providers. Interviews will explore the cognitive screening and management pathway, components of the intervention, and research processes, to refine the pathway, intervention, and programme theory prior to the definitive trial. Control participants will also be interviewed about their feelings about not being randomised to the intervention group, what we can do to improve return of questionnaires, and what care they received (to characterise usual care and assess any contamination). We will also enquire about participants’ experience of receiving their screening results. To aid participant recall, we will collect qualitative data from patient participants at two time points: after completion of 3-month follow-ups to gather feedback on the intervention and after completion of 6-month follow-ups to gather feedback on outcomes.
Interviews will mostly be conducted over the phone/videoconferencing; however, patient participants can request to be interviewed in-person. Semi-structured interview guides will be sent to patient participants ahead of the interview to foreshadow what the interview will cover. Interviews will be audio recorded and transcribed verbatim by an approved transcription service. Interviewers will keep field notes to capture contextual information. The interviewer will have a good understanding of the screening and intervention, but will not be directly involved in delivering either.
Adverse events
The occurrence of an adverse event (AE) or serious adverse event (SAE) because of study participation is unlikely since the study involves completing standardised tasks and questionnaires and receiving a manualised non-pharmacological intervention with trained professionals. Indeed, this has been the case in other MS trials of a similar intervention [38]. AEs and SAEs such as hospitalisation, distress, and death, in relation to participating in this study, will be recorded; however, these are likely to be rare events due to the nature of the study. ‘Notable events’ (i.e. any events that are considered out of ordinary) occurring during cognitive screening, or the intervention, will be recorded and monitored by the intervention providers or researchers. Participants will be informed of all research activities prior to participating in the study; thus, there will be no deception.
The results of the screening will be discussed with the patient by a healthcare professional, and, therefore, any concerns about the screening results will be addressed by the clinician. It is possible that talking about cognitive difficulties may sometimes create distress for people with MS. This distress will be dealt with during the intervention sessions or interviews on an individual basis. The intervention will be delivered in a clinical environment by a trained intervention provider who will receive monthly supervision. Therefore, the overall risk has been assessed as minimal.
If a participant is identified as having a high score on the Patient Health Questionnaire-9 and Generalised Anxiety Disorder-7 scale as part of the part 2 patient-reported outcomes (≥ 15 indicative of severe anxiety and depression [41]), we will recommend that they contact their GP to discuss this further. This will not affect their participation in the study, and GPs will already be aware of patients’ involvement in the part 2 study.
If a participant discloses information during the intervention sessions or during interviews indicating that they are at risk of self-harm, or discloses information about intention to harm others, the intervention provider and interviewer will follow the safeguarding policies of their employing organisation or local NHS Trust standard procedures. If the participant has responded to question 9 of the Patient Health Questionnaire-9 (“How often have you been bothered with … thoughts that you would be better off dead, or of hurting yourself”) with answer 3 (“Nearly every day”), when checked by the research team, this will be interpreted as a significant suicide risk and documented as an AE. The researcher will report the suicide risk to the principal investigator (PI) immediately. The PI/person delegated by PI will then deal with the situation as per local NHS Trust standard procedures. AEs and SAEs will be reviewed and monitored by the independent programme steering committee.
The interviews will be conducted by trained researchers who will follow a distress protocol in the event of distress during interviews [42]. Researchers will ensure they give sufficient time to participants for debriefing after the intervention sessions/interviews. Participants will be informed that they can end the study at any point. If the participant no longer wishes to continue and consent is withdrawn, the researcher will debrief the participant and provide support, as needed.
Patient participants will be advised in the participant information sheet to contact their general practitioner (GP) (and/or their occupational health/counselling services for clinician and intervention provider participants) if they feel distressed. Contact information of appropriate sources of support will be provided for patient participants who feel they need further information/support with respect to cognitive problems in MS. Participants and GPs of patient participants will also receive the contact details of the research team for enquiries about the research.
Fidelity evaluation
To ensure fidelity of delivery of the intervention, we will request intervention providers’ and participants’ consent to record intervention sessions (audio or video recording depending on the platform used and participants’ preference). When this is not possible, intervention providers will keep detailed notes. Intervention providers will also complete an intervention record form during/after each session, detailing the content of the therapeutic interaction. We anticipate 48 observations (up to 12 participants (4 per intervention provider) each receiving approximately 4 sessions) will be sufficient to identify intervention manual deviations and skills that require addressing in training for the definitive RCT trial.
A fidelity checklist will be completed based on the Conceptual Framework for Implementation Fidelity [43] for each case exploring adherence to the content, frequency, duration and coverage, and possible factors that moderate the adherence (e.g. intervention complexity, facilitation strategies, quality of delivery, responsiveness). A sample of data from the intervention record forms, from observations, and from case notes of interventions will be used to complete the checklists to identify where and how the intervention delivery deviated from that described in the intervention manual.
Findings will be used to refine the logic model, intervention documents, and training packages delivered to clinical team members and intervention providers for the clinical pathway, as necessary. We will develop and refine fidelity tools for the definitive trial and codebook for audio/video analysis of intervention delivery, based on work by Borrelli [44].
Statistical analysis
In part 1, descriptive statistics and frequencies will be computed using STATA software to describe screening usage by calculating the proportions of participants who completed the screening in different settings and devices and the frequency and type of support and reminders provided. The proportions of participants with no cognitive problems, mild cognitive problems, or moderate and severe cognitive problems will be computed using pre-determined cut-offs [24, 25] and data from previous work [21], and assessment of scale cut-offs will be made.
A full statistical and health economics analysis plan for part 2 will be written and agreed by the programme management group and the Programme Steering Committee before data collection is completed. As this is a feasibility RCT, analysis will focus on assessing the feasibility criteria to determine whether to proceed to a definitive trial. Recruitment and retention figures will be calculated. This will include an assessment of the size of the eligible population and those that consent to participate. From this accumulated data, we will check the assumptions of the sample size calculation for the RCT. Statistical analysis plans for the RCT will also be finalised with knowledge of the format of the data collected. We will focus on the traffic light stop/review/go criteria [45, 46] to progress to the definitive trial, particularly on recruitment (go, average 12/month; review, average 6–11/month; stop, average ≤ 5/month) and retention (go, ≥ 80%; review, 50–79%; stop, ≤ 49%).
Descriptive statistics will also be computed to summarise questionnaire data overall and per group. Exploratory analysis will be conducted using the principle of intention to treat. A repeated measures ANOVA will be used to assess changes in the questionnaire measures over time. Adjusted mean differences will be reported to assess differences over time and between groups. Analysis will adjust for stratification variables. All estimates will be presented with 95% confidence intervals.
Data from individual participants and subgroups of participants will also be assessed to determine whether any participant, or subgroup of participants, has a larger or smaller magnitude of changes in the questionnaire measures compared with other participants. Any findings will be considered exploratory and will be considered for incorporation into the design of the definitive RCT.
We will evaluate the use of single work question instead of the full MS Work Difficulties questionnaire [39]. Correlation and reliability analyses will be computed between the total score of the MS Work Difficulties questionnaire and the single question. We will also evaluate the use of the Whooley Questions instead of the full PHQ-9. Correlation analysis will be computed between the total score of the PHQ-9 and the Whooley Questions.
Levels of missing data will be monitored and presented as part of the ongoing data collection, cleaning, and reporting processes. For validated outcome measures where rules are identified for handling missing data, these methods will be implemented. As this is a feasibility study, no further imputation will be applied to the data. Suitability of outcome measures will be determined by the level of completeness. Potential key outcome measures (e.g. Multiple Sclerosis Impact Scale-psychological subscale) for the definitive RCT will be deemed appropriate if minimum success criteria are achieved or if we can identify solutions to overcome any identified issue.
Qualitative analysis
Qualitative data from part 3 will be analysed using a framework approach [47, 48] using QSR NVivo. Data will be coded by research team members, and the coded data will then be mapped to thematic matrices which reflect resources required for cognitive screening and management pathway to be delivered, contextual factors which influence its delivery, mechanisms which influence its affect, and outcomes which are described by participants. This will enhance our understanding of the key issues for stakeholders in relation to screening, intervention, and trial procedures. It will allow us to explore the behavioural elements of the intervention, essential resources, and barriers to screening and intervention delivery and trial procedures. If required, the framework will be revised to include new concepts introduced during the interviews, with input from PPI team members. Once all the data are mapped onto the framework, tables will be used to summarise each main theme. Interpretation of this data will inform a final revision of the logic model and programme theory and the design of the definitive trial. Intervention documents, training package, and outcome measures will be refined as necessary.
Health economics evaluation
The study will explore the feasibility of collecting resource/service use information through the use of the service use questionnaire that was successfully used in a previous study [38]. It was informed by other measures in similar populations or service/setting (e.g. review of Database of Instruments for Resource-Use Measurement website [49]), with a primary focus on collecting direct healthcare and personal social service costs (NHS/PSS perspective) and considering whether direct and indirect non-healthcare costs can be collected to inform a societal perspective. We refined the measure (with PPI and clinician input) to ensure that it reflects good practice [50].
Drawing on previous studies [19, 20], we will consider the outcome domains that stakeholders identify as being relevant and which measures best map across these domains. Justification for the choice of measure (e.g. EQ-5D-5L, ICECAP-A) will be supported by literature searches to ensure our approach is consistent within the field. We will assess the usefulness of instruments by examining descriptive statistics (e.g. completion rates, missing items) with exploration of possible ceiling effects. This assessment, in conjunction with the qualitative data obtained, will be used to finalise the economic outcome measures to use in the definitive trial, including any refinement needed. The outcome for the health economic evaluation will be to derive the framework for a full health economic evaluation for the definitive trial.
Data management
All data will be handled confidentially and will be anonymised or pseudonymised (as appropriate) and be kept separate from information about the identity of the participants and documents with patient identifiable data. Each participant will be assigned a unique identity number for use on case report forms, other study documents, and electronic databases. Electronic data including study databases will be held securely and password protected on secure university networks. Paper records will be held securely, in locked rooms and cabinets. Paper records will be entered onto electronic databases by research team. Accuracy of data entry will be checked by a member of the research team who did not complete the original data entry.
Governance
The study will be overseen by an independent programme steering committee, with an independent chair, expert clinician and researcher, statistician, and PPI representative. The study sponsor is the Nottinghamshire Healthcare NHS Foundation Trust. The study will be managed and coordinated by the programme management group, which consists of the chief investigator, programme manager, PPI coinvestigators, and other co-applicants and researchers involved with the NEuRoMS project.
Patient and public involvement
This protocol has been developed in conjunction with our PPI coinvestigators (who have MS) and our local MS-PPI group. Our PPI coinvestigators have been involved with every key stage of the research process from identifying research questions, guiding funding applications, developing and testing the cognitive screening technology and protocol development, and informing study design. All patient-facing material has been co-written with, and approved by, our PPI partners.
We will continue to work closely with our MS PPI group to ensure we produce useful findings that can facilitate the transferability of the screening and management pathway into practice in a range of healthcare settings. Our PPI coinvestigators and our PPI group will continue to be involved with every key stage of the research process (e.g. data collection, analysis, write up, and dissemination) providing us with the real-life experiences of living with MS and what they feel is needed.
Dissemination
Study findings will be disseminated to scientific audiences, people with MS, policymakers, healthcare networks, relevant organisations, and stakeholders. Study findings will be published in peer-reviewed journals, presented at national and international conferences, and made available to relevant patient groups via a range of dissemination channels. Our PPI coinvestigators will also disseminate research findings to the wider MS community and public through local and national networks (e.g. local support groups, newsletters) and through social media and other media channels. Participants will be provided with a lay summary of the findings (produced in consultation with our PPI coinvestigators and PPI group), and the summary will be made available on the NEuRoMS study website. Authorship on publications will be based on the International Committee of Medical Journal Editors Recommendations for the Conduct, Reporting, Editing, and Publication of Scholarly Work in Medical Journals [51].
Discussion
The need for timely identification and effective management of cognitive problems in MS has been highlighted by people with MS [19, 20], clinical guidelines [52], and International MS Consortia [53, 54]. This protocol describes a feasibility study delivering a cognitive screening and management pathway to identify, triage, and treat cognitive problems in people with MS. Following MRC guidelines [23], this study will evaluate key feasibility parameters of the pathway before proceeding to a definitive trial.
This feasibility study targets people with MS with mild cognitive problems since their level of impairment means they are more likely to benefit from a brief intervention introduced at an earlier stage in their care. Mild cognitive problems are often missed and are poorly understood, partly because the field of cognition in MS has tended to use dichotomous categorisations of ‘intact’ or ‘impaired’ to interpret cognitive performance [55, 56]. The data obtained from this study will broaden our current knowledge of cognitive problems in MS to give a better understanding of the prevalence of people with MS who experience cognitive problems of varying severity and to develop MS cognitive profiles amongst individual participants and subgroups of participants. This new understanding will help form relevant homogenous target groups for research studies and enable clinical teams to tailor support to patterns of cognitive deficit.
To help characterise and profile the part 2 participants, this study uses a comprehensive battery of outcome measures at baseline and to assess outcomes following the intervention. One potential uncertainty is whether these measures could be burdensome for participants to complete and therefore affect retention across the three timepoints (baseline, 3-month and 6-month follow-up), particularly amongst our sample of people with MS with cognitive problems. Our initial discussions with PPI members suggest that this will not be the case, but the feasibility and acceptability data gathered throughout the study will help us finalise the outcome measures ahead of the definitive RCT.
The NEuRoMS pathway utilises technological advances including digital administration of cognitive screening, which will afford people with MS the flexibility to complete screening in their own homes, on their own devices, and prior to their clinic appointment. Moreover, results from the cognitive screening will be automatically calculated by an online system and integrated into an easily understandable output made readily available to clinical teams. This could help facilitate conversations about cognitive problems amongst clinicians and people with MS within time-pressured clinical settings. However, some stakeholders may require additional support to use and engage with these digital tools [19, 20]. In addition, clinical services have been differentially affected by the COVID-19 pandemic, adopting different service provision strategies (e.g. a shift to remote delivery/monitoring) and dealing with unpredictable staff absences due to contracting the virus or self-isolation. Such challenges of conducting MS studies during COVID-19 have been described elsewhere [57]. Whilst considerable thought has been given to minimising these challenges, for example by codeveloping the cognitive screening platform with PPI input and working with the three NHS hospitals to embed the NEuRoMS pathway into their different systems, multiple data sources will be gathered to capture the feasibility and acceptability of digital delivery and to address this aspect for a future full-scale trial.
The feasibility study protocol described in this paper forms part of a National Institute for Health and Care Research Programme Grant for Applied Research, titled ‘neuropsychological evaluation and rehabilitation in multiple sclerosis’ (NEuRoMS) project. If feasibility is demonstrated, the definitive RCT will commence in 2023.
Availability of data and materials
Not applicable
Abbreviations
- AE:
-
Adverse event
- CTU:
-
Clinical Trials Unit
- DMT:
-
Disease-modifying therapies
- GP:
-
General practitioner
- ICECAP-A:
-
ICEpop CAPability measure for Adults
- MRC:
-
Medical Research Council
- MS:
-
Multiple sclerosis
- NEuRoMS:
-
Neuropsychological evaluation and rehabilitation in multiple sclerosis
- NHS:
-
National Health Service
- NWORTH:
-
North Wales Organisation for Randomised Trials in Health
- PI:
-
Principal investigator
- PPI:
-
Patient and public involvement
- RCT:
-
Randomised controlled trial
- REC:
-
Research ethics committee
- SAE:
-
Serious adverse event
- SPIRIT:
-
Standard Protocol Items Recommendations for Interventional Trials
References
Multiple Sclerosis International Federation. Atlas of MS 3rd Edition. 2020. https://www.msif.org/wp-content/uploads/2020/10/Atlas-3rd-Edition-Epidemiology-report-EN-updated-30-9-20.pdf. Accessed 23 Jan 2021.
Fischer M, Kunkel A, Bublak P, Faiss JH, Hoffmann F, Sailer M, et al. How reliable is the classification of cognitive impairment across different criteria in early and late stages of multiple sclerosis? J Neurol Sci. 2014;343(1–2):91–9.
Chiaravalloti ND, DeLuca J. Cognitive impairment in multiple sclerosis. Lancet Neurol. 2008;7(12):1139–51.
Cutajar R, Ferriani E, Scandellari C, Sabattini L, Trocino C, Marchello LP, et al. Cognitive function and quality of life in multiple sclerosis patients. J Neurovirol. 2000;6(Suppl2):S186–90.
Langdon DW, Thompson AJ. Cognitive problems in multiple sclerosis. MS Management. 1996;3:5–9.
Rao SM, Leo GJ, Ellington L, Nauertz T, Bernardin L, Unveragt F. Cognitive dysfunction in multiple sclerosis. II. impact on employment and social functioning. Neurology. 1991;41:691–6.
Fredrikson S. Economic impact of cognitive impairment in multiple sclerosis. In: DeLuca J, Sandroff BM, editors. Cognition and behavior in multiple sclerosis: American Psychological Association; 2018. p. 207–22.
Dorning H, Luck G, Holloway E. A lottery of treatment and care - MS services across the UK: technical report. 2013 https://www.mssociety.org.uk/ms-resources/lottery-treatment-and-care-technical-report. Accessed 18 July 2017.
MS Society, James Lind Alliance. Top 10 MS research priorities. 2013. https://www.mssociety.org.uk/ms-news/2013/09/top-10-ms-research-priorities-identified. Accessed 17 Oct 2016.
Taylor LA, Mhizha-Murira JR, Smith L, Potter KJ, Wong D, Evangelou N, et al. Memory rehabilitation for people with multiple sclerosis. Cochrane Database Syst Rev. 2021;10(CD008754). https://doi.org/10.1002/14651858.CD008754.pub4.
Devonshire V, Lapierre Y, Macdonell R, Ramo-Tello C, Patti F, Fontoura P, et al. The Global Adherence Project (GAP): a multicenter observational study on adherence to disease-modifying therapies in patients with relapsing-remitting multiple sclerosis. Eur J Neurol. 2011;18(1):69–77.
Croft A, Mynors G, Roberts M, Doncaster D, Bowen A. MS Forward View: a consensus for the future of MS services. Letchworth: MS Trust; 2016.
Trust MS. Rehabilitation medicine consultants and MS: report of a survey of rehabilitation consultants working in MS in the UK for the MS Forward View project. Letchworth: MS Trust; 2015.
Mynors G, Bowen A, Doncaster D. MS specialist nursing in the UK 2016: report on progress towards equitable provision. Letchworth: MS Trust; 2016.
Roberts M, Mynors G, Bowen A. Improving services for people with advanced MS. Letchworth: MS Trust; 2016.
Klein OA, das Nair R, Ablewhite J, Drummond A. Assessment and management of cognitive problems in people with multiple sclerosis: a national survey of clinical practice. Int J Clin Pract. 2019;73(3):e13300.
Giovannoni G, Butzkueven H, Dhib-Jalbut S, Hobart J, Kobelt G, Pepper G, et al. Brain health: time matters in multiple sclerosis. Mult Scler Relat Disord. 2016;9(Suppl 1):S5–48.
NEuRoMS. Neuropsychological evaluation and rehabilitation in multiple sclerosis. 2019. https://neuroms.org/. Accessed 23 Jan 2021.
Elwick H, Smith L, Mhizha-Murira JR, Topcu G, Leighton P, Drummond A, et al. Cognitive assessment in multiple sclerosis clinical care: a qualitative evaluation of stakeholder perceptions and preferences. Neuropsychol Rehabil. 2021. https://doi.org/10.1080/09602011.2021.1899942.
Smith L, Elwick H, Mhizha-Murira JR, Topcu G, Bale C, Evangelou N, et al. Developing a clinical pathway to identify and manage cognitive problems in multiple sclerosis: qualitative findings from patients, family members, charity volunteers, clinicians and healthcare commissioners. Mult Scler Relat Disord. 2021;49:102563. https://doi.org/10.1016/j.msard.2020.102563.
das Nair R, Topcu G, Evangelou N, Hoare Z, Drummond A, Kendrick D, et al. Neuropsychological evaluation and rehabilitation in multiple sclerosis – observational study. OSF Registries. 2021. https://doi.org/10.17605/OSF.IO/NKHDW.
das Nair R, Topcu G, Drummond A, Hoare Z, Fitzsimmons D, Evangelou N, et al. Neuropsychological evaluation and rehabilitation in multiple sclerosis – qualitative case study. ISRCTN Registry. 2021. https://doi.org/10.1186/ISRCTN15615992.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. Int J Nurs Stud. 2013;50(5):587–92.
Middleton RM, Pearson OR, Ingram G, Craig EM, Rodgers WJ, Downing-Wood H, et al. A rapid electronic cognitive assessment measure for multiple sclerosis: validation of cognitive reaction, an electronic version of the symbol digit modalities test. J Med Internet Res. 2020;22(9):e18234.
van Dongen L, Westerik B, van der Hiele K, Visser LH, Schoonheim MM, Douw L, et al. Introducing Multiple Screener: an unsupervised digital screening tool for cognitive deficits in MS. Mult Scler Relat Disord. 2020;38:101479.
Hooper R. Justifying sample size for a feasibility study. London: NIHR RDS London; 2019. https://www.rds-london.nihr.ac.uk/wpcms/wp-content/uploads/2019/02/Justifying-sample-size-for-feasibility-study-updated-22-Feb-2019.pdf. Accessed 22 July 2020
Dey I. Grounding Grounded Theory. Francisco: Academic Press; 1999.
Russell D, Hoare ZS, Whitaker R, Whitaker CJ, Russell IT. Generalised method for adaptive randomisation in clinical trials. Stat Med. 2011;30(9):922–34.
Ritvo PG, Fischer JS, Miller DM, Andrews H, Paty DW, LaRocca NG, et al. MSQLI - multiple sclerosis quality of life inventory: a user’s manual. New York: National Multiple Sclerosis Society; 1997.
Sullivan MJ, Edgley K, Dehoux E. A survey of multiple sclerosis: I. Perceived cognitive problems and compensatory strategy use. Can. J Rehabil. 1990;4(2):99–105.
Hobart J, Lamping D, Fitzpatrick R, Riazi A, Thompson A. The Multiple Sclerosis Impact Scale (MSIS-29): a new patient-based outcome measure. Brain. 2001;124(5):962–73.
Herdman M, Gudex C, Lloyd A, Janssen MF, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20(10):1727–36.
Kroenke K, Spitzer RL, Williams JBW. The PHQ-9. J Gen Intern Med. 2001;16(9):606–13.
Spitzer RL, Kroenke K, Williams JBW, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092–7.
Whooley MA, Avins AL, Miranda J, Browner WS. Case-finding instruments for depression. Two questions are as good as many. J Gen Intern Med. 1997;12(7):439–45.
Nicholl CR, Lincoln NB, Playford ED. The reliability and validity of the Nottingham Extended Activities of Daily Living Scale in patients with multiple sclerosis. Mult Scler. 2002;8(5):372–6.
Rigby SA, Domenech C, Thornton EW, Tedman S, Young CA. Development and validation of a self-efficacy measure for people with multiple sclerosis: the Multiple Sclerosis Self-efficacy Scale. Mult Scler. 2003;9(1):73–81.
Lincoln NB, Bradshaw LE, Constantinescu CS, Day F, Drummond AER, Fitzsimmons D, et al. Group cognitive rehabilitation to reduce the psychological impact of multiple sclerosis on quality of life: the CRAMMS RCT. Health Technol Assess. 2020;24(4):1–214.
Honan CA, Brown RF, Hine DW. The Multiple Sclerosis Work Difficulties Questionnaire (MSWDQ): development of a shortened scale. Disabil Rehabil. 2014;36(8):635–41.
Al-Janabi H, Flynn N, T, Coast J. Development of a self-report measure of capability wellbeing for adults: the ICECAP-A. Qual Life Res. 2012;21(1):167–76.
PHQ and GAD-7 Instructions. Instruction manual: instructions for Patient Health Questionnaire (PHQ) and GAD-7 measures. n.d. https://www.phqscreeners.com/images/sites/g/files/g10016261/f/201412/instructions.pdf. Accessed 22 July 2020.
Haigh C, Witham G. Distress protocol for qualitative data collection: Manchester Metropolitan University; 2015. https://www2.mmu.ac.uk/media/mmuacuk/content/documents/rke/Advisory-Distress-Protocol.pdf. Accessed 3 Sept 2018
Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S. A conceptual framework for implementation fidelity. Implementation Sci. 2007;2:40.
Borrelli B. The assessment, monitoring, and enhancement of treatment fidelity in public health clinical trials. J Public Health Dent. 2011;71(Suppl 1):S52–63.
Avery KNL, Williamson PR, Gamble C, Connell Francischetto E, Metcalfe C, Davidson P, et al. Informing efficient randomised controlled trials: exploration of challenges in developing progression criteria for internal pilot studies. BMJ Open. 2017;7(2):e013537.
Charlesworth G, Burnell K, Hoe J, Orrell M, Russell I. Acceptance checklist for clinical effectiveness pilot trials: a systematic approach. BMC Med Res Methodol. 2013;13(1):78.
Pope C, Ziebland S, Mays N. Qualitative research in healthcare: analysing qualitative data. BMJ. 2000;320:114–6.
Ritchie J, Lewis J. Qualitative research practice: a guide for social science students and researchers. London: Sage; 2003.
DIRUM Team. Database of instruments for resource use measurement. n.d. http://www.dirum.org/. Accessed 3 Sept 2021.
Thorn JC, Coast J, Cohen D, Hollingworth W, Knapp M, Noble SM, et al. Resource-use measurement based on patient recall: issues and challenges for economic evaluation. Appl Health Econ Health Policy. 2013;11(3):155–61.
International Committee of Medical Journal Editors. International Committee of Medical Journal Editors Recommendations For The Conduct, Reporting, Editing, And Publication Of Scholarly Work In Medical Journals. 2019. http://www.icmje.org/recommendations/. Accessed 6 Jun 2021.
National Institute for Health and Care Excellence. Multiple sclerosis in adults: management NICE Guidelines (CG186). 2014. https://www.nice.org.uk/guidance/CG186. Accessed 6 Sept 2021
Kalb R, Beier M, Benedict RHB, Charvet L, Costello K, Feinstein A, et al. Recommendations for cognitive screening and management in multiple scler.osis care. Mult Scler. 2018;24(13):1665–80.
Hobart J, Bowen A, Pepper G, Crofts H, Eberhard L, Berger T, et al. International consensus on quality standards for brain health-focused care in multiple sclerosis. Mult Scler. 2018;25(13):1809–18.
Sumowski JF, Benedict R, Enzinger C, Filippi M, Geurts JJ, Hamalainen P, et al. Cognition in multiple sclerosis: state of the field and priorities for the future. Neurology. 2018;90(6):278–88.
De Meo E, Portaccio E, Giorgio A, Ruano L, Goretti B, Niccolai C, et al. Identifying the distinct cognitive phenotypes in multiple sclerosis. JAMA Neurol. 2021;78(4):414–25.
das Nair R, Hunter R, Garjani A, Middleton RM, Tuite-Dalton KA, Nicholas RS, et al. Challenges of developing, conducting, analysing and reporting a COVID-19 study as the COVID-19 pandemic unfolds: an online co-autoethnographic study. BMJ Open. 2021;11(6):e048788.
Acknowledgements
We would like to thank our Nottingham Multiple Sclerosis Patient and Public Involvement Group for their wide-ranging involvement in the development of this study. Other members of the NEuRoMS Collective contributing to obtaining funding for the study, pathway and intervention development, and/or study design include Denise Kendrick, Stephen Timmons, Jennifer Martin, Shirley Thomas, Rod Middleton, Shaun Harris, and Kyle Harrington.
Consortia
On behalf of the NEuRoMS Collective
Funding
This report is an independent research funded by the National Institute for Health and Care Research (Programme Grants for Applied Research, neuropsychological evaluation and rehabilitation in multiple sclerosis — developing, evaluating, and implementing a clinical management pathway (NEuRoMS), RP-PG-0218–20002). The views expressed in this publication are those of the author(s) and not necessarily those of the NHS, the National institute for Health and Care Research, or the Department of Health and Social Care.
Author information
Authors and Affiliations
Consortia
Contributions
GT led on drafting the manuscript. All listed authors contributed to the study design and drafting of the manuscript. RdN, GT, AD, DF, ZH, PL, CB, and NE contributed to the conception of the project and obtaining funding for the study. CB and JT provided PPI input to study design and pathway and intervention development. The authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
The North West — Greater Manchester West Research Ethics Committee (REC) has given approval for the study (Reference number: 20/NW/0454, date: 13 Jan 2021). Substantial amendments that require review by the REC will not be implemented until the REC and Health Research Authority has granted approval. The ISRCTN will be notified of protocol modifications. Study participants will be notified of protocol modifications where appropriate.
Consent for publication
Not applicable
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1.
SPIRIT 2013 Checklist: Recommended items to address in a clinical trial protocol and related documents*.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Topcu, G., Smith, L., Mhizha-Murira, J.R. et al. Neuropsychological evaluation and rehabilitation in multiple sclerosis (NEuRoMS): protocol for a mixed-methods, multicentre feasibility randomised controlled trial. Pilot Feasibility Stud 8, 123 (2022). https://doi.org/10.1186/s40814-022-01073-5
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s40814-022-01073-5