Patient-reported experience measures (PREMs) are a unique measure of experience of patients which can help address the quality of care of the patients.
Our aim of the study is to collect quality of care outcomes with our newly navigated transcranial magnetic stimulation patient-reported experience measure (nTMS-PREMs) questionnaire among neurosurgical patients undergoing nTMS.
A single-centre prospective nTMS-PREMs 19-item questionnaire study was performed between February 2018 and December 2018 on patient referred for nTMS at our hospital. The Data was analysed using Likert scale, linear and logistic regression using statistical software (STATA 13.0®).
Fifty patient questionnaires were collected (30 males, 20 females, mean age of 47.6 ± 2.1 years) among which 74% of patients underwent both motor and language mapping with a mean duration of 103.3 ± 5.1 min. An overall positive response was noted from the results of the questionnaire, tiredness and anxiety being the common effects noted. Patients with the left-sided disease appreciated more the conditions provided in our laboratory (Q4, p = 0.040) and increasing age was related to less confidence and trust (Q6, p = 0.038) in the staff performing the exam. Younger patients tolerated nTMS better than older patients (> 65 years). PubMed literature search resulted in no relevant articles on the use of PREMs in nTMS patients.
nTMS is a well-tolerated non-invasive tool and nTMS-PREMS provides a promising role in identifying the unmet needs of the patients and improving the quality of their care.
Navigated transcranial magnetic stimulation (nTMS) has become in recent years a commonly used tool in the pre-operative planning for neurosurgical patients . nTMS is now being widely used as an important pre-operative tool for motor and speech mapping in eloquent glioma surgery (awake/asleep), brain metastasis, cavernoma, and vascular malformations [5, 7, 14, 15, 17, 20, 23, 25] and is a useful adjunct to impact the surgical indications, guide the surgical approach, and estimate and reduce the risk of inducing post-surgical deficits [26, 27]. It has further been highlighted in recent studies that the preoperative nTMS motor mapping/speech mapping provides improved outcome in patients with glioblastoma  and is also useful in language-eloquent tumour surgery in awake-ineligible patients . While a safe and non-invasive way to map the cerebral cortex, nTMS can be associated with anxiety or unpleasant experience  or discomfort  and can be time-consuming, with motor mapping requiring up to 90 min and language mapping requiring up to 120 min . To date, little is known about the overall patients’ experience during nTMS, with particular regard to how well the procedure is tolerated and what additional information it gives to patients in their overall healthcare experience. This is of particular relevance, since patients’ collaboration and understanding of nTMS are crucial for the success of the examination.
Patient-reported experience measures (PREMs) are increasingly used to assess the effectiveness of clinical care on a particular patient population (for example, Picker Patient Experience Questionnaire (PPE-15), Patient Experience Questionnaire (PEQ), Scottish Inpatient Patient Experience Survey (SIPES), Norwegian Patient Experience Questionnaire (NORPEQ), In-Patient Experiences of Health Care (I-PAHC)) [1,2,3,4, 11]. In neurosurgery, studies to evaluate patients’ experience and satisfaction have been performed, for example, in patients undergoing awake craniotomy [10, 18, 30]. However, no specific PREMs have been reported for the use of nTMS. In the present paper, we aim to document the first patient-reported experience measure for nTMS in neurosurgery (nTMS-PREMs).
Material and methods
A prospective study was carried out between January and December 2018 at our hospital. All patients (age ≥ 18 years old) who were referred for TMS at our Institution were involved. Patients were referred for TMS after multidisciplinary team (MDT) discussions when a lesion in a presumed eloquent brain was identified. All patients were instructed about TMS in person at the time of the first outpatient meeting in the neuro-oncology clinic and again on the day of the exam. In addition, patients and their families were supplied with a booklet explaining the details of the exam. TMS was performed as an outpatient procedure. A T1 post-contrast MRI for navigation purposes was acquired before or on the day of the exam. Patients who had the MRI on the same day of TMS had only a T1 post-gadolinium MRI sequence for navigation purposes and were given a break of approximately 1 h before proceeding to TMS. All patients underwent either motor mapping alone or a combination of motor and language mapping. In the latter case, motor and language mapping were performed on the same day as a continuous exam. Motor mapping was performed with single pulse stimulation at 105% of the resting motor threshold (RMT) while language mapping was performed with repetitive stimulation at 100% of the RMT. Two authors (S.P. and J.P.L.) performed all the mappings. After the mapping, the results were explained and discussed with patients, with particular regard to the relationship between positive responses and tumour location. Details of the nTMS protocol at our institution have been previously reported .
After the exam, all patients were invited to anonymously fill an ad hoc nTMS-PREMs questionnaire (Supplementary Material 1). The questionnaire was designed with reference to the Royal College of Surgeons (RCS) of England survey/audit indications with domains covering quality of the information provided, facilities of the laboratory, the test/examination, staff evaluation, and discharge information . The questionnaire evaluated the following domains of the TMS experience: background (the quality of the information provided before the exam, 3 questions); laboratory (the facilities of the TMS laboratory, 2 questions); staff (evaluating the examiners performing the procedure, 3 questions); exam (the experience during the exam itself, 5 questions); discharge information (the quality and accuracy of the information provided at discharge, 4 questions); and the overall rating of the nTMS experience (2 questions). One question within the “exam” section was aimed only at patients who had language mapping alongside the motor mapping. Each question was rated as a scale from 1 (very poor experience) to 5 (excellent experience). Each question was addressed individually as well as part of the 6 domains where the combined score (combined results of all questions within that domain) was determined. In order to provide a better global evaluation of each question and domain, the responses were also combined as follows: poor, ratings 1 and 2; neutral, rating 3; and good, ratings 4 and 5.
The following variables were analysed against each question and domain: age, gender, duration of the exam, and type of mapping (motor versus motor and language). The laterality of the disease, location of the disease, and RMT ratio (RMT disease side/RMT healthy side)—pathological (90% < RMT < 110%) versus non-pathological (all other values)—were assessed against each question in the “exam” domain. Linear regression was used for age and duration of the exam. Logistic regression was used for gender, laterality of the disease, RMT ratio, and type of mapping. Multinomial logistic regression was used for location. The combined score analysis was performed using ordered logistic regression analysis. A multivariate analysis was performed for the 6 domains. An adjustment for age, gender, duration, and type of monitoring was used for every domain and laterality and RMT ratio for the “exam” domain. A subgroup analysis for the older population was performed. p values < 0.05 were considered significant for all the performed analysis. Statistical software (STATA 13.0®) was used for all the performed analysis. All the analyses were performed after the study was completed.
In addition, a literature search was performed in PubMed to look for previous papers reporting PREMS related to TMS. We used MeSH terms related to nTMS and PREMS. There were no articles in the search that was dedicated to specific experience measures in nTMS. The study was registered in the local audit registry as a service improvement project approved by the Neurosurgical Department. Informed consent was taken with all the patients in the study for nTMS mapping. The pre-operative mapping was applied following the standard nTMS mapping protocol published previously .
Patients were referred from both the neuro-oncology and neurovascular services with a total of 50 questionnaires completed (30 males, 20 females, mean age of 47.6 ± 2.1 years)—2 patients did not return the questionnaires. The vast majority had an underlying brain tumour—46 (92.0%). The preferential location was on the left side (29 patients, 60.4%) with the frontal (22 cases, 48.9%) and temporal (13 cases, 28.9%) lobes being more commonly affected. Twenty-one patients (46.67%) had a pathological RMT ratio (mean RMT ratio, 1.0 ± 0.02). Seventy-four percent of patients underwent both motor and language mapping with a mean duration of 103.3 ± 5.1 min (motor only, 85.8 ± 6.1 min; motor and speech, 106.9 ± 5.9 min; p = 0.02, t test) (Table 1).
A breakdown of responses to the questionnaire is reported in Table 2. In general, patients reported a positive experience with nTMS, with 94% positive responses for the overall nTMS experience. Seven hundred ninety-two (85%) of the responses provided about our service were rated as good, and 648 (69%) rated with the maximum score. Taking into account the individual domains of the questionnaire, 89% of patients reported a positive score for the “background” domain, with a good understanding of TMS and availability of information prior to TMS taking place with only 7% rating this section poorly. The combined score for the “laboratory” domain was good in 85% of responses with 75% reporting no technical problems during the exam. The “staff” section had the highest positive rating, with 95% good responses, indicating confidence in the staff performing the investigation (95%), presence of knowledge (92%), and support from staff (96%). The “exam” domain had the lowest positive rating (70% as good) with a poor experience due to anxiety and pain reported by 26% and 24% of patients, respectively. In addition, 16% of patients reported tiredness during/after the exam and difficulties in concentration. Reassuringly, 94% of patients felt the exam duration met their expectations and was acceptable. The quality of the “discharge information” provided was well rated by the patients (84% rated as good) with 88% of patients feeling they had a better understanding of the relationship between their lesion and the eloquent areas of the brain and 70% of patients clearly understood the importance of nTMS in the context of the surgical treatment they were about to receive.
The significant results from the univariate statistical analysis are reported in Table 3 (the complete table of results is provided in Supplementary Table 2). An increased duration of the exam was related to increased pain felt during the exam (Q13, p = 0.004) and a poorer understanding of the significance of the results for the surgical treatment (Q14, p = 0.031). Increasing age was related to less confidence and trust (Q6, p = 0.038) and less ability to recognize knowledge and experience (Q7, p = 0.003) in the staff performing the exam (Table 3).
The univariate analysis was also repeated against each domain of the questionnaire. This revealed that longer exams were related to a poorer rate of the laboratory conditions (p = 0.017). Increasing age was related to a poorer rate of staff performance (p = 0.001). Concerning the exam, the patients who had only motor mapping had a better experience than the ones who had both motor and language mapping (p = 0.020). Patients who had frontal lesions and longer mapping reported worse experiences (p = 0.028 and p = 0.003). The quality of the information provided at discharge was better in patients who had motor mapping only (p = 0.001) and worse in patients who had longer mappings (p = 0.002). None of the studied variables seemed to influence the way patients rated their overall experience of nTMS (all p > 0.05) (Table 4).
The multivariate analysis confirmed age (p = 0.01) and duration of the exam (p = 0.05) as two major factors influencing the rating of the TMS exam. Increasing age was related to a poorer rating in almost all domains with exception of the laboratory conditions and increased duration of the exam was related to the poor rating of laboratory conditions (p = 0.03) and worse discharge information (p = 0.003) (Table 5 and Supplemental Table 3)
PREMs play an important role in evaluating the experience of patients to an intervention that leads to the evaluation of patients’ satisfaction and is useful for research, quality improvement projects, clinician performance evaluation, audit, and economic evaluation [1, 11]. In recent years, generic- and intervention-specific PREMs have been developed and used in different areas of clinical medicine and surgical practice, stressing the relevance of patient satisfaction to a patient-centred approach in modern medicine [1, 3, 4, 11]. Well-established surgical PREMs have already been developed for specific surgical interventions, like hernia repair or hip replacement and these have been approved for use in the UK and worldwide . In neurosurgery, intervention-specific PREMs will act as an important indicator of the quality of care of neurosurgical patients and enhance research, quality governance, and economic evaluation/cost-effectiveness of the overall treatment/surgical decision-making and execution.
Over the last decade, nTMS has been used by neurosurgeons to map functional areas of the brain for surgical planning in neuro-oncology [5, 22], AVM resection [7, 9, 16], and epilepsy . A successful nTMS depends largely on patient cooperation, with a long duration of the exam and fatigue or discomfort potentially affecting the results of the mapping. PREMs specifically designed to assess the nTMS experience can give a valuable insight into patient counselling, experience during the procedure, side effects, duration of the test, and how the results of the mapping are understood and perceived by patients. The information provided can in turn be used as a feedback for the nTMS team to allow self-assessment and service improvement. Our literature search through PubMed showed that there are currently no PREMs specifically designed for TMS. Previous papers looked at patient experience during repetitive TMS for therapeutic application . Singh et al.  looked at experience and attitudes in patients undergoing repetitive TMS for psychiatric conditions in North India over a 3-month period. They noted an overall positive experience in the context of repetitive TMS for treatment of depression, with a majority agreeing they would recommend TMS to others. A similar result was reported by an earlier study carried out in Tasmania in 2001, again in the context of rTMS for depression . In neurosurgery, recent studies [14, 23, 28, 29] focused on the occurrence of pain, discomfort, and seizures during pre-surgical brain mapping. The authors concluded that nTMS is safe and generally well tolerated. Despite giving useful information on the safety and tolerability of nTMS, this study did not report PREMs addressing the whole patient experience.
In the present paper, we report the first specific nTMS-PREMs. To this effect, we designed a patient questionnaire following the indications of the Royal College of Surgeon in auditing patient experience and satisfaction and the published literature review on commonly developed PREMs [1, 19]. As a result, six domains were identified and evaluated: background information, laboratory, staff, exam experience, discharge information, and overall rating of the nTMS experience. Our results show that nTMS is largely well-tolerated and patients have an overall good experience with nTMS at different time points of the mapping. In all domains, there was a majority of positive responses, with 94% of positive responses for the overall nTMS assessment. However, approximately one in four patients reported the occurrence of anxiety and pain during the exam. Both univariate analysis and multivariate analysis confirmed the age and duration of exam as two major factors that influence patients’ experience during the TMS procedure. The univariate analysis clarified that longer duration of mapping and language mapping are related to a poorer experience. The poorer experience with language mapping can be explained on the basis of the longer duration of the test and on the discomfort/pain induced by repetitive stimulation involving the temporalis muscle [27,28,29]. Similarly, an increased duration of the exam was related to a poorer understanding of the discharge information, with particular regard to the role of TMS in planning the surgical treatment. We speculate that this is due to the difficulty of patients to maintain attention and retain information due to fatigue after a long mapping session. Elderly patients tended to give a poorer assessment of the staff performing nTMS. This result may be explained on the basis that only very few negative responses were reported concerning the staff (with a possible influence on the statistical result). However, we acknowledge that nTMS was performed by relatively junior members within the neuro-oncology team and therefore, we cannot exclude that a perceived “generational gap” between patients and healthcare professionals may have played a role [21, 31].
The information gathered from the PREMs recorded in this study can be used to improve clinical practice. The poor experience reported with long duration of mapping can be mitigated by ensuring patients can take appropriate rest. It has now become customary at our institution to offer patients a break in between motor and language mapping, so that they can be more relaxed and focused during the language testing. In addition, on top of providing patients with a booklet containing all the information about nTMS before the testing, we make sure to spend enough time to explain the results of mapping, showing patients their nTMS-generated maps. After nTMS, the majority of patients reported a good understanding of the relationship between the tumour and functional areas of the brain. This is relevant, as nTMS results can be used for better patient counselling at the time of consenting for an operation. It is now a routine at our institution to include nTMS-generated maps, when available, as part of the information presented to patients and relatives when describing the challenges and risks of a specific neurosurgical intervention in a highly functional area.
This is a single-centre pilot study in a limited number of patients. Further multicentric, international studies are warranted to further validate our questionnaire and confirm the generalisability of our results across different countries and patient populations. Our pilot, single-centre experience will serve as the necessary basis for such studies.
nTMS is an overall well-tolerated procedure, with positive feedback reported by the vast majority of patients. Poorer experience has been identified in elderly patients and in patients undergoing long mapping, with particular regard to pain and understanding of nTMS results. This information can help in tailoring the nTMS experience to individual patients’ needs.
Beattie M, Murphy DJ, Atherton I, Lauder W (2015) Instruments to measure patient experience of healthcare quality in hospitals: a systematic review. Syst Rev 23(4):97
Black N, Varaganum M, Hutchings A (2014) Relationship between patient reported experience (PREMs) and patient reported outcomes (PROMs) in elective surgery. BMJ Qual Saf 23(7):534–542
Christalle E, Zeh S, Hahlweg P et al (2018) Assessment of patient centredness through patient-reported experience measures (ASPIRED): protocol of a mixed-methods study. BMJ Open 8:e025896
Fernandes S, Fond G, Zendjidjian X, Michel P, Baumstarck K, Lancon C et al (2019) The patient-reported experience measure for improving quality of care in mental health (PREMIUM) project in France: study protocol for the development and implementation strategy. Patient Prefer Adherence 13:165–177
Frey D, Schilt S, Strack V, Zdunczyk A, Rösler J, Niraula B et al (2014) Navigated transcranial magnetic stimulation improves the treatment outcome in patients with brain tumors in motor eloquent locations. Neuro-Oncology 16(10):1365–1372
Garry W, Martin J, Kirkby K, Pridmore S (2001) Transcranial magnetic stimulation: experience, knowledge and attitudes of recipients. Aust N Z J Psychiatry 35:58–61
Ille S, Picht T, Shiban E, Meyer B, Vajkoczy P, Krieg SM (2018) The impact of nTMS mapping on treatment of brain AVMs. Acta Neurochir 160(3):567–578
Jung J, Lavrador JP, Patel S, Giamouriadis A, Lam J, Bhangoo et al (2019) First UK experience of §navigated Transcranial magnetic stimulation in pre-surgical mapping of brain tumours. World Neurosurg 122:e1578–e1587
Kato N, Schilt S, Schneider H, Frey D, Kufeld M, Vajkoczy P, Picht T (2014) Functional brain mapping of patients with arteriovenous malformations using navigated transcranial magnetic stimulation: first experience in ten patients. Acta Neurochir 156(5):885–895
Khu KJ, Doglietto F, Radovanovic I, Taleb F, Mendelsohn D, Zadeh G, Bernstein M (2010) Patients' perceptions of awake and outpatient craniotomy for brain tumor: a qualitative study. J Neurosurg 112(5):1056–1060
Kingsley C, Patel S (2017) Patient-reported outcome measures and patient- reported experience measures. BJA Educ 17(4):137–144
Klomjai W, Katz R, Lackmy-Vallée A (2015) Basic principles of transcranial magnetic stimulation (TMS) and repetitive TMS (rTMS). Ann Phys Rehabil Med 58
Koudijs SM, Leijten FS, Ramsey NF, van Nieuwenhuizen O, Braun KP (2010) Lateralization of motor innervation in children with intractable focal epilepsy—a TMS and fMRI study. Epilepsy Res 90:140–150
Krieg SM, Shiban E, Buchmann N, Gempt J, Foerschler A, Meyer B, Ringel F (2012) Utility of presurgical navigated transcranial magnetic brain stimulation for the resection of tumors in eloquent motor areas. J Neurosurg 116(5):994–1001
Krieg SM, Lioumis P, Mäkelä JP, Wilenius J, Karhu J, Hannula H, Savolainen P, Lucas CW, Seidel K, Laakso A, Islam M, Vaalto S, Lehtinen H, Vitikainen AM, Tarapore PE, Picht T (2017) Protocol for motor and language mapping by navigated TMS in patients and healthy volunteers; workshop report. Acta Neurochir 159(7):1187–1195
Kronenburg A, van Doormaal T, van Eijsden P, van der Zwan A, Leijten F, Han K (2014) Surgery for a giant arteriovenous malformation without motor deterioration: preoperative transcranial magnetic stimulation in a non-cooperative patient. J Neurosurg Pediatr 14(1):38–42
Lefaucheur JP, Picht T (2016) The value of preoperative functional cortical mapping using navigated TMS. Neurophysiol Clin 46(2):125–133
Manninen PH, Balki M, Lukitto K, Bernstein M (2006) Patient satisfaction with awake craniotomy for tumor surgery: a comparison of remifentanil and fentanyl in conjunction with propofol. Anesth Analg 102(1):237–242
Meredith P, Wood C (1995) The development of the Royal College of Surgeons of England's patient satisfaction audit service. J Qual Clin Pract 15(2):67–74
Paiva WS, Fonoff ET, Marcolin MA, Bor-Seng-Shu E, Figueiredo EG, Teixeira MJ (2013) Navigated transcranial magnetic stimulation in preoperative planning for the treatment of motor area cavernous angiomas. Neuropsychiatr Dis Treat 9:1885–1888
Peck BM (2011) Age-related differences in doctor-patient interaction and patient satisfaction. Current gerontology and geriatrics research, article ID 137492
Picht T, Schmidt S, Brandt S, Frey D, Hannula H, Neuvonen T et al (2011) Preoperative functional mapping for rolandic brain tumor surgery: comparison of navigated transcranial magnetic stimulation to direct cortical stimulation. Neurosurgery 69(3):581–589
Picht T, Krieg SM, Sollmann N, Rösler J, Niraula B, Neuvonen T, Savolainen P, Lioumis P, Mäkelä JP, Deletis V, Meyer B, Vajkoczy P, Ringel F (2013) A comparison of language mapping by preoperative navigated transcranial magnetic stimulation and direct cortical stimulation during awake surgery. Neurosurgery 72(5):808–819
Picht T, Frey D, Thieme S, Kliesch S, Vajkoczy P (2016) Presurgical navigated TMS motor cortex mapping improves outcome in glioblastoma surgery: a controlled observational study. J Neuro-Oncol 126(3):535–543
Raffa G, Quattropani MC, Scibilia A, Conti A, Angileri FF, Esposito F, Sindorio C, Cardali SM, Germanò A, Tomasello F (2018) Surgery of language-eloquent tumors in patients not eligible for awake surgery: the impact of a protocol based on navigated transcranial magnetic stimulation on presurgical planning and language outcome, with evidence of tumor-induced intra-hemispheric plasticity. Clin Neurol Neurosurg 168:127–139
Rosenstock T, Picht T, Schneider H, Koch A, Thomale UW (2019) Left perisylvian tumor surgery aided by TMS language mapping in a 6-year-old boy: case report. Childs Nerv Syst 35(1):175–181
Schwarzer V, Bährend I, Rosenstock T, Dreyer FR, Vajkoczy P, Picht T (2018) Aphasia and cognitive impairment decrease the reliability of rnTMS language mapping. Acta Neurochir 160(2):343–356
Singh S, Sharma M, Aggarwal A, Avasthi A (2018) The knowledge, experience and attitudes of recipients of repetitive transcranial magnetic stimulation: a study from North India. Asian J Psychiatr 31:102–106
Tarapore PE, Picht T, Bulubas L, Shin Y, Kulchytska N, Meyer B, Berger MS, Nagarajan SS, Krieg SM (2016) Safety and tolerability of navigated TMS for preoperative mapping in neurosurgical patients. Clin Neurophysiol 127(3):1895–1900
Wahab SS, Grundy PL, Weidmann C (2011) Patient experience and satisfaction with awake craniotomy for brain tumours. Br J Neurosurg 25(5):606–613
Williams SL, Haskard KB, DiMatteo MR (2007) The therapeutic effects of the physician-older patient relationship: effective communication with vulnerable older patients. Clin Interv Aging 2(3):453–467
The authors would like to acknowledge the Department of Neurosurgery at King’s College Hospital, London, for support during the study.
Conflict of interest
The authors declare that they have no conflict of interest.
All patients involved in the study voluntarily completed the questionnaire after informed consent regarding the study.
The authors report on patient reported experience measures (PREMs) for navigated transcranial magnetic stimulation (nTMS). They argue that while nTMS provides safe and non-invasive cortical mapping the examination is often long and associated with anxiety and discomfort. Although patient collaboration is essential for a successful examination, PREMs specific to nTMS have not been reported before. The authors use a new questionnaire designed in house, on guidelines from the Royal College of Surgeons, and review outcomes on 50 adult patients with eloquent brain lesions (tumours in 92%), recruited between January and December 2018, who go on to have surgery. The examination is carried out as an out-patient procedure; patients are given an explanatory booklet before the test and a discussion on the results is carried out on completion. Patients were then given the questionnaire to complete; only two out of 50 were not returned. Responses were overall good, but anxiety and pain were identified frequently in the Exam domain of the questionnaire. This is an interesting study that addresses the impact and patient perception of nTMS. The authors acknowledge a major limitation related to the single-centre nature of this study - its use in other centres and its external validation is an important subsequent step to this work.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article is part of the Topical Collection on Neurosurgery general
A portion of this paper was presented as a poster in the Society of British Neurosurgeons (SBNS) Spring Meeting 2019 held in Manchester, UK, on 19–22 March 2019 and a poster in EANS Congress 2019, held in Dublin, Ireland on 24–28 September 2019.
About this article
Cite this article
Patel, S., Ghimire, P., Lavrador, J.P. et al. Patient-reported experience measures in patients undergoing navigated transcranial magnetic stimulation (nTMS): the introduction of nTMS-PREMs. Acta Neurochir 162, 1673–1681 (2020). https://doi.org/10.1007/s00701-020-04268-y
- Unmet needs
- Quality of care