Abstract
The Early Mobility Impairment Questionnaire (EMIQ) was developed to facilitate early identification of mobility impairments in multiple sclerosis (MS) patients. We describe the initial development of the EMIQ with a focus on the psychometric evaluation of the questionnaire using classical and item response theory methods. The initial 20-item EMIQ was constructed by clinical specialists and qualitatively tested among people with MS and physicians via cognitive interviews. Data from an observational study was used to make additional updates to the instrument based on exploratory factor analysis (EFA) and item response theory (IRT) analysis, and psychometric analyses were performed to evaluate the reliability and validity of the final instrument’s scores and screening properties (i.e., sensitivity and specificity). Based on qualitative interview analyses, a revised 15-item EMIQ was included in the observational study. EFA, IRT and item-to-item correlation analyses revealed redundant items which were removed leading to the final nine-item EMIQ. The nine-item EMIQ performed well with respect to: test–retest reliability (ICC = 0.858); internal consistency (α = 0.893); convergent validity; and known-groups methods for construct validity. A cut-point of 41 on the 0-to-100 scale resulted in sufficient sensitivity and specificity statistics for viably identifying patients with mobility impairment. The EMIQ is a content valid and psychometrically sound instrument for capturing MS patients’ experience with mobility impairments in a clinical practice setting. Additional research is suggested to further confirm the EMIQ’s screening properties over time.
Similar content being viewed by others
References
Definition of MS. 2014;Available at: URL: http://www.nationalmssociety.org/What-is-MS/Definition-of-MS#. Accessed Oct 14, 2014
Kingwell E, Marriott JJ, Jette N, Pringsheim T, Makhani N, Morrow SA, Fisk JD, Evans C, Beland SG, Kulaga S, Dykeman J, Wolfson C, Koch MW, Marrie RA (2013) Incidence and prevalence of multiple sclerosis in Europe: a systematic review. BMC Neurol 13:128
Janzen W, Turpin KV, Warren SA, Marrie RA, Warren KG (2013) Change in the health-related quality of life of multiple sclerosis patients over 5 years. Int J MS Care 15:46–53
Buhse M, Banker WM, Clement LM (2014) Factors associated with health-related quality of life among older people with multiple sclerosis. Int J MS Care 16:10–19
van Asch P (2011) Impact of mobility impairment in multiple sclerosis 2—patients’ perspectives. European Neurological Review 6:115–120
Krause I, Kern S, Horntrich A, Ziemssen T (2013) Employment status in multiple sclerosis: impact of disease-specific and non-disease-specific factors. Mult Scler 9(13):1792–1799. doi:10.1177/1352458513485655
Comi G, Filippi M, Barkhof F, Durelli L, Edan G, Fernandez O, Hartung H, Seeldrayers P, Sorensen PS, Rovaris M, Martinelli V, Hommes OR (2001) Effect of early interferon treatment on conversion to definite multiple sclerosis: a randomised study. Lancet 357:1576–1582
Jacobs LD, Beck RW, Simon JH, Kinkel RP, Brownscheidle CM, Murray TJ, Simonian NA, Slasor PJ, Sandrock AW (2000) Intramuscular interferon beta-1a therapy initiated during a first demyelinating event in multiple sclerosis. CHAMPS Study Group. N Engl J Med 343:898–904
Kappos L, Freedman MS, Polman CH, Edan G, Hartung HP, Miller DH, Montalban X, Barkhof F, Radu EW, Metzig C, Bauer L, Lanius V, Sandbrink R, Pohl C (2009) Long-term effect of early treatment with interferon beta-1b after a first clinical event suggestive of multiple sclerosis: 5-year active treatment extension of the phase 3 BENEFIT trial. Lancet Neurol 8:987–997
Kinkel RP, Kiollman C, O’Connor P, Murray TJ, Simon J, Arnold D, Bakshi R, Weinstock-Gutman B, Brod S, Cooper J, Duquette P, Eggenberger E, Felton W, Fox R, Freedman M, Galetta S, Goodman A, Guarnaccia J, Hashimoto S, Horoqitz S, Javerbaum J, Kasper L, Kaufman M, Kerson L, Mass M, Rammohan K, Reiss M, Rolak L, Rose J, Scott T, Sehorst J, Shin R, Smith C, Stuart W, Thurston S, Wall M (2006) IM interferon beta-1a delays definite multiple sclerosis 5 years after a first demyelinating event. Neurology 66:678–684
Martin CL, Phillips BA, Kilpatrick TJ, Butzkueven H, Tubridy N, McDonald E, Galea MP (2006) Gait and balance impairment in early multiple sclerosis in the absence of clinical disability. Mult Scler 12:620–628
Swingler RJ, Compston DA (1992) The morbidity of multiple sclerosis. Q J Med 83:325–337
LaRocca NG (2011) Impact of walking impairment in multiple sclerosis: perspectives of patients and care partners. Patient 4:189–201
World Health Organization (2007) Internationl classification of functioning, disability and health: children and youth version: ICF-CY. World Health Organization, Geneva
Anderseck B, van Asch P, Johnson J, Agarwal S, Hudgens S, Humphrey L, Medcalf R, Ziemssen T (2013) Early mobility impairment: bridging the communication gap between people with multiple sclerosis and their healthcare providers. Presented at 23rd Meeting of the European Neurological Society, Barcelona, Spain
Kurtzke JF (1983) Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology 33:1444–1452
Hohol MJ, Orav EJ, Weiner HL (1999) Disease steps in multiple sclerosis: a longitudinal study comparing disease steps and EDSS to evaluate disease progression. Mult Scler 5:349–354
Hohol MJ, Orav EJ, Weiner HL (1995) Disease steps in multiple sclerosis: a simple approach to evaluate disease progression. Neurology 45:251–255
Marrie RA, Goldman M (2007) Validity of performance scales for disability assessment in multiple sclerosis. Mult Scler 13:1176–1182
The EuroQol Group (1990) EuroQol-5D: a new facility for the measurement of health-related quality of life. Health Policy 16:199–208
Hobart J, Riazi A, Lamping R (2003) Measuring the impact of MS on walking ability: the 12-item MS Walking Scale (MSWS-12). Am Acad Neurol 60:31–36
Muthén LK, Muthén BO (2004) Mplus user’s guide, 3rd edn. Muthén & Muthén, Los Angeles
Cai L, Du Toit SHC, Thissen D (2012) IRTPRO: flexible, multidimensional, multiple categorical IRT modeling. [Scientific Software]. Scientific Software International, International Lincolnwood, IL
Gliem JA, Gliem RR (2003) Calculating, interpreting, and reporting Cronbach’s alpha reliability coefficient for Likert-type scales. Presented at Midwest Research-to-Practice Conference in Adult, Continuing, and Community Education, Columbus, OH
Pompilus F, Burgess S, Hudgens S, Banderas B, Daniels S (2015) Development and validation of a novel patient-reported treatment satisfaction measure for hyperfunctional facial lines: facial line satisfaction questionnaire. J Cosmet Dermatol. 14(4):274–285. doi:10.1111/jocd.12166
Aday LA (1996) Designing and conducting health surveys: a comprehensive guide. Jossey-Bass, San Francisco
Cronbach LJ (1951) Coefficient alpha and the internal structure of tests. Psychometrika 16:297–334
Nunnally JC, Bernstein I (1994) The assessment of reliability. Psychometric theory, 3rd edn. McGraw Hill, New York. pp 248–292
Fayers P, Machin D (2000) Quality of life: assessment, analysis, and interpretation. Wiley and Sons, West Sussex
Schumacker RE, Lomax RG (1996) A beginner’s guide to structural equation modeling. Lawrence Erlbaum Associates, Mahwah
MacCallum RC, Browne MW, Sugawara HM (1996) Power analysis and determination of sample size for covariance structure modeling. In: Psychological methods, 1 edn. pp 130–149
Kaiser HF (1960) The application of electronic computers to factor analysis. Educ Psychol Measur 20:141–151
Bates D, Burks J, Globe D, Signori M, Hudgens S, Denys P, MacDiarmid S, Nitti V, Odderson I, Ross AP, Chancellor M (2013) Development of a short form and scoring algorithm from the validated actionable bladder symptom screening tool. BMC Neurol 13:78
Hu L, Bentler PM (1999) Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model 6:1–55
Browne MW, Cudeck R (1993) Alternative ways of assessing model fit. In: Bollen KA, Long JS (eds) Testing structural equation models. Sage, Newbury Park, pp 136–162
Coon CD, Williams VSL, Nelson LM, Price MA. Determining missing data rules for Patient-Reported Outcomes: Alpha-if-item-deleted. 2010. ISPOR 15th Annual International Meeting
Youden WJ (1950) Index for rating diagnostic tests. Cancer 3:32–35
Kalron A, Nitzani D, Magalashvili D, Dolev M, Menascu S, Stern Y, Rosenblum U, Pasitselsky D, Frid L, Zeilig G, Barmatz C, Givon U, Achiron A (2015) A personalized, intense physical rehabilitation program improves walking in people with multiple sclerosis presenting with different levels of disability: a retrospective cohort. BMC Neurol 15:21
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of interest
T Ziemssen has received personal compensation for participating on advisory boards, trial steering committees and data and safety monitoring committees as well as for scientific talks and project support from: Bayer HealthCare, Biogen Idec, Elan, Genzyme, Merck Serono, Novartis, Roche, Sanofi-Aventis, Synthon and Teva. G Phillips and A Lee are currently employed by Biogen who provided financial support for research. A Mathias was employed by Adelphi Values at the time of research, which received payment from Biogen to assist with the research process. C Coon was employed at the time of research by Adelphi Values, which received payment from Biogen to assist with the research process. C Foley and R Sen are currently employed by Adelphi Values, which received payment from Biogen to assist with the research process.
Design, conduct, and financial support for this research were provided by Biogen. Biogen participated in the interpretation of data, review, and approval of the manuscript. All authors contributed to the development of the publication and maintained control over the final content.
Ethical standards
This study was conducted in accordance with the British Healthcare Business Intelligence Association (BHBIA) Legal and Ethical Framework (Dec 2012 Legal and Ethical guidelines for Healthcare MR), Association of the British Pharmaceutical Industry (ABPI) Code of Conduct, ABPI Adverse Event Guidelines (April 2013), and Data Protection legislation.
Rights and permissions
About this article
Cite this article
Ziemssen, T., Phillips, G., Shah, R. et al. Development of the multiple sclerosis (MS) early mobility impairment questionnaire (EMIQ). J Neurol 263, 1969–1983 (2016). https://doi.org/10.1007/s00415-016-8210-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00415-016-8210-4