Abstract
Purpose
The objective was to determine the concurrent validity of questions on arm, shoulder and neck symptoms of an Internet-based questionnaire. In addition, the inter-observer reliability of physical examinations by occupational physicians was investigated.
Methods
A total of 160 employees of a Dutch occupational health service were approached, of which 106 participated. Right after the assessment of arm, shoulder and neck symptoms using a self-administered questionnaire, each participant was examined by two occupational physicians. The presence of symptoms in the past 7 days was compared to the physical examinations. The participation of two occupational physicians allowed us to study also the inter-observer reliability.
Results
Overall, the concurrent validity of the symptom questions of the questionnaire can be defined as poor to moderate with κ values between 0.16 and 0.53. Detecting the presence of symptoms (p pos) could be considered as moderately valid with values below 0.60, but the p neg shows that the concurrent validity for detecting the absence of arm, shoulder or neck symptoms can be considered sufficient with values above 0.69. The agreement between occupational physicians can, with a few exceptions, be considered as moderate with κ values below 0.60. The agreement was sufficient for detecting the absence of symptoms (p neg > 0.7).
Conclusions
The agreement between the symptom questions of the questionnaire and physical examinations of occupational physicians can be considered as poor to moderate. The results are comparable to what is generally reported in the literature. Future studies should be aimed at gaining more fundamental knowledge about the possible conceptual differences between self-reported symptoms and symptoms assessed using physical examinations. Moreover, it is advisable to improve the inter-observer reliability of physical examinations as applied in the present study.
Similar content being viewed by others
References
Akesson I, Johnsson B, Rylander L, Moritz U, Skerfving S (1999) Musculoskeletal disorders among female dental personnel–clinical examination and a 5-year follow-up study of symptoms. Int Arch Occup Environ Health 72(6):395–403
Altman DG (1991) Practical statistics for medical research, 1st edn. Chapman & Hall, London
Andersen JH, Kaergaard A, Frost P, Thomsen JF, Bonde JP, Fallentin N, Borg V, Mikkelsen S (2002) Physical, psychosocial, and individual risk factors for neck/shoulder pain with pressure tenderness in the muscles among workers performing monotonous, repetitive work. Spine (Phila Pa 1976) 27(6):660–667
Bakhuys Roozeboom M, de Vroome E, Smulders P, van den Bossche S (2007) TNO Arbeidssituatie survey 2000–2004. Trends in de arbeid in Nederland tussen 2000 en 2004. TNO Kwaliteit van Leven
Bjorksten MG, Boquist B, Talback M, Edling C (1999) The validity of reported musculoskeletal problems. A study of questionnaire answers in relation to diagnosed disorders and perception of pain. Appl Ergon 30(4):325–330
Blatter B, Houtman I, van den Bossche S, Kraan K, van den Heuvel S (2005) Gezondheidsschade en kosten als gevolg van RSI en psychosociale arbeidsbelasting in Nederland (Health effects and costs due to RSI and psychosocial workload in The Netherlands). Ministerie van Sociale Zaken en Werkgelegenheid, Den Haag
Bongers PM (2003) Maak werk van RSI. Inaugural speech, VU Medical Centre, Amsterdam
Brandt LP, Andersen JH, Lassen CF, Kryger A, Overgaard E, Vilstrup I, Mikkelsen S (2004) Neck and shoulder symptoms and disorders among Danish computer workers. Scand J Work Environ Health 30(5):399–409
Buckle P (2005) Ergonomics and musculoskeletal disorders: overview. Occup Med (Lond) 55(3):164–167
Cicchetti DV, Feinstein AR (1990) High agreement but low kappa: II. Resolving the paradoxes. J Clin Epidemiol 43(6):551–558
de Vet HCW, Terwee CB, Mokkink LB, Knol DL (2011) Measurement in medicine. A practical guide. Cambridge University Press, Cambridge
Ekman A, Andersson A, Hagberg M, Hjelm EW (2000) Gender differences in musculoskeletal health of computer and mouse users in the Swedish workforce. Occup Med (Lond) 50(8):608–613
Feinstein AR, Cicchetti DV (1990) High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol 43(6):543–549
Gerr F, Marcus M, Monteilh C (2004) Epidemiology of musculoskeletal disorders among computer users: lesson learned from the role of posture and keyboard use. J Electromyogr Kinesiol 14(1):25–31
Hildebrandt VH, Bongers PM, van Dijk FJ, Kemper HC, Dul J (2001) Dutch musculoskeletal questionnaire: description and basic qualities. Ergonomics 44(12):1038–1055
IJmker S, Huysmans MA, Blatter BM, van der Beek AJ, van Mechelen W, Bongers PM (2007) Should office workers spend fewer hours at their computer? A systematic review of the literature. Occup Environ Med 64(4):211–222
Juul-Kristensen B, Kadefors R, Hansen K, Bystrom P, Sandsjo L, Sjogaard G (2006) Clinical signs and physical function in neck and upper extremities among elderly female computer users: the NEW study. Eur J Appl Physiol 96(2):136–145
Kaergaard A, Andersen JH, Rasmussen K, Mikkelsen S (2000) Identification of neck-shoulder disorders in a 1 year follow-up study. Validation of a questionnaire-based method. Pain 86(3):305–310
Klein Hesselink J, Houtman I, Hooftman W, Bakhuys Roozeboom M (2009) Arbobalans 2009. Kwaliteit van de arbeid, effecten en maatregelen in Nederland. TNO Kwaliteit van Leven
Kuorinka IAA, Jonsson B, Kilbom è, Vinterberg H, Biering-Sorensen F, Andersson GBJ, Jorgensen K (1987) Standardised Nordic questionnaires for the analysis of musculoskeletal symptoms. Appl Ergon 18(3):233–237
Marx RG, Bombardier C, Wright JG (1999) What do we know about the reliability and validity of physical examination tests used to examine the upper extremity? J Hand Surg Am 24(1):185–193
Nordander C, Ohlsson K, Balogh I, Rylander L, Palsson B, Skerfving S (1999) Fish processing work: the impact of two sex dependent exposure profiles on musculoskeletal health. Occup Environ Med 56(4):256–264
Ohlsson K, Attewell RG, Johnsson B, Ahlm A, Skerfving S (1994) An assessment of neck and upper extremity disorders by questionnaire and clinical examination. Ergonomics 37(5):891–897
Palmer K, Walker-Bone K, Linaker C, Reading I, Kellingray S, Coggon D, Cooper C (2000) The Southampton examination schedule for the diagnosis of musculoskeletal disorders of the upper limb. Ann Rheum Dis 59(1):5–11
Palmer KT, Cooper C, Walker-Bone K, Syddall H, Coggon D (2001) Use of keyboards and symptoms in the neck and arm: evidence from a national survey. Occup Med (Lond) 51(6):392–395
Perreault N, Brisson C, Dionne CE, Montreuil S, Punnett L (2008) Agreement between a self-administered questionnaire on musculoskeletal disorders of the neck-shoulder region and a physical examination. BMC Musculoskelet Disord 9:34
Punnett L, Bergqvist U (1999) Musculoskeletal disorders in visual display unit work: gender and work demands. Occup Med 14(1):113–124
Salerno DF, Franzblau A, Werner RA, Chung KC, Schultz JS, Becker MP, Armstrong TJ (2000) Reliability of physical examination of the upper extremity among keyboard operators. Am J Ind Med 37(4):423–430
Sluiter JK, Rest KM, Frings-Dresen MH (2001) Criteria document for evaluating the work-relatedness of upper-extremity musculoskeletal disorders. Scand J Work Environ Health 27(Suppl 1):1–102
Speklé EM, Hoozemans MJ, van der Beek AJ, Blatter BM, Bongers PM, van Dieën JH (2009) Internal consistency, test-retest reliability and concurrent validity of a questionnaire on work-related exposure related to arm, shoulder and neck symptoms in computer workers. Ergonomics 52(9):1087–1103
Speklé EM, Hoozemans MJ, Blatter BM, Heinrich J, van der Beek AJ, Knol DL, Bongers PM, van Dieën JH (2010) Effectiveness of a questionnaire based intervention programme on the prevalence of arm, shoulder and neck symptoms, risk factors and sick leave in computer workers: a cluster randomised controlled trial in an occupational setting. BMC Musculoskelet Disord 11:99
Stål M, Moritz U, HJohnsson B, Pinzke S (1997) The natural course of musculoskeletal symptoms and clinical findings in upper extremities of female milkers. Int J Occup Environ Health 3:190–197
Toomingas A, Nemeth G, Alfredsson L (1995) Self-administered examination versus conventional medical examination of the musculoskeletal system in the neck, shoulders, and upper limbs. The Stockholm MUSIC I Study Group. J Clin Epidemiol 48(12):1473–1483
Verbeek JAHM, Broekkamp CW, van Cuilenburg LC, van Heijst AJP, Kramer E, Kremer EAJM, Rutten RGHM, Tellekamp JJ, Verhoeven ACLPJ (2003) Practice guideline for occupational physicians on the management of employees with complaints of arm, shoulder or neck. NVAB, Utrecht, The Netherlands. http://nvab.artsennet.nl/web/file?uuid=7870867f-9fde-4122-ae6b-d99811e5566a&owner=56486107-3665-4b31-91e4-b4b90e8c1963&contentid=55307
Waersted M, Hanvold TN, Veiersted KB (2010) Computer work and musculoskeletal disorders of the neck and upper extremity: a systematic review. BMC Musculoskelet Disord 11:79
Wahlstrom J (2005) Ergonomics, musculoskeletal disorders and computer work. Occup Med (Lond) 55(3):168–176
Walker-Bone K, Byng P, Linaker C, Reading I, Coggon D, Palmer KT, Cooper C (2002) Reliability of the Southampton examination schedule for the diagnosis of upper limb disorders in the general population. Ann Rheum Dis 61(12):1103–1106
Zetterberg C, Forsberg A, Hansson E, Johansson H, Nielsen P, Danielsson B, Inge G, Olsson BM (1997) Neck and upper extremity problems in car assembly workers. A comparison of subjective complaints, work satisfaction, physical examination and gender. Int J Ind Ergon 19(4):277–289
Acknowledgments
Floris Sielcken, Rolf Greeven and Sourena Shirzad are greatly acknowledged for the collection of the data of the present study.
Conflict of interest
The authors declare that they have no conflict of interest.
Author information
Authors and Affiliations
Corresponding author
Appendices
Appendix 1
Actual questions used in the RSI QuickScan questionnaire to assess the prevalence of upper extremity symptoms in the present study.
Appendix 2
Form used to register upper extremity symptoms by the occupational physicians in the physical examinations.
Region | Diagnose | Negative | Positive: No pain No disabilities | Positive: Pain No disabilities | Positive: Pain Disabilities |
---|---|---|---|---|---|
Specific symptoms | |||||
Neck | Cervical radicular syndrome | ||||
Shoulder | Specific shoulder symptoms | ||||
Elbow | Lateral epicondylitis | ||||
Medial epicondylitis | |||||
Forearm wrist hand | Tenosynovitis/peritendinitis | ||||
Carpal tunnel syndrome | |||||
Other | |||||
Nonspecific symptoms | |||||
Neck | Nonspecific symptoms | ||||
Shoulder | Nonspecific symptoms | ||||
Elbow | Nonspecific symptoms | ||||
Forearm wrist hand | Nonspecific symptoms |
Rights and permissions
About this article
Cite this article
Hoozemans, M.J.M., Speklé, E.M. & van Dieën, J.H. Concurrent validity of questions on arm, shoulder and neck symptoms of the RSI QuickScan. Int Arch Occup Environ Health 86, 789–798 (2013). https://doi.org/10.1007/s00420-012-0809-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00420-012-0809-x