Abstract
Aims. A study was designed to assess the effects of a standardized instructional videotape on training senior medical students to acceptable levels of reliability in performing several commonly used obsever dependent outcome measures in patients with ankylosing spondylilis (AS).
Methods. During a single day, six third-year medical students independently examined five patients with AvS in predetermined order using a Latin Square design, before and after viewing a standardized videotape demonstrating 14 examination techniques. Reliability coefficients were calculated based on the variance components of the analysis of variance (ANOVA) table.
Results. Prestandardization reliability coefficients were < 0.80 for three measures. Following standardization 12 reliability coefficients exceeded 0.80. For the majority of measures prestandardization reliability coefficients were high and no further improvement in reliability could be demonstrated.
Conclusions. High levels of interobserver agreement were noted prior to viewing the instructional videotape. This may represent the success of undergraduate clinical skills training programmes, or it may be the result of having reviewed an illustrated instructional text just prior to the initial patient examinations. With the exception of chest excursion, high levels of prestandardization reliability, by necessity, precluded the demonstration of significant effects from viewing the videotape. Nevertheless, the data indicate that senior medical students arc capable of reliably performing quantitative measurement in AS. Recent surveys in Canada and Australia, showing a general lack of quantitative clinical measurement in the longitudinal follow up of AS outpatients by rheumatologists, suggest that the lack of quantitation is not due to inability to reliably perform the measurements.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bellamy, N., Anastassiades, T. P., Buchanan, W. W., Davis, P., Lee, P., McCain, G. A., Wells, G. A. and Campbell, J. (1991). Rheumatoid arthritis antirheumatic drug trials. I. Effects of standardization procedures on observer dependent outcome measures,J. Rheumatal. 18, 1893–1900.
Muirden, K. D., Bendrups, A., Boyden, K., McColl, G., Moran, H., Stockman, A., Tellus, M. M., Travers, R. and Campbell, J. (1997). Rheumatoid arthritis antirheumatic drug trials: effects of a standardized instructional videotape on the reliability of observer-dependent outcome measures.Inflammopharmacology 5, 273–84.
Bellamy, N., Carette, S., Ford, P. M., Kean, W. E, le Riche, N. G. H., Lussier, A., Wells, G. and Campbell, J. (1992). Osteoarthritis antirheumatic drug trials. I. Effects of standardization procedures on observer dependent outcome measures,J. Rheumatal.19, 436–43.
Bellamy, N., Bachmeier, C, Brooks, P., Browne, C. D., Cohen, M. L., Conaghan, P. G., Day, R. O., March, L. and Campbell, J. (1997). Osteoarthritis antirheumatic drug trials: effects of a standardized instructional videotape on the reliability of observer-dependent outcome measures,Inflammopharmacology 5, 285–95.
Bellamy, N., Buchanan, W. W., Esdaile, J. M., Fam, A. G., Kean, W. F., Thompson, J. M., Wells, G, A. and Campbell, J. (1991). Ankylosing spondylitis antirheumatic drug trials. I. Effects of standardization procedures on observer dependent outcome measures,J. Rheumatal. 18, 1701–8.
Bellamy, N., Muirden, K. D., Boyden, K., McColl, G., Moran, H., Stockman, A., Tellus, M. M., Wicks, I. and Campbell, J. (1997). Ankylosing spondylitis antirheumatic drug trials: effects of a standardized instructional videotape on the reliability of observer-dependent outcome measures,Inflammopharmacology 5, 297–308.
Bellamy, N., Bell, M. J., Carette, S., Fam, A. G., Haraoui, B. W., McCain, G. A., Reynolds, W. J., Wells, G. A. and Campbell, J. (1994). Estimation of observer reliability and sample size calculation parameters for outcome measures in fibromyalgia clinical trials,Inflammopharmacology 2, 345–60.
Bellamy, N., Buchbinder, R., Hall, S., Lowthian, P., Patrick, M. R., Ryan, P. F. J., Stockman, A., Grant, G., Green, S. and Campbell, J. (1997). Fibromyalgia antirheumatic drug trials: effects of a standardized instructional videotape on the reliability of observer-dependent outcome measures,Inflammopharmacology 5, 261–72.
Bellamy, N., Anastassiades, T. P., Buchanan, W. W., Davis, P., Lee, P., McCain, G. A., Wells, G. A. and Campbell, J. (1991). Rheumatoid arthritis antirhcumatie drug trials. II. Tables for calculating sample size for clinical trials of antirheumatic drugs,J. Rheumatol. 18, 1901–7.
Bellamy, N., Carette, S., Ford, P. M., Kean, W. R. le Riche, N. G. H., Lussier, A., Wells, G. A. and Campbell J. (1992). Osteoarthritis antirheumatic drug trials. II. Tables for calculating sample size for clinical trials,J. Rheumatol,19, 444–50.
Bellamy, N., Buchanan, W. W., Esdaile, J. M., Fam, A. G., Kean, W. F., Thompson, M., Wells, G. A. and Campbell, J. (1991). Ankylosing spondylitis antirheumatic drug trials, 11. Tables for calculating sample size for clinical trials,J. Rheumatol. 18, 1709–15.
Laurent, M. R., Buchanan, W. W. and Bellamy, N. (1991). Methods of assessment used in ankylosing spondylitis clinical trials: a review,Brit. J. Rheumatol. 30, 326–9.
Ball, G. V. (1989). Ankylosing spondylitis, in:Arthritis and Allied Conditions — A Textbook of Rheumatology, 11th edn, McCarty, D. J. (Ed.), pp. 934–43. Philadelphia, Lea & Febiger.
Hochberg, M. C., Chang, R. W., Dwosh, I., Lindsey, S., Pineus, T. and Wolfe, F. (1992). The American College of Rheumatology 1991 revised criteria for the classification of global functional status in rheumatoid arthritis,Arthritis Rheum,35, 498–502.
Bellamy. N. (1993).Musculoskeletal Clinical Metrology, pp. 225–42. Dordrecht. Kluwer Academic Publishers.
Box, G. E. P., Hunter, W. G. and Hunter, J. S. (1978).Statistics for Experimenters. New York, John Wiley.
SAS Users Guide: Basics and statistics (1985). Version 5 edn. Cary, SAS Institute Inc.
Klinkoff, A. V., Bellamy, N., Bombardier, C., Carette, S., Chalmers, A., Esdaile, J. M., Goldsmith, C., Tugwell, P., Smythe, H. A. and Buchanan, W. W. (1988). An experiment in reducing interobserver variability of the examination for joint tenderness,J. Rheumatol,15, 492–4.
Pope. J. E., Baron, M., Bellamy, N., Campbell, J., Carelle, S., Chalmers, I., Dales, P., Hanly, J., Kaminska, E. A., Lee, P., Sibley, J. and Stevens, A. (1995). Variability of skin scores and clinical measurements in scleroderma,J. Rheumatol. 22, 1271–6.
Green, S., Buchbinder, R., Forbes, A. and Bellamy, N. (1998). A standardized protocol for measurement of range of movement of the shoulder using the plurimeter-V inclinometer and assessment of its intrarater and interrater reliability,Arthritis Care Res. 11, 27–32.
Bellamy, N., Kaloni, S., Pope, J., Coulter, K. and Campbell, J. (1998). A survey of outcome measurement procedures used in routine rheumatology outpatient practice by Canadian rheumalologists,J. Rheumatol. 25, 852–8.
Bellamy, N., Muirden, K. D., Brooks, P., Barroclough, D., Tellus, M. M. and Campbell, J. A survey of outcome measurement procedures used in routine rheumatology outpatient practice by Australian rheumatologists (1997). Scientific Program of the Australian Rheumatology Association 40th Annual Scientific Conference, Brisbane, May 25–8, p. 160.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Bellamy, N., Anjema, C., Dhanoa, D. et al. An evaluation of the effectiveness of a videotape programme on interobserver reliability in outcome assessment for ankylosing spondylitis. Inflammopharmacol 7, 107–117 (1999). https://doi.org/10.1007/BF02918383
Received:
Revised:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF02918383