Skip to main content
SpringerLink
Log in

An evaluation of the effectiveness of a videotape programme on interobserver reliability in outcome assessment for rheumatoid arthritis

  • Published:
InflammoPharmacology Aims and scope Submit manuscript

Abstract

Aims. A study was designed to assess the effects of a standardized instructional videotape on training senior medical students to acceptable levels of reliability in performing several commonly used observer dependent outcome measures in patients with rheumatoid arthritis (RA).

Methods. During a single day, six third-year medical students independently examined six patients with RA in predetermined order using a Latin Square design, before and after viewing a standardized videotape demonstrating 15 examination techniques. Reliability coefficients were calculated based on the variance components of the analysis of variance (ANOVA) table.

Results. Prestandardization reliability coefficients were >0.80 for all measures and remained above 0.80 following standardization except for one measure.

Conclusions. High levels of interobserver agreement were noted prior to viewing the instructional videotape. This may represent the success of undergraduate clinical skills training programmes or it may be me result of the students having reviewed an illustrated instructional text just prior to the initial patient examinations. High levels of prestandardization reliability, by necessity, precluded the demonstration of significant effects from viewing the videotape. Nevertheless, the data indicate that senior medical students are capable of reliably performing quantitative measurement in RA. Recent surveys in Canada and Australia, showing a general lack of quantitative clinical measurement in the longitudinal follow up of RA outpatients by rheumatologists, suggest that the lack of standardization is not due to inability to reliably perform the measurements.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Bellamy, N., Anastassiades, T. P., Buchanan, W. W., Davis, P., Lee, P., McCain, G. A., Wells, G. A. and Campbell, J. (1991a). Rheumatoid arthritis antirheumatic drug trials. I. Effects of standardization procedures on observer dependent outcome measures,J. Rheumatol. 18, 1893–1900.

    PubMed  CAS  Google Scholar 

  2. Muirden, K. D., Bendrups. A., Boydcn, K., McColl, G., Moran, H., Stockman, A., Tellus, M. M., Travers, R. and Campbell, J. (1997). Rheumatoid arthritis antirheumatic drug trials: effects of a standardized instructional videotape on the reliability of observer-dependent outcome measures,Inflanmmpharmacology 5, 273–84.

    Article  Google Scholar 

  3. Bellamy, N., Carelle, S., Ford, P. M., Kean, W. F., le Riche, N. G. H., Lussier, A., Wells, G. and Campbell J. (1992a). Osteoarthritis antirheumatic drug trials. I. Effects of standardization procedures on observer dependent outcome measures,J. Rheumatol 19, 436–43.

    PubMed  CAS  Google Scholar 

  4. Bellamy, N., Bachmeier, C, Brooks, P., Browne, C. D., Cohen, M. L., Conaghan, P. G., Day, R. O., March, L. and Campbell, J. (1997a). Osteoarthritis antirheumatic drug trials: effcets of a standardized instructional videotape on the reliability of observer-dependent outcome measures,Inflammophannacology 5, 285–95.

    Article  CAS  Google Scholar 

  5. Bellamy, N., Buchanan, W. W., Esdaile, J. M., Fam, A. G., Kean, W. F., Thompson, J. M., Wells, G. A. and Campbell, J. (1991b). Ankylosing spondylitis antirheumatic drug trials. I. Effects of standardization procedures on observer dependent outcome measures,J. Rheumatol. 18, 1701–8.

    PubMed  CAS  Google Scholar 

  6. Bellamy, N., Muirden, K. D., Boyden, K., McColl, G., Moran, H., Stockman, A., Tellus, M. M., Wicks, I. and Campbell, J. (1997b). Ankylosing spondylitis antirheumatic drugs trials: effects of a standardized instructional videotape on the reliability of observer dependent outcome measures,Inflammopharmacology 5, 297–308.

    Article  PubMed  CAS  Google Scholar 

  7. Bellamy, N., Bell, M. J., Caretle, S., Fam, A. G., Haraoui, B. W., McCain. G. A., Reynolds, W. J., Wells, G. A. and Campbell, J. (1994). Estimation of observer reliability and sample size calculation parameters for outcome measures in fibromyalgia clinical trials,Inflammopharmacology 2, 345–60.

    Article  Google Scholar 

  8. Bellamy, N., Buchbinder, R., Hall, S., Lowthian, P., Patrick, M. R., Ryan, P. F. J., Stockman, A., Grant, G., Green, S. and Campbell, J. (1997c). Fibromyalgia antirheumatic drug trials: effects of a standardized instructional videotape on the reliability of observer-dependent outcome measures,Inflammopharmacology 5, 261–72.

    Article  PubMed  CAS  Google Scholar 

  9. Bellamy, N., Anastassiades, T. P., Buchanan, W. W., Davis, P., Lee, P., McCain, G. A., Wells, G. A. and Campbell, J. (1991c). Rheumatoid arthritis antirheumatic drug trials. II. Tables for calculating sample size for clinical trials of antirheumatic drugs,J. Rheumatol. 18, 1901–7.

    PubMed  CAS  Google Scholar 

  10. Bellamy, N., Carette, S., Ford, P. M., Kean, W. F., le Riche, N. G. H., Lussier, A., Wells, G. A. and Campbell J. (1992b). Osteoarthritis antirheumatic drug trials. II. Tables for calculating sample size for clinical trials,J. Rheumatol. 19, 444–50.

    PubMed  CAS  Google Scholar 

  11. Bellamy, N., Buchanan, W. W., Esdaile, J. M., Fam, A. G., Kean, W. F., Thompson, J. M., Wells, G. A. and Campbell, J. (1991d). Ankylosing spondylitis antirheumatic drug trials. II. Tables for calculating sample size for clinical trials,J. Rheumatol. 18, 1709–15.

    PubMed  CAS  Google Scholar 

  12. Gøtzsche P. C. (1989). Methodology and overt and hidden bias in reports of 196 double-blind trials of nonsteroidal antiinflammatory drugs in rheumatoid arthritis,Controlled Clin. Trials 10, 31–56.

    Article  PubMed  Google Scholar 

  13. Arnett, F. C, Edworthy, S. M., Bloch, D. A., McShane, D. J., Fries, J. F., Cooper, N. S., Healey, L. A., Kaplan, S. R., Liang, M. H., Luthra, H. S., Medsger, T. A. Jr., Mitchell, D. M., Neustadt, D. H., Pinals, R. S., Schaller, J. G., Sharp, J. T., Wilder, R. L. and Hunter, G. G. (1988). The American Rheumatism Association 1987 revised criteria for the classification of rheumatoid arthritis,Arthritis Rheum. 31, 315–24.

    Article  PubMed  CAS  Google Scholar 

  14. Hochberg, M. C., Chang. R. W., Dwosh, I., Lindsey, S., Pincus, T. and Wolfe, F. (1992). The American College of Rheumatology 1991 revised criteria for the classification of global functional status in rheumatoid arthritis,Arthritis Rheum. 35, 498–502.

    Article  PubMed  CAS  Google Scholar 

  15. Bellamy, N. (1993).Musculoskeletal Cliniail Metrology, pp. 197–210. Kluwer Academic Publishers, Dordrecht.

    Google Scholar 

  16. Box, G. K. P., Hunter, W. G. and Hunter, J. S. (1978).Statistics for Experimenters. John Wiley, New York.

    Google Scholar 

  17. SAS Users Guide: Basics and statistics (1985), Version 5 edn. Cary, SAS institute Inc.

  18. Klinkoff, A. V., Bellamy, N., Bombardier, C, Carette, S., Chalmers, A., Esdaile, J. M., Goldsmith, C., Tugwell, P., Smythe, H. A. and Buchanan, W. W. (1988). An experiment in reducing interobserver variability of the examination for joint tenderness,J. Rheumatol. 15. 492–4.

    Google Scholar 

  19. Pope, J. E., Baron, M., Bellamy, N., Campbell, I., Carette, S., Chalmers. I., Dales, P., Hanly, J., Kaminska, E. A., Lee, P., Sibley, J. and Stevens, A. (1995). Variability of skin scores and clinical measurements in sclerodcnna,J. Rheumiatol. 22, 1271–6.

    CAS  Google Scholar 

  20. Green, S., Buchbinder, R., Forbes, A. and Bellamy, N. (1998). A standardized protocol for measurement of range of movement of the shoulder using the plurimetcr-V inclinometer and assessment of its intrarater and interrater reliability,Arthritis Care Res. 11, 27–32.

    Article  Google Scholar 

  21. Bellamy, N., Anjema, C, Chhina, T., Dudek, N., Hurley, B., Landesman, B., Probyn, L., Hill, J. and Campbell, J. (1999). An evaluation of the effectiveness of a videotape programme on interobserver reliability in outcome assessment for fibromyalgia,Inflammopharmacology 7, 119–30.

    Article  CAS  PubMed  Google Scholar 

  22. Bellamy, N., Anjema, C, Dhanoa, D., Joglekar, A., Mills, G. C. R., Nesrallah, G., Smith, C., Ucar, C, Hill, J. and Campbell, J. (1999). An evaluation of the effectiveness of a videotape programme on interobserver reliability in outcome assessment for ankylosing spondylitis,Inflammopharmacology 7, 107–17.

    Article  CAS  PubMed  Google Scholar 

  23. Bellamy, N., Anjema, C, Alikhan, N., Chhina, T., Dhanoa, D., Edelist, D., Esufali, Z., Ismail, F., Hill, J. and Campbell, J. (1999). An evaluation of the effectiviness of a videotape programme on interobserver reliability in outcome assessment for osteoarthritis,lnflammopharmacology 7, 143–54.

    Article  CAS  Google Scholar 

  24. Bellamy, N., Kaloni, S., Pope, J., Coulter, K. and Campbell, J. (1998), A survey of outcome measurement procedures used in routine rheumatology outpatient practice by Canadian rheumatologists,J. Rheumatol. 25, 852–8.

    PubMed  CAS  Google Scholar 

  25. Bellamy, N., Muirden, K. D., Brooks, P., Barroclough, D., Tellus, M. M. and Campbell, J. (1997). A survey of outcome measurement procedures used in routine rheumatology outpatient practice by Australian rheumatologists. Scientific Program of the Australian Rheumatology Association 40th Annual Scientific Conference, Brisbane, May 25–28, p. 160.

Download references

Author information

Authors and Affiliations

  1. Department of Medicine, The University of Queensland, Brisbane, Australia

    N. Bellamy

  2. Department of Medicine, The University of Western Ontario, London, Ontario, Canada

    C. Anjema, T. S. Frankovic, N. Horowitz, G. C. R. Mills, S. Shulman, C. Smith, J. Hill & J. Campbell

Authors
  1. N. Bellamy
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. C. Anjema
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. T. S. Frankovic
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. N. Horowitz
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. G. C. R. Mills
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. S. Shulman
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. C. Smith
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. J. Hill
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. J. Campbell
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Bellamy, N., Anjema, C., Frankovic, T.S. et al. An evaluation of the effectiveness of a videotape programme on interobserver reliability in outcome assessment for rheumatoid arthritis. Inflammopharmacol 7, 131–141 (1999). https://doi.org/10.1007/BF02918385

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02918385

Key words

Search

Navigation