Skip to main content

Inter-Rater Reliability of the Mealtime Scan+

The journal of nutrition, health & aging volume 23, pages 623–627 (2019)Cite this article

Abstract

Background and Objectives

The Mealtime Scan (MTS) was developed to assess the dining environment in Long Term Care (LTC). MTS has been reviewed and updated to ensure its standardization and responsiveness to changes in the dining environment. The objectives of this paper are to provide an overview of the changes made in the new MTS+ tool and to describe its inter-rater reliability.

Research Design and Methods

The observational and scoring methods used to evaluate the physical, social, and relational-centered dining environments in LTC homes were reviewed and updated into MTS+ and an overall quality of dining rating derived. Two trained assessors were evaluated for the inter-rater reliability. Nine dining rooms in three LTC homes at different meals were observed for a total of 45 observations. Interclass Correlation Coefficient (ICC) was used to assess reliability.

Results

MTS+ demonstrated good reliability on the orientation cues, social environment, and relationship-centered activities (orientation cues ICC: 0.75, social ICC: 0.78, relational ICC: 0.78). However, the tool’s reliability was poor for the physical environment, ICC: 0.48 and moderate for the overall rating of the quality of the dining environment, ICC: 0.67.

Discussion and Implications

Although deemed more effective and practical for use in intervention studies, MTS+ has some limitations with respect to its reliability, particularly in assessing the physical environment. It is hypothesized that more extensive training of the assessors may lead to improvements in the reliability of MTS+. MTS+ can be used in intervention research when one assessor completes repeat observations of a dining area.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

43,34 €

Price includes VAT (Finland)
Tax calculation will be finalised during checkout.

References

  1. Keller H, Carrier N, Duizer L, Lengyel C, Slaughter S, Steele C. Making the Most of Mealtimes (M3): grounding mealtime interventions with a conceptual model. J Am Med Dir Assoc 2014;15(3), 158–161.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Igulio S, Keller H, Chaudhuy H, Slaughter SE, Lengyel C, Morrison J, Boscart V, Carrier N. (2018). Construct Validity of the Mealtime Scan: A Secondary Data Analysis of Making Most of Mealtimes (M3) Study. J Nutr Gerontol Geriatics 2018; 37(2):82–104. doi https://doi.org/10.1080/21551197.2018.1461166

    Article  Google Scholar 

  3. Keller HH. Improving food intake in persons living with dementia. Ann NY Acad Sci 2016;1367(1): 3–11.

    Article  PubMed  Google Scholar 

  4. Henkusens C, Keller HH, Dupuis S, Schindel Martin L. Transitions to long-term care: how do families living with dementia experience mealtimes after relocating? J Appl Gerontol 2014;33(5), 541–563.

    Article  PubMed  Google Scholar 

  5. Hung L, Chaudhury H, Rust T. The effect of dining room physical environmental renovations on person-centered care practice and residents’ dining experiences in long-term care facilities. J Appl Gerontol 2016;35(12):1279–1301.

    Article  PubMed  Google Scholar 

  6. Keller HH, Chaudhury H, Pfisterer KJ, Slaughter SE. Development and inter-rater reliability of the Mealtime Scan for long-term care. Gerontologist, 2017;58(3): e160–e167.

    Article  PubMed Central  Google Scholar 

  7. Chaudhury H, Cooke HA, Cowie H, Razaghi L. The influence of the physical environment on residents with dementia in long-term care settings: A review of the empirical literature. Gerontologist 2017;58(5): e325–e337.

    Article  Google Scholar 

  8. Ducak K, Sweatman G, Keller H. Dining culture change in long-term care homes: Transitioning to resident-centered and relational meals. Ann Long Term Care: Clin Care Aging 2015;23(6): 28–36.

    Google Scholar 

  9. Wu S, Morrison JM, Dunn-Ridgeway H, Vucea V, Iuglio S, Keller H. Mixed methods developmental evaluation of the CHOICE program: a relationship-centred mealtime intervention for long-term care. BMC Geriatics 2018;18(1): 277.

    Article  Google Scholar 

  10. Iuglio S, Keller HH, Chaudhury H, Morrison JM, Slaughter SE, Lengyel C et al. Construct validation of the Mealtime Relational Care Checklist (M-RCC) for individual resident use in long term care. J Nurs Measure (in press).

  11. Ten Have P. Teaching students observational methods: visual studies and visual analysis. Visual Studies 2003;18(1):29–35.

    Article  Google Scholar 

  12. Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropractic Med 2016;15(2):155–163.

    Article  Google Scholar 

  13. Rotondi MA, Donner A. A confidence interval approach to sample size estimation for interobserver agreement studies with multiple raters and outcomes. J Clin Epi 2012;65(7):778–784.

    Article  Google Scholar 

Download references

Author information

Affiliations

  1. Schlegel -University of Waterloo Research Institute for Aging, 250 Laurelwood Dr, Waterloo, ON, N2J0E2, Canada

    Heather Keller

  2. Faculty of Appled Health Sciences, University of Waterloo, Waterloo, ON, Canada

    S. Awwad & J. Morrison

  3. Simon Fraser University, Burnaby, BC, Canada

    H. Chaudhury

Authors
  1. Heather Keller
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. S. Awwad
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. J. Morrison
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. H. Chaudhury
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Heather Keller.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Keller, H., Awwad, S., Morrison, J. et al. Inter-Rater Reliability of the Mealtime Scan+. J Nutr Health Aging 23, 623–627 (2019). https://doi.org/10.1007/s12603-019-1210-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12603-019-1210-1

Key words

  • Long-Term Care
  • residences
  • dining
  • mealtime
  • measurements