Many countries around the world have adopted social distancing as one of the public health measures to reduce COVID-19 transmissions in the community. Such measures could have negative effects on the mental health of the population. The aims of this study are to (1) track the impact of COVID-19 on self-reported mood, self-rated health, other health and psychosocial indicators, and health services utilization of people who have an interRAI assessment during the first year of COVID-19; (2) compare these indicators with the same indicators in people who had an interRAI assessment in the year before COVID-19; and (3) report these indicators publicly as soon as data analysis is completed every 3 months.
interRAI COVID-19 Study (iCoS) is an observational study on routinely collected national data using the interRAI Home Care and Contact Assessment, which are standardized geriatric assessment tools mandated for all people assessed for publicly funded home support services and aged residential care in New Zealand. Based on the 2018/19 figures, we estimated there are 36,000 interRAI assessments per annum. We will compare the four post-lockdown quarters (from 25th March 2020) with the respective pre-lockdown quarters. The primary outcomes are self-reported mood (feeling sad, depressed or hopeless: 0 = no, 1 = yes) and self-rated health (0 = excellent, 1 = good, 2 = fair, 3 = poor). We will also analyze sociodemographics, other secondary health and psychosocial indicators, and health services utilization. Descriptive statistics will be conducted for primary outcomes and other indicators for each of the eight quarters. We will compare the quarters using regression models adjusted for demographic characteristics using weights or additional variables. Key health and psychosocial indicators will be reported publicly as soon as data analysis is completed for each quarter in the 12-month post-lockdown period by using a data visualization tool.
This rapid translation of routinely collected national interRAI data will provide a means to monitor the health and psychosocial well-being of vulnerable older New Zealanders. Insights from this study can be shared with other countries that use interRAI and prepare health and social services for similar epidemics/pandemics in the future.
As in many countries around the world, New Zealand went into lockdown at the end of March 2020 in an attempt to reduce the spread of COVID-19 infection in our communities. The sudden adoption of lockdown measures changed our social behavior and support networks overnight. Older adults are the most at-risk group for COVID-19 because its mortality risk increases with age, particularly in those with chronic conditions . In New Zealand, as of the end of September 2020, 25 people had died of COVID-19; most of them are older adults. The lockdown measure urged adults aged 70 years old and above to avoid social contact and stay home. Such drastic measures can have many direct and indirect effects on the health and psychosocial well-being in the elderly. For example, older adults who were previously mobile but are now housebound are at risk of developing frailty . Furthermore, the World Health Organization suggested that older adults in isolation might become more anxious, angry, stressed, agitated and withdrawn during the COVID-19 pandemic outbreak or while in isolation .
Some older adults in self-isolation can also become lonely if they live alone and/or cannot access their usual community programmes and support [1, 4]. Loneliness is a serious public health concern. It is a well-recognized risk factor for premature mortality, and poor physical and psychological wellbeing [5,6,7,8]. For example, previous studies have demonstrated that loneliness in older age is associated with reduced quality of life , higher rates of adverse health outcomes and higher mortality rates . Moreover, social isolation possesses a premature mortality risk similar to the risk associated with maintaining an unhealthy diet, lack of physical activity and smoking . It has been suggested that the impact of even short-term social distancing measures merits further study in populations where there is an existing high rate of loneliness and isolation .
Loneliness is relatively common in our community. Two recent studies found that one in five older New Zealanders assessed with the interRAI Home Care (interRAI-HC) assessment reported feelings of loneliness [11, 12], which is nearly twice the rate (11%) in the general older population . For those interRAI subjects who were lonely, 27% had significant depressive symptoms and more than half (56%) stated poor or fair self-rated health .
interRAI-HC is a standardised geriatric assessment tool developed by health researchers in over 30 countries. New Zealand is the first country in the world to implement a mandated interRAI-HC for all people assessed for publicly funded home support services and aged residential care. Health professionals in the 20 District Health Boards (DHBs) use interRAI-HC to help determine which level of support older adults living in the community need. There were 36,000 interRAI-HC assessments completed in 2018/19 , while 10 and 40% of all New Zealanders aged 65 years and 85 years respectively have had an interRAI-HC during the same period. interRAI-HC contains information on about 250 demographic, clinical and psychosocial factors, which can be used to support care planning, resource allocation, quality measurement, and outcome evaluation . It takes up to one and a half hours to complete an interRAI-HC assessment face-to-face in a person’s home. In response to the COVID-19 pandemic, interRAI New Zealand advised DHBs that they could use a shorter version of assessment, interRAI Contact Assessment, in place of interRAI-HC, between 25th March to 30th June 2020. The shorter version can be completed in 20 min over the telephone and allowed the assessment of patients urgently, reliably and efficiently.
Older adults assessed for home support services and aged residential care typically have physical illness and/or functional impairment . Functional limitation is one of the main aetiological factors for loneliness in older adults [17,18,19]. Given the pre-existing high rates of loneliness, depression and poor/fair self-rated health in the interRAI population , we hypothesise that this population is at-risk of experiencing further decline in their health and psychosocial well-being as a result of the COVID-19 pandemic and self-isolation. The aims of this study are to (1) track the impact of COVID-19 on self-reported mood, self-rated health, other health and psychosocial indicators, and health services utilization of people who have an interRAI assessment during the first year of COVID-19; (2) compare these indicators with the same indicators in people who had an interRAI assessment in the year before COVID-19; and (3) report these indicators publicly as soon as data analysis is completed every 3 months.
The interRAI COVID-19 Study (iCoS) is an observational longitudinal study of routinely collected national health information.
interRAI data collection and data access
interRAI data are collected by trained interRAI assessors working in DHBs and approved community agencies that provide home support services. interRAI assessments are usually completed using a laptop computer, providing immediate outcomes at the time of assessment. There is a national competency framework that supports interRAI assessment and provides quality assurance for interRAI assessment. interRAI assessors must be clinically registered and signed off as competent to use the instruments by interRAI New Zealand. interRAI assessment competency is achieved by participating in training that involves a mixture of knowledge and skills, including completing real life assessments, passing an evaluation and achieving an acceptable quality review outcome. One of the competency standards is to ‘accurately record assessment information’ whereby an interRAI assessor uses multiple sources of information for example referral notes, person interview, observation, discussion with family or carers or health professionals to gain accurate information. The item domains of the interRAI Home Care version have been shown to have good inter-rater reliability .
interRAI data are entered in real-time to the Technical Advisory Services (TAS) data warehouse. Based on the 2018/19 figures, we estimate there are 9000 interRAI assessments per quarter (Fig. 1). We will compare the four post-lockdown quarters with the respective pre-lockdown quarters.
Primary and secondary outcomes
interRAI data will be de-identified and analysed for each of the quarters shown in Fig. 1. The primary outcomes are self-reported mood (feeling sad, depressed or hopeless, 0 = no, 1 = yes) and self-rated health (0 = excellent, 1 = good, 2 = fair, 3 = poor). We will also analyse sociodemographics, other secondary health and psychosocial indicators, and health services utilization. Table 1 shows a summary of these variables and the re-coding performed to allow some direct comparison between both versions of interRAI assessments (Home Care and Contact Assessment) in the pre- and post-lockdown periods.
The primary outcomes analysis
Initially, we will conduct descriptive statistics for primary outcomes and other indicators for each of the eight quarters (−Q4, −Q3, −Q2, −Q1, Q1, Q2, Q3, Q4) in Fig. 1. For example, rates of depressed/hopeless mood and fair/poor self-rated health. This analysis will describe the study sample and the distribution of explanatory variables to inform multivariate analysis strategies. To have comparable groups, we will adjust for confounders or modifiers such as demographic characteristics and factors associated with the assessment process using weights or propensity score matching methods.
Next, we will compare the pre-lockdown quarters with the post-lockdown quarters (−Q4 vs Q1, −Q3 vs Q2, −Q2 vs Q3, −Q1 vs Q4) by using regression models to control for the effect of demographic variables, physical or clinical factors, social indicators, lifestyle factors, or time of assessment. These factors will be incorporated in the model to test for significance.
The impact of COVID-19 measures on self-reported depressed mood (yes/no) will be evaluated using multivariate logistic regression. Self-rated health (0 = excellent, 1 = good, 2 = fair, 3 = poor) is an ordinal outcome and will be evaluated using ordinal logistic regression. If propensity score matching methods are used, we would use conditional logistic regression approaches. A stepwise selection of predictors will be used for inclusion in the model. Significant factors will be allowed to stay in the final model at p-value of less or equals to 0.05. Estimation approaches used for the regression models mentioned will be mixed models and generalized estimating equations (GEE). These approaches enable us to incorporate repeated measures in the analysis.
The fit and the validity of the models will be done by evaluating the deviance via goodness of fit tests. Multicollinearity will be tested using the variance inflation factor (VIF), which assesses how much the variance of an estimated regression coefficient increases if predictors are correlated. A VIF between 5 and 10 indicates high correlation that may be problematic.
R Statistical Software will be used for all analyses.
We will perform additional data analysis for the following at-risk subgroups: living alone, cognitive difficulty and the older age group (age 80+).
Data reporting and visualization
We will develop and publish an interactive report of key health and psychosocial indicators. The report will be publicly available as soon as data analysis is completed for each quarter in the 12-month post-lockdown period. TAS has existing infrastructure using Microsoft Power BI Service to publish interactive reports and dashboards such as interRAI reports available online at https://www.interrai.co.nz/data-and-reporting/. Power BI is a group of software services, apps, and connectors that work together to transform unrelated sources of data into coherent, visually immersive, and interactive insights . The objectives of this Power BI report are to (i) provide interactive descriptive analysis to monitor self-reported mood, self-rated health, other health and psychosocial indicators, and health services utilization of the interRAI population every 3 months in the first year of COVID-19, and (2) allow pre- and post- COVID-19 comparative analyses of selected indicators. The research team will work with a TAS web designer and data visualization specialist to report our results on the interRAI New Zealand website.
There has been a call for urgent action to mitigate the physical and mental health consequences of COVID-19 self-isolation in older adults . The ‘flattening the curve’ approach adopted by the New Zealand Government, including strict border control and quarantine was successful in practically controlling community transmission of COVID-19. The COVID-19 alert system implemented in New Zealand (Level 2 to 4) advises high-risk people to remain at home (e.g. those over 70 or those with other existing medical conditions). However, by easing some of these measures, many parts of the world are experiencing a second or third wave of COVID-19. Without this rapid translation of routinely collected national interRAI data, the health and psychosocial well-being of vulnerable older New Zealanders might be left un-monitored. If COVID-19 indeed has an impact on their health and psychosocial well-being, the New Zealand public health and social services and non-government organizations can ramp up their resources to address and minimize these problems at a national and/or community level as soon as our quarterly interRAI indicators become available. These rapid and effective responses could prevent further deterioration of the health of older New Zealanders, and decrease the impact on New Zealand health services. For example, evidence-based interventions to maximize mobility in older adults in isolation have been suggested , along with the use of a range of digital technologies for social engagement and measures to facilitate physical activity and nutrition [4, 22].
Physical illness, social isolation, and loneliness are well-recognised risk factors for late-life suicidal behaviour , especially during pandemic outbreaks . For example, the rates of suicide among older adults increased in 2003 during the Severe Acute Respiratory Syndrome (SARS) epidemic in Hong Kong . The effects of it lasted for the following years, since it was found that the suicide rates did not return to pre-epidemic rates . In New Zealand, suicide rates of older men aged 85 years and above between 2011 and 2019 were the second highest amongst all age groups . The social isolation and loneliness to which older adults are exposed during the COVID-19 pandemic in New Zealand could have important implications in increasing the already high suicide rates. interRAI includes information on self-rated health and depressed mood, which are two of the indicators we will report on. Many of the evidence-based late-life suicide prevention programmes target better screening and treatment of depression .
This study is a collaboration between the University of Auckland, interRAI New Zealand and TAS. interRAI New Zealand and TAS have expertise in interRAI data retrieval, analysis and dynamic reporting including web designing and data visualisation. interRAI Contact Assessment, a shorter version of interRAI-HC, replaced interRAI-HC in the first 3 months of the Level 4 lockdown in New Zealand. As shown in Table 1, some health indicators are not routinely collected by the interRAI Contact Assessment and this will result in missing data in the first post-lockdown quarter. Self-report mood and self-rated health are chosen as the two primary outcomes because they are included in both versions of interRAI assessments, which allows some direct comparison in the pre- and post-lockdown periods.
This study will generate a large health dataset that could be used to test other hypotheses. There is also an opportunity to link this dataset to other administrative datasets such as the Ministry of Health’s National Minimum Dataset (NMDS) for public and private hospital discharge information and Mortality Dataset for underlying causes of all registered deaths. We would welcome collaboration with other researchers and make our data available upon request and ethics approval. For example, Māori researchers who are interested in analysing health data related to the indigenous people of New Zealand. Our team already has members with expertise in Pacific and Asian health research who can interpret aspects of ethnicity-level data. Finally, insights from this study can be shared with other countries that use interRAI and prepare health and social services for similar epidemics/pandemics in the future.
Protocol version 1, 7 August 2020. interRAI data collection occurs in real-time to the TAS data warehouse. Data analysis for the 12-month pre-lockdown period and quarter 1 post-lockdown commenced on 12 August 2020.
Availability of data and materials
De-identified data and material are available upon request and ethics approval.
Coronavirus Disease of 2019
District Health Board
International Residential Assessment Instrument
International Residential Assessment Instrument-Home Care
Severe Acute Respiratory Syndrome
Technical Advisory Services
Lloyd-Sherlock P, Ebrahim S, Geffen L, McKee M. Bearing the brunt of Covid-19: older people in low and middle income countries. BMJ. 2020. https://doi.org/10.1136/bmj.m1052.
Davies N, Frost R, Bussey J, Hartmann-Boyce J, Park S. Maximising mobility in older people when isolated with COVID-19: Centre for Evidence-Based Medicine; 2020. https://discovery.ucl.ac.uk/id/eprint/10094045/. Accessed 21 Sept 2020.
World Health Organization. Mental health and psychosocial considerations during the COVID-19 outbreak. 2020. https://www.who.int/publications/i/item/WHO-2019-nCoV-MentalHealth-2020.1. Accessed 21 Sept 2020.
Armitage R, Nellums LB. COVID-19 and the consequences of isolating the elderly. Lancet Public Health. 2020. https://doi.org/10.1016/S2468-2667(20)30061-X.
Gerst-Emerson K, Jayawardhana J. Loneliness as a public health issue: the impact of loneliness on health care utilization among older adults. Am J Public Health. 2015;105:1013–9.
Holt-Lunstad J, Smith TB, Baker M, Harris T, Stephenson D. Loneliness and social isolation as risk factors for mortality. Perspect Psychol Sci. 2015;10:227–37.
Holt-Lunstad J, Smith TB, Layton JB. Social relationships and mortality risk: a meta-analytic review. PLoS Med. 2010. https://doi.org/10.1371/journal.pmed.1000316.
Santini ZI, Jose PE, Cornwell EY, Koyanagi A, Nielsen L, Hinrichsen C, Meilstrup C, Madsen KR, Koushede V. Social disconnectedness, perceived isolation, and symptoms of depression and anxiety among older Americans (NSHAP): a longitudinal mediation analysis. Lancet Public Health. 2020;5(1):e62–70.
Van Orden KA, Bower E, Lutz J, Silva C, Gallegos AM, Podgorski CA, Santos EJ, Conwell Y. Strategies to promote social connections among older adults during ‘social distancing’ restrictions. Am J Geriatr Psychiatry. 2020. https://doi.org/10.1016/j.jagp.2020.05.004.
Vahia IV, Blazer DG, Smith GS, Karp JF, Steffens DC, Forester BP, Tampi R, Agronin M, Jeste DV, Reynolds CF III. COVID-19, mental health and aging: a need for new knowledge to bridge science and service. Am J Geriatr Psychiatry. 2020. https://doi.org/10.1016/j.jagp.2020.03.007.
Cheung G, Wright-St Clair V, Chacko E, Barak Y. Financial difficulty and biopsychosocial predictors of loneliness: a cross-sectional study of community dwelling older adults. Arch Gerontol Geriat. 2019. https://doi.org/10.1016/j.archger.2019.103935.
Jamieson HA, Gibson HM, Abey-Nesbit R, Ahuriri-Driscoll A, Keeling S, Schluter PJ. Profile of ethnicity, living arrangements and loneliness amongst older adults in Aotearoa New Zealand: a national cross-sectional study. Australas J Ageing. 2018;37:68–73.
Statistics New Zealand. Loneliness in New Zealand: findings from the 2010 NZ General Social Survey. Wellington: Statistics New Zealand; 2013.
interRAI New Zealand. interRAI New Zealand Annual report 2018/19. https://www.interrai.co.nz/assets/9169ec695a/00-AR_interRAI_2019-FINAL_WEB.pdf. Accessed 21 Sept 2020.
Mathias K, Hirdes J, Pittman D. A care planning strategy for traumatic life events in community mental health and inpatient psychiatry based on the InterRAI assessment instruments. Community Ment Health J. 2010;46(6):621–7.
Cheung G, Edwards S, Sundram F. Death wishes among older people assessed for home support and long-term aged residential care. Int J Geriatr Psychiatry. 2017;32:1371–80.
Hagan Hennessy C, Walker, A. Growing Older: Quality Of Life In Old Age. McGraw-Hill Education (UK). 2004.
Burholt V, Scharf T. Poor health and loneliness in later life: the role of depressive symptoms, social resources, and rural environments. J Gerontol B Psychol Sci Soc Sci. 2014;69:311–24.
Burholt V, Windle G, Morgan D. A social model of loneliness: the roles of disability, social resources and cognitive impairment. Gerontologist. 2016;57:1020–30.
Hirdes JP, Ljunggren G, Morris JN, Frijters DH, Soveri HF, Gray L, Björkgren M, Gilgen R. Reliability of the interRAI suite of assessment instruments: a 12-country study of an integrated health information system. BMC Health Serv Res. 2008;8:277.
Microsoft. What is Power BI. https://docs.microsoft.com/en-us/power-bi/fundamentals/power-bi-overview. Accessed 21 Sept 2020.
Cheung G, Peri K. Challenges to dementia care during COVID-19: innovations in remote delivery of group cognitive stimulation therapy. Aging Ment Health. 2020. https://doi.org/10.1080/13607863.2020.1789945.
Cheung G, Merry S, Sundram F. Medical examiner and coroner reports: uses and limitations in the epidemiology and prevention of late-life suicide. Int J Geriatr Psychiatry. 2015;30:781–92.
Yip PSF, Cheung YT, Chau PH, Law YW. The impact of epidemic outbreak. Crisis. 2010;31:86–92.
Cheung YT, Chau PH, Yip PS. A revisit on older adults suicides and severe acute respiratory syndrome (SARS) epidemic in Hong Kong. Int J Geriatr Psychiatry. 2008;23:1231–8.
Barak Y, Cheung G, Fortune S, Glue P. No country for older men: ageing male suicide in New Zealand. Australas Psychiatry. 2020. https://doi.org/10.1177/1039856220905304.
Okolie C, Dennis M, Simon Thomas E, John A. A systematic review of interventions to prevent suicidal behaviors and reduce suicidal ideation in older people. Int Psychogeriatr. 2017;29:1801–24.
The authors would like to thank Michelle Liu and Kevin Wang, Technical Advisory Services Analysis and Modelling team, for designing and developing the data visualisation tool.
Auckland Medical Research Foundation and Central Region Technical Advisory Services Limited provided funding for this study.
Ethics approval and consent to participate
Ethics approval was obtained from Auckland Health Research Ethics Committee (reference AH2579). We will include participants (~ 93% of interRAI population) who gave consent to have their records to be used for research purposes at the time of their interRAI assessment.
Consent for publication
Participants did not specifically provide consent for their de-identified data to be published.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Cheung, G., Rivera-Rodriguez, C., Martinez-Ruiz, A. et al. Impact of COVID-19 on the health and psychosocial status of vulnerable older adults: study protocol for an observational study. BMC Public Health 20, 1814 (2020). https://doi.org/10.1186/s12889-020-09900-1
- Older adults
- Mental health