Key summary points
In this study, the interrater reliability of the Clinical Frailty Scale (CFS) ratings comparing assessments by both experienced and unexperienced staff (ED clinicians and a study team (ST) using a smartphone application to support CFS scoring) was evaluated. The feasibility of the CFS assignment at ED triage, defined as a majority of patients aged 65 or older assigned a CFS level at triage, was also investigated.
AbstractSection FindingsIn this cross-sectional study of 1349 consecutive ED patients aged 65 years and older, the interrater reliability for CFS ratings was good for three different dyads assessed, whether used as an ordinal scale or as frailty categories (CFS 1–4 = non-frail to vulnerable; CFS 5–6 = mild to moderate frailty; CFS 7–9 = severe frailty to terminally ill). More than two-thirds (70.2%) of patients had a CFS rating assigned at triage.
AbstractSection MessageThe CFS is a reliable scale for use in the ED and the implementation of frailty assessment could be facilitated with an algorithm-assisted assessment.
Abstract
Purpose
The Clinical Frailty Scale (CFS) allows health care providers to quickly stratify older patients, to support clinical decision-making. However, few studies have evaluated the CFS interrater reliability (IRR) in Emergency Departments (EDs), and the freely available smartphone application for CFS assessment was never tested for reliability. This study aimed to evaluate the interrater reliability of the Clinical Frailty Scale (CFS) ratings between experienced and unexperienced staff (ED clinicians and a study team (ST) of medical students supported by a smartphone application to assess the CFS), and to determine the feasibility of CFS assignment in patients aged 65 or older at triage.
Methods
Cross-sectional study using consecutive sampling of ED patients aged 65 or older. We compared assessments by ED clinicians (Triage Clinicians (TC) and geriatric ED trained nurses (geriED-TN)) and a study team (ST) of medical students using a smartphone application for CFS scoring. The study is registered on Clinicaltrials.gov (NCT05400707).
Results
We included 1349 patients aged 65 and older. Quadratic-weighted kappa values for ordinal CFS levels showed a good IRR between TC and ST (ϰ = 0.73, 95% CI 0.69–0.76), similarly to that between TC and geriED-TN (ϰ = 0.75, 95% CI 0.66–0.82) and between the ST and geriED-TN (ϰ = 0.74, 95% CI 0.63–0.81). A CFS rating was assigned to 972 (70.2%) patients at triage.
Conclusion
We found good IRR in the assessment of frailty with the CFS in different ED providers and a team using a smartphone application to support rating. A CFS assessment occurred in more than two-thirds (70.2%) of patients at triage.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Background
Frailty is a state of increased vulnerability to stressors which develops as a consequence of age-related decline in several inter-related physiological systems [1, 2], and is associated with a wide range of adverse health outcomes such as delirium, falls, functional decline, prolonged hospitalization and death [3,4,5,6,7,8,9]. Although qualitative assessment using “clinical judgment” is often used to identify frailty, this is not a reliable method and is less accurate than using formal assessment tools [10]. Several assessment tools have been proposed to assist with the identification of frailty in the Emergency Department (ED) [10,11,12,13].
The Clinical Frailty Scale (CFS) is a 9-point scale ranging from “very fit” to “terminally ill” [14]. It is one of the most commonly used frailty assessment tools [15]. The CFS allows health care providers to quickly stratify older patients with the help of pictographs and clinical descriptors. Using the CFS in the ED may be helpful in the early identification of patients who may benefit from additional services, and to support clinical decision-making [3, 8, 9, 16]. The CFS takes less than a minute to complete and due to its simplicity and ease of use the CFS is well-suited for use in the ED [12, 17,18,19,20].
Importance
The CFS has been investigated for interrater reliability (IRR) between nurses and physicians, between patients’ self-ratings and health care providers’ ratings, and between physicians from different specialties [19, 21,22,23,24]. In EDs, however, there has been a limited amount of studies evaluating the CFS interrater reliability, either including few patients or specific patient groups or never including nurses who specialize in care of older patients. In an ED study from the UK in which the CFS is in routine use, frailty assessment at triage was reported to include 50.3% of patients aged 65 and older [8]. A smartphone application has also been made available to aid CFS scoring in the hands of less experienced personnel. The application was developed as a response to the National Institute of Health and Care Excellence recommending use of the CFS when risk stratifying older people with COVID-19 [25].
It was previously suggested to determine frailty adjusted triage in the ED setting by assessing both acuity (with the Emergency Severity Index, ESI triage tool) and frailty (as measured with the CFS) [3, 9, 16, 26,27,28,29]. Frailty adjusted triage was implemented in our ED prior to the COVID-19 pandemic [30, 31], but to what degree this process is adhered to is unknown.
Goals of this investigation
The primary aim of this study was to evaluate the IRR of CFS ratings comparing assessments by both experienced and unexperienced staff (ED clinicians and a study team (ST) using a smartphone application to support CFS scoring), in a consecutive sample of ED patients aged 65 and older. In addition, we aimed to determine the proportion of patients aged 65 or older who were assigned a CFS level at triage.
Methods
Study design and setting
This cross sectional analysis of a subgroup of patients aged 65 and older was based on a prospective observational study using consecutive sampling. All patients, aged 18 or older, who presented to the ED of the University Hospital Basel, in Northwestern Switzerland, between April 25 and May 30, 2022, were assessed for inclusion 24 h a day, 7 days a week. The University Hospital Basel is a tertiary care center with an annual ED attendance of approximately 55,000 patients aged 16 years and older, of whom about a third are aged 65 years or older. Obstetric, pediatric, and ophthalmologic patients are treated in separate facilities on campus. There are three geriatric hospitals, two palliative care facilities, and 39 nursing homes with almost 2900 nursing beds in the area.
This study is reported according to the “Guidelines for Reporting Reliability and Agreement Studies (GRRAS)” [32]. The GRRAS checklist for reporting of studies of reliability and agreement can be found in Supplemental Table 1.
Selection of participants
This study was approved by the local Ethics Committee (EKNZ, Nr. 236/13) and conducted according to the principles of the Declaration of Helsinki. The study is registered on the Clinicaltrials.gov website (study N° NCT05400707). All patients presenting to the ED of the University Hospital Basel during the study period were screened for inclusion. Patients who were unable to provide verbal informed consent (e.g., treatment in the resuscitation bay or immediate transfer to the OR) were not included. Of note, patients with cognitive impairment who were able to provide verbal consent were not excluded to minimize bias, in accordance with previous recommendations [33, 34]. The analysis included all index visits from patients aged 65 and over.
Data collection
During the study period (24 h a day, 7 days a week), patients were screened and interviewed by a study team member upon presentation to the ED. All data were recorded on machine-readable case report forms, which were subsequently scanned, and the data were then cleaned in a two-step process. This was carried out first, by ED administrators for handwriting issues and legibility issues, and then by an external company, Digx Gmbh®, which was also responsible for the transfer of data into the database. All other data from the patients’ Electronic Health Record (EHR) were also transferred into the database, using the unique patient ID to match it with the EHR. Demographics (such as age and sex) and the Emergency Severity Index level (ESI), a 5 level triage tool [35], were collected from the EHR. ESI triage level assignment is mandatory in all patients presenting to the ED, and can, therefore, be used as a comparator to assess adherence to frailty-adjusted score [9].
CFS assessment
The CFS was assessed by three different groups of raters: Triage clinicians (TC), geriatric ED trained nurses (geriED-TN), and a study team (ST) of medical students supported by the CFS smartphone application [36]. The group of TC raters consisted of 67 nurses who work 24/7 and 25 triage liaison physicians who are present during highest patient influx times (i.e., during 8 a.m. and 00:00 a.m.) and are available for rapid assessments, communication and test ordering at triage [37]. The team of geriED-TN raters consisted of 8 ED nurses specialized in care of older patients with at least a bachelors’ degree. The geriED-TN are present from Monday to Friday 8 a.m. to 5 p.m. to assess patients deemed at geriatric risk. The ST group of raters consisted of medical students in their fourth to sixth year (of six years) of medical school training. The ST was unaware of the hypothesis of this study and was not involved in patient care.
As the study site is located in a German-speaking area of Switzerland, we had previously performed an authorized translation of the CFS into German with permission (Supplemental Fig. 2) [35, 38, 39]. This translation is used in clinical routine in our ED and was, therefore, used by the TC and the geriED-TN. The ST assessed the CFS using the “Clinical Frailty Scale (CFS)” application (version 1.1.0) on a handheld device [36]. The CFS smartphone application was developed by NHS Elect and clinicians in Leicester UK and specifically designed to reduce anchoring bias when using the CFS [40], by guiding users through the CFS in reverse order. This elicited negative responses to the highest level of dysfunction as opposed to settling on positive responses to the lowest degree of dysfunction thus reducing a tendency to underscore subjects.
TC, in charge of triage, i.e., determining the acuity (with the ESI), assessed the CFS during the triage process upon patients’ arrival in the ED. All patients aged 65 or older are meant to be assessed with the CFS. The geriED-TN assess CFS ratings in a subset of patients that were deemed at geriatric risk. At 8 a.m. they routinely assess these patients that stayed in the ED observation unit overnight. The ST assessed CFS in the first hour after patients’ arrival in the ED for all patients aged 65 or older.
Training of TC consisted of a day of teaching and case-based discussions in geriatric emergency medicine topics. Additionally, TC received CFS training using case vignettes. In addition to normal TC training, the geriED-TN received individual teaching by an experienced Advanced Practice Nurse, the clinical champion of the geriED-TN team while on shift. Further, every 3 months, a whole-day workshop with case-based discussions, action learning and continuing education on geriatric topics is organized. The ST received half an hour of training in the concept of frailty in general, and the CFS in particular. In addition, the members of the ST were instructed to use the application’s algorithm to determine frailty levels and used the training material provided in the application.
Outcomes
The primary outcome was the IRR of CFS assessments between triage clinicians, a dedicated ST supported by a smartphone application, and a team of geriED-TN. As a secondary outcome, we investigated the proportion of patients that are assessed for frailty, with the CFS, in daily routine (by TC and geriED-TN). This was defined as the adherence rate. Feasibility was defined as an adherence rate in the majority of all patients, as 50% is the adherence found in a similar study [8]. In addition, the adherence rate of frailty assessments was compared to the rate of acuity assessments.
Statistical analysis
Descriptive statistics are expressed as counts and percentages or as medians with interquartile ranges (IQR). IRR between ordinal (i.e., 1 to 9) CFS ratings was calculated using quadratic-weighted kappa statistics with 95% confidence intervals (CI) for these associations: TC – ST, TC – geriED-TN, and ST – geriED-TN. Quadratic-weighted kappa was also calculated for categorized CFS levels (CFS 1–4 = non-frail to vulnerable; CFS 5–6 = mild to moderate frailty; CFS 7–9 = severe frailty to terminally ill). A kappa value < 0.20 was considered as poor agreement, 0.20–0.40 as fair agreement, 0.41–0.60 as moderate agreement, 0.61–0.80 as good agreement and > 0.80 as very good agreement [41]. The Kappa’s 95% CI were calculated using bootstrap methods. Intraclass correlation coefficients (ICC) and their 95% confident intervals between ordinal CFS ratings were calculated based on a single rater, absolute agreement, 2-way mixed-effects model. We interpreted the ICC values as such: less than 0.5 are indicative of poor reliability, values between 0.5 and 0.75 indicate moderate reliability, values between 0.75 and 0.9 indicate good reliability, and values greater than 0.90 indicate excellent reliability [42]. Heatmaps were constructed to compare the CFS ratings between the three dyads of raters. Bland–Altman plots were constructed to illustrate the differences between two group of raters plotted against their average. All statistical analyses were performed using R, version 4.2.1 [43].
Results
Baseline characteristics and CFS ratings
Of 4,931 patients screened for inclusion, 335 were not enrolled because they denied informed consent. We included 1349 patients aged 65 and older of whom 708 (52.5%) were female (for details, see Fig. 1). Median age was 78 (IQR: 72, 85). A CFS level was assigned at triage in 946 patients (70.2%), of whom 342 (36.1%) were frail (CFS > 4). In comparison, an ESI level was assigned at triage in 1,342 patients (99.6%). Median CFS at triage was 4 (IQR: 3, 5). GeriED-TN assigned 131 CFS ratings to patients under their care, of whom 80 (61.1%) were frail. Median CFS assigned by GeriED-TN was 5 (IQR: 4, 6). A CFS level was assigned by the ST in 1,131 patients (83.9%), of whom 414 (36.6%) were frail. Median CFS assigned by the ST was 4 (IQR: 3, 5). Overall, 972 (72.1%) patients had CFS levels assigned by the clinical team (by either TC and/or geriED-TN). The patients who did not receive any CFS rating from the clinical team (TC and geriED-TN) were younger, were less frequently of female gender, had higher urgency (i.e., lower ESI), were more likely to be admitted to the ICU than those who were assigned a CFS by the clinical team (for details, see Table 1).
Figure 2 displays the comparison and distribution of the CFS ratings by assessor category.
CFS IRR
Quadratic-weighted kappa values for ordinal CFS levels showed a good IRR between TC and ST (ϰ = 0.73, 95% CI 0.69–0.76), similarly to that between TC and geriED-TN (ϰ = 0.75, 95% CI 0.66–0.82) and between the ST and geriED-TN (ϰ = 0.74, 95% CI 0.63–0.81). After categorization of the CFS ratings, the quadratric-weighted kappa values showed a good IRR for all three dyads (TC–ST: ϰ = 0.70, 95% CI 0.65–0.75 / TC–geriED-TN: ϰ = 0.70, 95% CI 0.59–0.79 / ST–geriED-TN: ϰ = 0.67, 95% CI 0.55–0.77) (for details, see Table 2).
The ICC showed a good reliability between TC and geriED-TN (ICC = 0.78, 95% CI 0.70–0.85) as well as between the ST and geriED-TN (ICC = 0.75, 95% CI 0.66–0.82). The ICC showed a moderate reliability between TC and the ST (ICC = 0.73, 95% CI 0.70–0.76) (for details, see Supplemental Table 2). The mean bias, from the Bland–Altman analyses, were calculated to be: −0.17 (95% CI −0.26 to −0.09) between TC and ST, −0.49 (95% CI −0.70 to −0.27) between TC and geriED-TN, and −0.27 (95% CI −0.50 to −0.05) between ST and geriED-TN. Bland Altman plots for the three dyads are shown in Supplemental Fig. 1.
Discussion
In this cross-sectional study of 1349 consecutive ED patients aged 65 years and older the IRR of CFS ratings was good for all three different dyads assessed (TC–ST, TC–geriED-TN, and ST–geriED-TN), whether used as an ordinal scale or to categorize patients into frailty categories. In addition, we could show feasibility of the CFS at triage, as more than two-thirds (70.2%) of patients had a CFS rating assigned at triage, and in total, 72.1% of patients had a CFS rating assigned by the clinical team (TC and geriED-TN).
IRR of CFS ratings has been previously investigated. A large multi-center study demonstrated very good IRR of the CFS for a selected group of ICU patients aged 80 and older [44]. A Danish study on 40 raters that were distributed across several health care professions assessed clinical case vignettes using the Danish version of the CFS showing excellent IRR [24]. In EDs, there are limited data evaluating IRR of CFS ratings. Moderate agreement between patients’ self-ratings and health care providers’ ratings was demonstrated in North American academic EDs [19, 22]. A recent Swedish study performed in three EDs of one university hospital and two community hospitals on a total of 100 patients found moderate to good level of IRR of physicians of different specialties, registered nurses, and assistant nurses [21]. Another ED study on 100 patients compared ratings between nurses completing CFS assessments during bedside nursing to those made by one emergency physician with geriatric expertise and observed almost perfect interrater reliability [23].
Possibly, the CFS was not assessed in 402 patients (29.8%) at triage because of higher acuity (lower ESI level) and rapid treatment, e.g., in the resuscitation bay. However, this acutely-ill/-injured population is more often admitted to the ICU and could potentially benefit from frailty assessment as well, as it could help to identify the vulnerable and frail patients that are at risk of adverse outcomes, and who may benefit from extra services or care coordination [4, 5, 7]. However, the proportion of CFS ratings at triage was higher than previously described [10].
Despite the time pressure in the triage environment, the IRR of the CFS ratings was good between TC and geriED-TN. In non-concordant cases, a higher frailty level was mostly assigned by the geriED-TN. This is likely due to selection bias: geriED-TN assessed CFS in a subset of patients that were deemed to be at geriatric risk. In addition, GeriED-TNs do not have to focus primarily on identifying patients at risk for acute life-threatening events and have the opportunity to learn more about the patient and his environment. Thus, through learning more about the patient and his environment, individual aspects of frailty are more likely to be identified. Furthermore, establishment of a relation of trust may lead to more confession of deficits. This supports that assessing frailty at triage versus at disposition could be different and have a different impact [45]. While the primary function of TC is to identify patients who need to be managed quickly to avoid life-threatening events, the focus at triage is categorization of ED patients by acuity. This was highlighted by the fact that the ESI, was missing in only 6 visits during the study period, yielding to an adherence rate of 99.6%.
The questions about the degree of acceptable disagreement between raters and about the optimal use of a scale that did not show excellent reliability were raised [21]. In our study, most differences in ratings amounted to one point on this 9-point scale; more rarely, the deviation was 2 points or more. When considering frailty as a continuous entity that increases with rising CFS rating, and not a state that is present or not, this 1-point disagreement seems to be acceptable. On the other hand, if CFS ratings are used to categorize individuals as frail or non-frail and used to guide future management, a 1-point disagreement may have consequences. However, we could show that the CFS showed a good IRR even when used to categorize patients in frailty categories.
The implementation of an assessment tool in clinical practice is inevitably accompanied by challenges, particularly due to the additional workload [13]. Skills and beliefs about capacities were identified to be another possible barrier to implementing an assessment tool [46]. In addition, the use of an algorithm to assist assessment of the CFS was shown to help with reliable scoring by untrained raters [47]. We should ideally aim for caregivers with experience and training in the concepts of geriatric emergency medicine and not for unexperienced staff without specific knowledge in these areas. However, allowing less experienced staff to assess frailty with an algorithm could facilitate the implementation of frailty screening. Barriers that hindered people using frailty tools were identified to be the feeling that “it is not a priority” or that “it is someone else’s role” [10, 48] and allowing any caregiver to assess the CFS would help avoid these barriers. Incorporating frailty into the broader management plan may become more and more standard in the future. A routine, rapid and reliable standard assessment of frailty at arrival may be helpful for implementation.
Limitations
This was a single-center study in Switzerland, focused on a mostly Caucasian population, with inclusions during a 5-week period from April to May. The results of this study may not be generalizable to other hospitals, populations, or times of year. A certain inclusion bias can be assumed as the patients aged 65 and older that did not had a CFS assigned from the clinical team were younger and of higher urgency than those who did receive a CFS rating. By excluding non-consenting older adults for ethical concerns, we may have excluded frail patients and this could have impacted our results [33]. As there was no direct comparison (medical students scoring CFS without support by a smartphone application), it cannot be concluded for sure that the support by a smartphone application for CFS scoring improved interrater reliability. We did not record the information available on the pre-admission status of the patients when assessing the CFS, and it possible that the three groups of raters did not had the same information at time of assessment.
The groups are described in aggregate and no sub-analysis within groups were performed. We cannot assure that there is no variation of reliability within groups.
We used version 1.2 of the CFS tool. In the meantime, the CFS was updated to version 2.0 to address a caveat that assessment of the habitual health state of patients rather than the state of acute illness should occur. To help with this, level headings were revised in version 2.0. As these are minor differences between the versions, we speculate that the results of this study will still be applicable to CFS 2.0 [49].
Conclusion
With an increasingly aging population, there is a need to consider the aspect of frailty in older people during clinical assessment, so that clinical treatment concepts can be adapted accordingly. We found good IRR in the assessment of frailty with the CFS in different ED providers and a team of medical students using a smartphone application to support rating. Therefore, the implementation of frailty assessment could be facilitated with an electronic decision support. In our ED we demonstrated feasibility of scoring the CFS at ED triage, as CFS assessment occurred in more than two-thirds (70.2%) of patients at triage.
Data availability
The data that support the findings of this study are available from the corresponding author upon reasonable request, supported with a letter of authorization from an ethics committee.
References
Clegg A, Young J, Iliffe S, Rikkert MO, Rockwood K (2013) Frailty in elderly people. Lancet 381(9868):752–762
Wilson D, Jackson T, Sapey E, Lord JM (2017) Frailty and sarcopenia: The potential role of an aged immune system. Ageing Res Rev 36:1–10
Kaeppeli T, Rueegg M, Dreher-Hummel T, Brabrand M, Kabell-Nissen S, Carpenter CR et al (2020) Validation of the clinical frailty scale for prediction of thirty-day mortality in the emergency department. Ann Emerg Med 76(3):291–300
Bo M, Fonte G, Pivaro F, Bonetto M, Comi C, Giorgis V et al (2016) Prevalence of and factors associated with prolonged length of stay in older hospitalized medical patients. Geriatr Gerontol Int 16(3):314–321
Cunha AIL, Veronese N, de Melo Borges S, Ricci NA (2019) Frailty as a predictor of adverse outcomes in hospitalized older adults: a systematic review and meta-analysis. Ageing Res Rev 56:100960
Cardona M, Lewis ET, Kristensen MR, Skjøt-Arkil H, Ekmann AA, Nygaard HH et al (2018) Predictive validity of the CriSTAL tool for short-term mortality in older people presenting at Emergency Departments: a prospective study. Eur Geriatric Med 9(6):891–901
Hubbard RE, Peel NM, Samanta M, Gray LC, Mitnitski A, Rockwood K (2017) Frailty status at admission to hospital predicts multiple adverse outcomes. Age Ageing 46(5):801–806
Elliott A, Taub N, Banerjee J, Aijaz F, Jones W, Teece L et al (2021) Does the clinical frailty scale at triage predict outcomes from emergency care for older people? Ann Emerg Med 77(6):620–627
Kabell Nissen S, Rueegg M, Carpenter CR, Kaeppeli T, Busch JM, Fournaise A et al (2023) Prognosis for older people at presentation to emergency department based on frailty and aggregated vital signs. J Am Geriatr Soc 71(4):1250–1258
Elliott A, Phelps K, Regen E, Conroy SP (2017) Identifying frailty in the Emergency Department—feasibility study. Age Ageing 46(5):840–845
Van Damme J, Neiterman E, Oremus M, Lemmon K, Stolee P (2020) Perspectives of older adults, caregivers, and healthcare providers on frailty screening: a qualitative study. BMC Geriatrics 20(1):65
Jarman H, Crouch R, Baxter M, Wang C, Peck G, Sivapathasuntharam D, et al. (2021) Feasibility and accuracy of ED frailty identification in older trauma patients: a prospective multi-centre study. Scand J Trauma Resusc Emerg Med 29(1):54.
van der Burgh R, Wijnen N, Visscher M, de Groot B, Lucke J (2022) The feasibility and acceptability of frailty screening tools in the Emergency Department and the additional value of clinical judgment for frailty detection. Eur J Emerg Med 29(4):301–303
Rockwood K, Song X, MacKnight C, Bergman H, Hogan DB, McDowell I et al (2005) A global clinical measure of fitness and frailty in elderly people. Can Med Assoc J 173(5):489–495
Theou O, Squires E, Mallery K, Lee JS, Fay S, Goldstein J et al (2018) What do we know about frailty in the acute care setting? A scoping review. BMC Geriatrics 18(1):139
Rueegg M, Nissen SK, Brabrand M, Kaeppeli T, Dreher T, Carpenter CR et al (2022) The clinical frailty scale predicts 1-year mortality in emergency department patients aged 65 years and older. Acad Emerg Med 29(5):572–580
Lewis ET, Dent E, Alkhouri H, Kellett J, Williamson M, Asha S et al (2019) Which frailty scale for patients admitted via Emergency Department? A cohort study. Arch Gerontol Geriatr 80:104–114
Church S, Rogers E, Rockwood K, Theou O (2020) A scoping review of the Clinical Frailty Scale. BMC Geriatrics 20(1):393
Dresden SM, Platts-Mills TF, Kandasamy D, Walden L, Betz ME (2019) Patient versus physician perceptions of frailty: a comparison of clinical frailty scale scores of older adults in the Emergency Department. Acad Emerg Med 26(9):1089–1092
O’Caoimh R, Costello M, Small C, Spooner L, Flannery A, O’Reilly L et al (2019) Comparison of frailty screening instruments in the Emergency Department. Int J Environ Res Public Health 16(19):3626
Hörlin E, Munir Ehrlington S, Henricson J, John RT, Wilhelms D (2022) Inter-rater reliability of the Clinical Frailty Scale by staff members in a Swedish Emergency Department setting. Acad Emerg Med 29(12):1431–1437
Ringer T, Thompson C, McLeod S, Melady D (2020) Inter-rater agreement between self-rated and staff-rated clinical frailty scale scores in older Emergency Department Patients: a prospective observational study. Acad Emerg Med 27(5):419–422
Lo AX, Heinemann AW, Gray E, Lindquist LA, Kocherginsky M, Post LA et al (2021) Inter-rater reliability of clinical frailty scores for older patients in the Emergency Department. Acad Emerg Med 28(1):110–113
Nissen SK, Fournaise A, Lauridsen JT, Ryg J, Nickel CH, Gudex C et al (2020) Cross-sectoral inter-rater reliability of the clinical frailty scale - a Danish translation and validation study. BMC Geriatr 20(1):443
National Institute for Health and Care Excellence (2021) Clinical Guidelines. COVID-19 rapid guideline: critical care in adults. London: National Institute for Health and Care Excellence (NICE). Copyright © NICE 2021
Blomaard LC, Speksnijder C, Lucke JA, de Gelder J, Anten S, Schuit SCE et al (2020) Geriatric screening, triage urgency, and 30-day mortality in older Emergency Department patients. J Am Geriatr Soc 68(8):1755–1762
Bullard MJ, Musgrave E, Warren D, Unger B, Skeldon T, Grierson R et al (2017) Revisions to the Canadian Emergency Department Triage and Acuity Scale (CTAS) Guidelines 2016. CJEM 19(S2):S18–S27
Age / Frailty Adjusted Risk Stratification. European Task Force for Geriatric Emergency Medicine; [02.06.2023]; Available from: https://posters.geriemeurope.eu/posters/p02/
Lucke JA, Mooijaart SP, Heeren P, Singler K, McNamara R, Gilbert T et al (2022) Providing care for older adults in the Emergency Department: expert clinical recommendations from the European Task Force on Geriatric Emergency Medicine. Eur Geriatr Med 13(2):309–317
Simon NR, Jauslin AS, Rueegg M, Twerenbold R, Lampart M, Osswald S et al (2021) Association of frailty with adverse outcomes in patients with suspected COVID-19 infection. J Clin Med 10(11):2472
Nickel CH, Rueegg M, Pargger H, Bingisser R (2020) Age, comorbidity, frailty status: effects on disposition and resource allocation during the COVID-19 pandemic. Swiss Med Wkly 20(150):w20269
Kottner J, Audigé L, Brorson S, Donner A, Gajewski BJ, Hróbjartsson A et al (2011) Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. J Clin Epidemiol 64(1):96–106
Prusaczyk B, Cherney SM, Carpenter CR, DuBois JM (2017) Informed consent to research with cognitively impaired adults: transdisciplinary challenges and opportunities. Clin Gerontol 40(1):63–73
Adamis D, Martin FC, Treloar A, Macdonald AJ (2005) Capacity, consent, and selection bias in a study of delirium. J Med Ethics 31(3):137–143
Grossmann FF, Nickel CH, Christ M, Schneider K, Spirig R, Bingisser R (2011) Transporting clinical tools to new settings: cultural adaptation and validation of the emergency Severity Index in German. Ann Emerg Med 57(3):257–64
Clinical Frailty Scale App. https://www.acutefrailtynetwork.org.uk/Clinical-Frailty-Scale/Clinical-Frailty-Scale-App: NHS Acute Frailty Network; 2020 [31.05.2023]
Lauks J, Mramor B, Baumgartl K, Maier H, Nickel CH, Bingisser R (2016) Medical team evaluation: effect on Emergency Department waiting time and length of stay. PLoS ONE 11(4):e0154372
Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A et al (2005) Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: Report of the ISPOR Task Force for Translation and Cultural Adaptation. Value Health 8(2):94–104
Dalhousie University. Geriatric medicine research, our tools. Clinical Frailty Scale. https://www.dalca/sites/gmr/our-tools/clinical-frailty-scale.html
Tversky A, Kahneman D (1974) Judgment under uncertainty: heuristics and biases. Science 185(4157):1124–1131
Cohen J (1960) A coefficient of agreement for nominal scales. Educ Psychol Meas 20:37–46
Koo TK, Li MY (2016) A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 15(2):155–163
Team RC (2022) R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna
Flaatten H, Guidet B, Andersen FH, Artigas A, Cecconi M, Boumendil A et al (2021) Reliability of the clinical frailty scale in very elderly ICU patients: a prospective European study. Ann Intensive Care 11(1):22
Fehlmann CA, Nickel CH, Cino E, Al-Najjar Z, Langlois N, Eagles D (2022) Frailty assessment in emergency medicine using the Clinical Frailty Scale: a scoping review. Intern Emerg Med 17(8):2407–2418
Cane J, O’Connor D, Michie S (2012) Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci 7(1):37
Theou O, Pérez-Zepeda MU, van der Valk AM, Searle SD, Howlett SE, Rockwood K (2021) A classification tree to assist with routine scoring of the Clinical Frailty Scale. Age Ageing 50(4):1406–1411
Southerland LT, Hunold KM, Van Fossen J, Caterino JM, Gulker P, Stephens JA et al (2022) An implementation science approach to geriatric screening in an emergency department. J Am Geriatr Soc 70(1):178–187
Fournaise A, Nissen SK, Lauridsen JT, Ryg J, Nickel CH, Gudex C et al (2021) Translation of the updated clinical frailty scale 2.0 into Danish and implications for cross-sectoral reliability. BMC Geriatr 21(1):269
Funding
Open access funding provided by University of Basel.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
On behalf of all authors, the corresponding author states that there is no conflict of interest.
Ethical approval
This study was approved by the local Ethics Committee (EKNZ, Nr. 236/13) and conducted according to the principles of the Declaration of Helsinki. The study is registered on the Clinicaltrials.gov website (study N° NCT05400707). All patients presenting to the ED of the University Hospital Basel during the study period were screened for inclusion.
Informed consent
Patients who were unable to provide verbal informed consent (e.g., treatment in the resuscitation bay or immediate transfer to the OR) were not included. Of note, patients with cognitive impairment who were able to provide verbal consent were not excluded to minimize bias, in accordance with previous recommendations [3334]. The analysis included all index visits from patients aged 65 and over.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Albrecht, R., Espejo, T., Riedel, H.B. et al. Clinical Frailty Scale at presentation to the emergency department: interrater reliability and use of algorithm-assisted assessment. Eur Geriatr Med 15, 105–113 (2024). https://doi.org/10.1007/s41999-023-00890-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41999-023-00890-y