ALS Cognitive Behavioral Screen-Phone Version (ALS-CBS™-PhV): norms, psychometrics, and diagnostics in an Italian population sample

Background Up to 50% of motor neuron disease (MND) patients show neuropsychological deficits which negatively affect prognosis and care. However, disability-related logistical issues and uneven geographical coverage of healthcare services may prevent MND patients from accessing neuropsychological evaluations. This study thus aimed to standardize for the Italian population the ALS Cognitive Behavioral Screen-Phone Version (ALS-CBS™-PhV), an MND-specific, telephone-based screening for frontotemporal dysfunction. Methods The cognitive section of the ALS-CBS™-PhV, the Italian telephone-based Mini-Mental State Examination (Itel-MMSE), and the Telephone Interview for Cognitive Status (TICS) was administered to 359 healthy individuals (143 males, 216 females; age, 52.7 ± 15.8; education, 13.1 ± 4.4). Norms were derived through equivalent scores. Validity, factorial structure, reliability, diagnostic accuracy, and item difficulty and discrimination were examined. Statistical equivalence between the telephone-based and in-person versions was tested. Results ALS-CBS™-PhV measures were predicted by age and education. The ALS-CBS™-PhV reflected a mono-component structure, converged with Itel-MMSE and TICS scores (rs = .23–.51) and was equivalent to its in-person format (t = .37; p = .72). Good internal (Cronbach’s α = .61), test–retest (ICC = .69), and inter-rater (ICC = .96) reliability was detected. High accuracy was found when tested against both the Itel-MMSE and the TICS (AUC = .82–89). Backward digit span items were the most discriminative. Discussion The ALS-CBS™-PhV is a statistically solid screening test for frontotemporal disorders featuring MND. Its standardization allows for (1) improvements in tele-healthcare for MND patients, (2) epidemiological applications, and (3) effective assessments in decentralized clinical trials. The ALS-CBS™-PhV can be also suitable for assessing bedridden and visually impaired patients with motor disorders.


Introduction
Since motor neuron diseases (MNDs) and frontotemporal (FT) degenerations are pathophysiologically related [6], neuropsychological deficits within the FT spectrum occur in up to 50% of MND patients [34].
Early detection of FT involvement in MND is crucial due to its unfavorable impact on patients' prognosis and management [24]. Neuropsychological screening in MND patients has thus entered the customary clinical practice [40], with an ad hoc nosographic system [34] and the development of MND-specific diagnostic tools [33].
Among the latter, the ALS Cognitive Behavioral Screen (ALS-CBS™) [39] represents a guideline-recommended [34], I-level test. The psychometric and diagnostic properties of the ALS-CBS™ have been thoroughly demonstrated, along with its usability [21]. The ALS-CBS™ indeed accounts for motor disabilities (i.e., dysarthria and upper limb deficits) and specifically targets FT functions (i.e., dysexecutive and frontal behavioral disorders) [40]. In particular, the ALS-CBS™ includes (1) a cognitive section, which assesses linguistically mediated/non-mediated executive functioning via motor-free tasks, as well as (2) a proxy report questionnaire covering the full range of FT behavioral changes. An Italian standardization has been recently provided [36].
Due to its brevity and minimal reliance on visual/ physical supports, the English ALS-CBS™ has been successfully adapted to be administered over the telephone (ALS-CBS™-Phone Version, ALS-CBS™-PhV) [14]. In Italy, telemedicine has been shown to be promising in the clinical management of MND patients since it circumvents logistical issues related to motor disabilities and unequal geographical coverage of healthcare services [8,38]. However, the full potential of diagnostic tele-neurology for MND patients has yet to be fully explored [5], especially with regard to neuropsychological evaluation.
Telephone-based neuropsychological assessment represents an evidence-based medium [9,18] to reach populations that have difficulties accessing in-person visits [10].
Given the above premises, this study aimed at (1) adapting the ALS-CBS™-PhV to the Italian language, (2) testing the psychometric and diagnostic properties of the cognitive section, and (3) deriving normative data from a representative Italian population sample.
The study was approved on behalf of the ethical committee of the University of Milano-Bicocca. Participants provided informed consent to participate in the study.

Participants
Three hundred fifty-nine healthy individuals were recruited from different regions of Italy (see Tables 1  and 2). Exclusion criteria were (1) history of neurological and/or major psychiatric diseases; (2) organ failures, non-compensated metabolic disorders, and severe internal conditions; and (3) uncorrected hearing deficits. Mild-tomoderate, corrected vision deficits were not addressed as an exclusion criterion.
In the telephone-based format, (1) Commands (1a) has been adapted to actions that can be performed by the patient and are audible by the examiner, and (2) the Eye Movements (1b) has been replaced with a motor-mediated task requiring the examinee to detect a verbal target among distractors. The original ranges have been maintained.
Items 1a and 1b were translated into Italian by a bilingual author and then back-translated to English by two other independent, bilingual, authors blinded to each other's translations. No major discrepancies were detected. Remaining items were derived from the original, back-translated Italian ALS-CBS™ [36].
The behavioral section of the ALS-CBS™-PhV mirrors its de visu format but is delivered verbally over the telephone; it comprises fifteen 3-point Likert items (range, 0-45) questioning caregivers on patients' behavioral changes (3 = "no change"; 0 = "large change") and 4 "yes/no" questions on anxiety and depression.
The Italian telephone-based Mini-Mental State Examination (Itel-MMSE) [29] and the Telephone Interview for Cognitive Status (TICS) [19] were also administered as convergent measures of global cognition. Their total score range is 0-22 and 0-41, respectively. Validity and reliability evidence for both tests have been previously provided for the Italian population [16,37].
The Italian ALS-CBS™-PhV will be provided upon request to the corresponding author (E. N. A.).

Procedures
Before test administration, a detailed sound-check from both the examiner and the examinee standpoint was carried out to ensure good quality on the call. The examiner also made sure that the examinee was able to carry out those actions required to perform the tasks (e.g., pressing a key on the telephone pad) by, otherwise, instructing her/him. A third person was required to secure that the administration setting was free of facilitating elements (e.g., a calendar/watch providing the examinee with suggestions for temporal orientation items), as well as to confirm the correctness of address information needed to assess spatial orientation.
Twenty-six participants (12 males, 14 females; age, 42.2 ± 17.9, 19-80; education, 12.3 ± 3.28, 5-16) were administered both the in-person and the telephone-based ALS-CBS™ at a 14-day interval to determine their comparability. To control for carry-over effects, the administration order was counterbalanced across participants (N = 13 being administered first the paper-and-pencil ALS-CBS™ and then the telephone format, N = 13, and vice versa).
A power analysis for multiple regressions was run through the R package pwr [12] accordingly to previous normative studies [36], yielding an a priori N of 347 as sufficient to achieve a 95% power (with α = .05, f 2 = .05 and df numerator = 3) [31].
Based on raw data distributing normally or not (the last scenario being indexed by skewness and kurtosis values ≥ |1| and |3|, respectively) [27], either parametric or non-parametric techniques were adopted to test associations of interest between continuous measures. Bonferroni corrections were applied when relevant.
Validity was assessed by convergence and at the structure level (principal component analysis). Reliability was assessed as internal consistency (Cronbach's α), test-retest, and inter-rater -both via intra-class correlation coefficients.
Accuracy was tested via receiver operating characteristics analyses by addressing performances below vs. above the 5th percentile of the sample on the Itel-MMSE and the TICS as proxy reference measures.
Equivalence between the telephone-based and the paperand-pencil in-person ALS-CBS™ was tested via a two one-sided test (TOST) procedure for paired-sample t tests [26], which allows determining whether the effect size of a between-mean difference is equivalent to zero.
By addressing global cognition as the latent trait, difficulty and discrimination were examined for each item by running a two-parameter, logistic item response theory model [3,22] via the R package mirt [11].
With respect to the Concentration subtest, normative values were computed for both the "working memory" (i.e., the span, ranging 0-5) and the "total" outcome (i.e., the number of correct sequences, ranging 0-8) -the former assessing working memory capacity, the latter being a measure of sustained attention during the execution of the task according to Pasotti et al. [30].

Results
Cognitive scores are summarized in Table 2.
Acceptability rate was 100%. No clear floor/ceiling effects were detected.
A mono-component structure underlying the four subtests was detected (46.65% of variance explained; .64 ≤ r ≤ .75), reflecting executive functioning efficiency. Item sensitivity and discriminative capability are reported in Table 3. Concentration and item overall showed mild-to-moderate difficulty; the most discriminative ones proved to be the last 6 items of backward digit span sequences (Concentration) and, to a lesser extent, the Alternation Task.
When tested against a performance below vs. above the 5th percentile on the Itel-MMSE and the TICS, the ALS-CBS™-PhV showed high accuracy Within multiple regression procedures, only transformed age and education proved to be simultaneous predictors of both ALS-CBS™-PhV total and subtest scores (age, |2.95|≤t≤|5.72|; p ≤ .005; education, |4.25|≤t≤|8.22|; p ≤ .001). Adjustment equations for ALS-CBS™-PhV total and subtest scores are reported in Table 4. A freely accessible, online applet for the automated computation of ASs based on age and education (https:// enaie llo. shiny apps. io/ ALSCB SPhV/) was implemented via the R package shiny [13]. Furthermore, an offline score-sheet will be made available upon request to the corresponding author (E. N. A.).

Discussion
The present work provides Italian practitioners with a standardized telephone-based screening tool for FT cognitive disorders among MND patients. The cognitive section of the ALS-CBS™-PhV demonstrated (1) good convergent validity with established telephone-based measures of global cognition; (2) statistical equivalence with its paper-and-pencil format; (3) a clear mono-component structure (i.e., executive functioning-related cognitive efficiency); (4) moderate-toexcellent internal, test-retest, and inter-rater reliability; and (5) good accuracy in discriminating high vs. low levels of cognitive efficiency. Statistically sound norms for the ALS-CBS™-PhV and its subtests are also provided -along with an open-source applet for the automated computation of regression-adjusted scores. Finally, item-level information has been herein enclosed to help practitioners interpret test scores [2].
To the best of the authors' knowledge, the present work is the first ever to fully standardize a telephone-based cognitive screening test in Italy, thus relevantly contributing to the growing evidence worldwide on the feasibility of teleneuropsychological assessment [18].
The same cut-offs for the in-person ALS-CBS™ version, provided by Tremolizzo et al. [36], should be used for the behavioral section of the ALS-CBS™-PhV, adapted to Italian; however, further investigations should be carried out for ensuring its feasibility over the telephone.
The availability of a brief, normed, statistically robust, MND-specific telephone-based screening for neuropsychological deficits allows for clear improvement in testing within both healthcare and research settings. From a clinical standpoint, the ALS-CBS™-PhV will help deliver I-level neuropsychological assessment to difficult-to-reach patients, as well as to monitor their cognitive status by overcoming logistical issues. Such an option is particularly important when for providing healthcare to vulnerable populations in the COVID-19 era; MND patients, indeed, often suffer from disease-related respiratory impairments. Additionally, underserved populations can benefit from large-scale, telephone-based neuropsychological screening [17], which can represent the early stage of a multi-phasic, population-based diagnostic process [15].
From an experimental standpoint, the ALS-CBS™-PhV may allow large-scale epidemiological studies on FT disorders in MND patients [23] and facilitate follow-ups in clinical trials [4], specifically when combined with the available, self-administered ALS Functional Rating Scale -Revised [28]. By assessing executive functioning, the ALS-CBS™-PhV can furthermore be feasible for testing patients with frontotemporal dementias or other motor diseases possibly presenting with a dysexecutive profile (e.g., extra-pyramidal disorders) -as shown for another MND-specific I-level neuropsychological tool, the Edinburgh Cognitive and Behavioral ALS Screen [20,32].
Moreover, by requiring minimal physical supports and not relying on visual elements, the ALS-CBS™-PhV can be adopted for bedside evaluations and the in-person assessment of patients with visual impairments.
Finally, it has to be noted that future studies are needed to test the clinical usability of the ALS-CBS™-PhV in both cross-sectional and longitudinal dimensions. With this respect, it should be borne in mind that the ALS-CBS™-PhV appears to be applicable only to patients with sufficiently spared hand movements and intelligible speech.
Future developments might also focus on the feasibility of a videoconference-based format of the ALS-CBS™, which could represent a valid alternative for patients who cannot/ are unwilling to undergo a telephone-based assessment [10].
Funding Open access funding provided by Università degli Studi di Milano -Bicocca within the CRUI-CARE Agreement.
Data availability Part of the data collected and analyzed within the present study are openly accessible at https:// osf. io/ k7f98/. Data regarding the Telephone Interview for Cognitive Status could not be made publicly accessible as being under the copyright of Giunti Psychometrics.

Declarations
Ethics approval and consent to participate This study received ethical approval. Participants provided informed consent. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http:// creat iveco mmons. org/ licen ses/ by/4. 0/.