Abstract
Background
Verbal communication is the "gold standard" for assessing pain. Consequently, individuals with communication disorders are particularly vulnerable to incomplete pain management. This review aims at identifying the current pain assessment instruments for adult patients with communication disorders.
Methods
A systematic review with meta-analysis was conducted on PubMed, PEDRO, EBSCOhost, VHL and Cochrane databases from 2011 to 2023 using MeSH terms “pain assessment, “nonverbal communication” and “communication disorders” in conjunction with additional inclusion criteria: studies limited to humans, interventions involving adult patients, and empirical investigations.
Results
Fifty articles were included in the review. Seven studies report sufficient data to perform the meta-analysis. Observational scales are the most common instruments to evaluate pain in individuals with communication disorders followed by physiological measures and facial recognition systems. While most pain assessments rely on observational scales, current evidence does not strongly endorse one scale over others for clinical practice. However, specific observational scales appear to be particularly suitable for identifying pain during certain potentially painful procedures, such as suctioning and mobilization, in these populations. Additionally, specific observational scales appear to be well-suited for certain conditions, such as mechanically ventilated patients.
Conclusions
While observational scales dominate pain assessment, no universal tool exists for adults with communication disorders. Specific scales exhibit promise for distinct populations, yet the diverse landscape of tools hampers a one-size-fits-all solution. Crucially, further high-quality research, offering quantitative data like reliability findings, is needed to identify optimal tools for various contexts. Clinicians should be informed to select tools judiciously, recognizing the nuanced appropriateness of each in diverse clinical situations.
Trial registration
This systematic review is registered in PROSPERO (International prospective register of systematic reviews) with the ID: CRD42022323655.
Similar content being viewed by others
Introduction
Verbal communication is regarded as the "gold standard" for pain assessment [1], which is necessary for optimal management [2]. Since pain can be challenging to recognize by professionals, who frequently assess it based on their clinical impression, people with difficulties in verbal communication are particularly vulnerable to reduced or incomplete pain management [3,4,5,6]. Communication disorders affect people of all ages, although the prevalence and complexity of these conditions increase with age [7]. Thus, pain in people with communication difficulties due to dementia, intellectual disabilities or neurological conditions has been classically underestimated and, therefore, poorly treated [8, 9]. Moreover, many hospitalized people also experience temporary limitations in ability to communicate in situations such as recovering from anesthesia or being intubated [10].
Under-treated pain can result in both physical and psychological complications [11, 12]. However, evaluating pain in individuals with communication disorders is often viewed as a challenging and time-consuming task by healthcare professionals [13, 14]. Many of these professionals often report inadequate education and limited experience in dealing with patients in pain during their medical training, particularly in relation to vulnerable groups [14, 15]. Thus, a reliable and validated technique for pain evaluation in patients who are unable to self-report is urgently needed [16].
A multitude of observational tools is available to assess pain in this population, but there is not a clear consensus about the one to choose [11, 17]. Furthermore, these solutions are often considered to provide subjective, observer-dependent data [18,19,20], and some of these are only valid for a specific group of patients and context of care [21]. One way or another, there is an open debate about the usefulness of the non-verbal behaviors considered in these tools, as many of them can be non-specific or non-pain sensitive [17] or may determine secondary physiological indicators [18]. In order to address these issues, the clinical community is beginning to measure physiological signs that potentially can reflect pain, such as heart rate changes and heart rate variability, skin conductance and perfusion, changes in oxygen saturation, brain activity, pupil reactivity to light and expression of salivary metabolites, to cite a few [18, 22,23,24,25,26]. However, it needs to be pointed out that many of them are considered to lack sensitivity and specificity and cannot be used independently [27].
Taking all this into account, and due to the lack of evidence-based guidelines for pain assessment in the adult population [28], the main objective of this systematic review was to identify the different pain assessment methods currently used in adult patients with either permanent or temporary inability to communicate in any way. Specifically, we aimed at mapping and categorize existing instruments to evaluate pain in people with communication problems from which to commission primary research. Furthermore, the assessment of pain in people with communication problems was carried out through three constructs: pressure pain, suctioning pain and mobilization pain. These constructs could be included in the meta-analysis because they contained pre and post results or two comparison groups.
Material and methods
Design
A systematic mapping review with meta-analysis of pain assessment instruments in adult patients (≥18 years old) with communication disorders was performed. The PRISMA international standards were followed, as well as the Cochrane recommendations. This systematic review is registered in PROSPERO (International prospective register of systematic reviews) with the ID CRD42022323655.
Search strategy
The bibliographic search was conducted from January 2021 to August 2023 in the following databases: Pubmed, PEDRO, Virtual Health Library (VHL), Cochrane and EBSCOhost (includes the following databases: CINAHL®Complet, Psychology & Behavioral Sciences Collection, Academic Search Complete, APA PsycInfo, Abstracts in Social Gerontology, MLA International Bibliography, APA PsycArticles and E-Journals. The search formulation was based on DeCS/MeSH Descriptors and free terms using Boolean operators and, in some cases, truncation to obtain the maximum number of compatible results and prevent loss of information. The Boolean combination was: (Pain assessment) AND (communication disorder OR non verbal communication).
According to Price's Law and Cochrane recommendations, the search was limited to results in the English language, interventions involving adult patients, and a publication period from 2011 to 2021. A secondary review was conducted in August 2023, encompassing publications from 2021 to 2023 to identify any additional clinical trials published during the analysis period. Additionally, some of the previously used terms were recognized and utilized as MeSH terms by the PubMed search engine: pain, pain assessment, communication disorders, nonverbal communication. Finally, a targeted snowball search strategy was implemented to include relevant studies that, due to the chosen publication period or other criteria, did not initially align with the search strategy but still provided valuable information related to the review's objectives. All identified studies were imported into the Mendeley bibliographic manager (Elsevier, London, England) with the intention of removing any duplicate entries.
Selection criteria
The following inclusion criteria were followed in this systematic review: a) studies limited to humans; b) studies limited to patients over 18 years of age; c) studies limited to patients with an inability to self-report d) studies with control group or pre- and post- measurements that analyze or propose an assessment system that evaluates any behavioral (identifiable through observation) or physiological (identifiable through the measurement of any physiological parameter) responses related to a painful stimulus.
The exclusion criteria were a) No inability to self-report; b) No pain assessment models; c) Infant or neonate patients; d) Opinion pieces; e) Letters to the editor; f) Descriptive study protocols; g) Linguistic validations.
Data collection
Two researchers (AS-G and IR) independently performed the selection and critical reading. In case of disagreement, a third investigator (JM) was consulted.
The selection of articles proceeded through four phases:
-
1.
Identification: This phase involved searching different databases with subsequent elimination of duplicates.
-
2.
Screening: Articles were evaluated based on their titles.
-
3.
Selection: The eligibility of articles was assessed based on abstracts.
-
4.
Inclusion: Potentially eligible studies were selected based on a critical reading of the full text.
The results were compiled in an Excel datasheet that included: title, author/s, year of publication, country of publication, financing, article source, study design, recruitment, sample (with demographic and clinical data), follow-up, measures, interventions, risk of bias, conclusions, and limitations.
Finally, an Excel table was created to categorize the analytical papers for assessing the feasibility of the meta-analysis (MA). The analytical coding table included the following variables: study code, title, year, author, assessment instrument, construct, pre-measurement (mean and SD), post-measurement (mean and SD), and sample size. In instances where complete data for the pre-post measurements were not available, requests were made to the authors (n=5).
Assessment of risk of bias
The risks of bias of each study were assessed using the Cochrane Collaboration Tool as guidance [29]. This tool evaluates bias across seven specific domains: random sequence generation (selection bias), allocation concealment (selection bias), blinding of participants and personnel (performance bias), blinding of outcome assessment (detection bias), incomplete outcome data (attrition bias), selective reporting (reporting bias), and other bias. Each domain was categorized as "low risk," "high risk," or "moderate or uncertain risk." The overall risk was determined by weighing the risks observed in the various studies.
Analysis and synthesis
Qualitative synthesis
A qualitative analysis was conducted to assess the strength of the relationship between the variables and various pain assessment methods described in patients with communication disorders. This analysis allowed us to filter and interpret the data for the meta-analysis. Some studies were not included in the meta-analysis due to the heterogeneity of the data or the absence of relevant outcome measures. The methodological quality of all seven studies included in the meta-analysis was assessed using the Critical Appraisal Skills Program tool, Spanish version (CASPe) [30]. Studies that achieved a score of 7 or higher were considered of sufficient quality for inclusion in both the review and meta-analysis. Each study's level of evidence, as determined by the CASPe score, was further categorized by the Scottish Intercollegiate Guidelines Network (SIGN) [31], along with its corresponding degree of recommendation.
We also provide the reliability findings from the studies, reporting measures such as Cronbach's alpha, kappa, or ICC. In the case of ICC, the interpretations are as follows: ICC < 0.5 = poor reliability, ICC 0.5-0.75 = moderate reliability, ICC 0.75-0.9 = good reliability, ICC > 0.90 = excellent reliability [32].
Quantitative synthesis
When two or more outcome measures evaluated the same construct using similar instruments, the study was eligible for inclusion in a meta-analysis. The 'Meta-Essentials' Excel tool was used to conduct the meta-analysis [33]. Effect sizes were calculated by extracting pre-post sample sizes, means, and standard deviations (SD) from the selected studies. This was achieved by using the effect size or magnitude of the results, acknowledging the limitation that sometimes, even if the studies used the same construct, they might use similar but not identical scales. Dividing by a standard deviation allows studies that have applied different scales to measure the same construct or variable (e.g., measurement of pain) to express their results in a common metric (standard units). The quantification of results in a common metric is an essential requirement for applying subsequent statistical analysis techniques. Given the considerable diversity of scales and instruments used to measure the same variable in the phenomenon under study, the use of the standardized mean difference addresses the problem of heterogeneity in measurement instruments, enabling the statistical synthesis of the meta-analysis [34,35,36].
Despite the potential risk of introducing significant variability (heterogeneity), this approach was employed in an exploratory manner to offer additional insight into the overall landscape of current primary research and the prevailing state of measures used to assess pain in individuals with communication problems.
For continuous data, standardized mean differences (SMD) and 95% confidence intervals (CI) were calculated by dividing the mean of pre- and post- groups by the pooled SD. The SMD of the means proposed by Cohen in each study were weighted by the inverse of their variance to obtain the pooled index of the magnitude of the effect. Due to the heterogeneous nature of the selected studies, a random effects model was used. Finally, heterogeneity was evaluated using the inferential Q test proposed by Cochran, Pq test, Tau (T) square Tau \({T}^{2}\) and the \({I}^{2}\) hetero-geneity index with 95% CI. Heterogeneity was considered high or considerable when \({I}^{2}\) was >75% [37].
The asymmetries in the distribution of effect sizes, potentially resulting from publication bias or other forms of bias, were examined using two different approaches: Begg's strategy and Egger's test.
A sensitivity analysis was performed to test the influence of possible outliers and visualize the trends in the results. The thresholds for the interpretation of effect sizes were as follows: 0.1, small; 0.3, moderate; 0.5, large;0.7, very large; and 0.9, extremely large [33]. P < 0.05 was considered to indicate statistical significance.
It is important to note that for those studies that could not be incorporated into the meta-analysis due to either insufficient data or the utilization of different assessment instruments, solely a qualitative analysis was conducted (n=38).
Results
Search results
The comprehensive search was completed in August 2023, yielding a total of 345 studies, of which 253 remained after eliminating duplicates. Once the eligibility criteria were applied and the abstracts were reviewed, the number of studies was reduced to 76 for subsequent full-text reading. Finally, 50 studies were included in the systematic review. Among them, twenty-two (44%) were clinical trials and were further examined to determine if they were suitable for inclusion in a meta-analysis. The distribution of the remaining studies was as follows: n=12 (24%) observational/descriptive; n=8 (16%) systematic reviews; n=5 (10%) linguistic validation; n=1 (2%) psychometric validation; n=1 (2%) secondary data analysis; n=1 (2%) scale validation. Ultimately, 8 studies provided enough data to perform the meta-analysis. Figure 1 illustrates the flowchart of the review based on the PRISMA criteria [38].
Description of included studies
The sample of participants in the included studies consisted of 1,054,982 individuals. The mean age of the participants was 63.71 years (SD= 12.20). Among the 50 selected studies, it should be noted that only 2 had the presence of a control group (n=45), referring to a group of individuals who were assessed without receiving a painful stimuli/procedure. Table S1 (see Supplementary material, table S1) presents the main characteristics of the selected studies.
Of all the studies, 36% (n=18) were conducted in North America, 34% (n=17) were conducted in Europe, 16% (n=8) were conducted in Asia, 6% (n=3) were performed in Oceania and 2% (n=1) in South America. Regarding the development of the studies, 28% (n=14) were multicentric.
Regarding the pain assessment systems used in the studies included in this review, the vast majority used observational scales 80% (n=40). Besides, the 4% (n=2) of the studies used computerized facial recognition technologies (Electronic Pain Assessment Tool -ePAT) and 16% (n=8) employed the evaluation of different physiological parameters such as brain activity, cardiac activity, muscle activity, respiratory activity, sweating or conductance of the skin. Tables S2, S3 and S4 (see Supplementary material, tables S2-S4) provide detailed information about the different systems used to assess pain.
Classifying the studies by the characteristics of the patients, 29.54% (n=13) focused on elderly patients with dementia, 22.73% (n=10) on patients with mechanical ventilation, 12% (n=6) on patients with brain damage, 8% (n=4) on patients with cerebral palsy, 6% (n=3) on elderly patients with communication disorders,6% (n=3) on patients with intellectual disability, 6% (n=3) on critical patients, 6% (n=3) on patients with aphasia post-stroke, 2% (n=1) on cancer patients, 2% (n=1) on patients with acute pain, and 2% (n=1) on patients in a vegetative state/minimal consciousness.
Regarding the painful procedure assessed (factor), the review showed great heterogeneity. Most of the studies [24% (n=12)], assessed pain produced by mobilization or transfer of patients or by tracheal aspiration [20% (n=10)]. Further, the 16% (n =8) of the studies assessed pain due to a routine assessment, 16% (n=8) due to routine activities, 10% (n=5) due to painful pressure (pain produced by direct pressure on the skin with a pressure algometer) or by puncture 6% (n=3) (2 injections, 1 puncture with neuropen), 4% (n=2) due to movement (nonspecific), and 4% (n=2) due to walking among others.
Reliability findings
Out of all the selected studies utilizing observational scales, a total of 27 studies (67.5%) reported reliability results (detailed in the Supplementary material, table S5). Given the diversity in the types of scales employed across these studies, as well as the variations in the populations under assessment and the methods of reliability evaluation, we have categorized the studies to facilitate the synthesis and comparative analysis of their results (Table 1).
The methodological quality of all the 7 studies included in the meta-analysis according to CASPe and SIGN, is specified in table S6 (see Supplementary material, table S6 ).
Quantitative analysis
Three meta-analyses were performed among 7 studies. Specifically, variables such as Pressure pain, (pain produced by a direct pressure on the skin with a pressure algometer) (Table 2), Suctioning Pain (pain produced by a tracheal suctioning) (Table 3) and Mobilization Pain (pain produced by a postural change or transference) (Table 4) were analyzed quantitatively. Pressure pain was assessed with PCSLACII and NCS (Nociception Coma Scale); Suctioning pain was assessed with ESCID, BPS and CPOT; and Mobilization pain was assessed with ESCID and BPS.
The effect size has been moderate or large in the studies included in the meta-analysis. We highlight the effect size of López-López C et. al., 2018 of -0.4 (moderate) and of Al Darwish ZQ, et. al., 2016 of 0.67 (large). The rest has a small effect between 0.1 and 0.3
The effect size findings reveal that a large number of comparisons fall into the small and moderate magnitude category, which can generate errors in the interpretation of the results based on the p value of the different studies and therefore, take your conclusions with caution.
The results showed low heterogeneity in all the analyzed variables (\({I}^{2}\)= 0% for all variables) and there were no statistically significant changes on the outcomes of the different assessment tools between pre-pain and post-pain assessments [(p >0.05); Pressure (\({I}^{2}\)= 0%; Z=0.82; p=0.207), suctioning (\({I}^{2}\)= 0%; Z=-1.42; p=0.079), mobilization (\({I}^{2}\)= 0%; Z=-1.49 p=0.069)]. Thus, despite the to the lack of significance and the absence of heterogeneity, the meta-analysis cannot conclude the usefulness of any of the scales under study to statistically differentiate pre- and-post pain using the cited variables.
Risk of bias assessment
High risk of bias was found in 15 studies: Lautenbacher et al [40], López-López et al [41], Benromano et al (a&b) [24, 25], Al Darwish et al [26], Le et al [42], Linde et al [43], Rahu et al [44], Chatelle et al [45], Meir et al [46], Jeitziner et al [47], Vázquez et al [48], Arbour et al [49], Thé et al [50] and Poulsen et al [51] ; unclear risk of bias was found in 6 studies: Atee et al [52], Rahu et al [53], Roulin et al [54], Shinde et al [55], Latorre-Marco et al [56] and Chanques et al [57]. Only one study had a low risk of bias (Soares et al., 2018) [58]. According to the ROBINS-I tool (Risk Of Bias tool to assess Non-randomized Studies of Interventions), the areas that were most likely to increase the risk of bias were random sequence generation and blinding of participants and personnel, while bias due to selective reporting of result as had the lowest risk (Fig. 2).
Discussion
Our review revealed a wide array of pain assessment tools designed for non-communicative patients, ranging from physiological variables to observational scales. Among these tools, observational scales are the most commonly employed instruments for evaluating pain in individuals with communication disorders. The diversity of methods poses a challenge in designating a single scale as the gold standard for pain assessment in adults with communication disorders. Nevertheless, specific observational scales appear to be particularly suitable for identifying pain during certain potentially painful procedures, such as suctioning and mobilization, in these populations. Additionally, specific observational scales appear to be well-suited for particular conditions, notably in the case of mechanically ventilated patients.
Evidence underscores the importance of using observational tools since relying solely on self-reports is inadequate for assessing pain in patients with communicative disorders [59]. Our study revealed a wide variety of studies employing different scales, often with small sample sizes and a high risk of bias. This diversity hinders a comprehensive and reliable analysis, resulting in a low level of confidence according to this systematic review and analytical study. Indeed, the meta-analysis showed low results when examining pain changes before and after three painful procedures.
Nonetheless, our meta-analyses identified consistent trends in the effectiveness of specific scales used in pain assessments during certain procedures, such as mobilization and aspiration. These procedures should be monitored for pain in these vulnerable populations. While these findings may not be universally applicable, they do suggest promising avenues for further research.
Other tools that employ a combination of specific facial codes and common pain behaviors [60] have demonstrated favorable reliability properties [61]. Nonetheless, to the best of our knowledge, there are no studies concerning the correlation of their scores with those obtained from other assessment tools. In addition, this systematic review has unveiled a range of physiological measures, reflecting efforts to utilize objective markers for pain evaluation. However, even in environments with readily available access to these instruments, such as ICUs, the use of observational scales remains more prevalent [13, 62,63,64]. While this review did not yield sufficient data to assess their reliability properties, these measures may emerge as an alternative or complement to behavioral scales. They warrant further consideration in future studies to ensure a multidimensional approach to pain assessment [27].
This review has several limitations. The use of effect size in similar but not identical instruments introduces an important element of variability in the meta-analysis that can compromise heterogeneity even if analyzing the same construct. This is not an exclusive difficulty of meta-analysis, since the wide variety of characteristics inherent to the study subjects makes it necessary to design a uniform protocol, carry out a rigorous process of subject selection and perform a careful analysis of the influence on the results of extreme cases. Moreover, this aspect has been seen in previous systematic reviews, which also concluded that no single scale could be universally recommended [65, 66]. Furthermore, not being able to report all the confidence intervals before the absence of data provided by the authors, of the included studies, represents a reproducibility bias of the meta-analysis. This means that it is not possible to fully determine the impact of the findings.
In conclusion, the predominant method of pain assessment in adults with communication disorders involves the use of observational scales, with certain scales demonstrating promising psychometric properties for specific populations. Nevertheless, the existing diversity in assessment tools and study designs prevents the selection of a universally suitable scale for evaluating pain across all adults with communication disorders.
Current evidence does not strongly favor one scale over others for clinical practice. To enhance their recommendation in clinical guidelines, further research with more rigorous study designs is imperative. In this regard, we acknowledge the existence of at least two major groups [67, 68] that are conducting psychometric tests on items from various observational scales and analyzing those items that best predict clinicians' evaluations of pain intensity, in order to provide tools with high reliability and validity, such as the Pain Intensity Measure for Persons with Dementia and the Pain Assessment in Impaired Cognition (PAIC-15 scale).
It is advisable to carry out studies of diagnostic accuracy (STARD) and prognosis (REMARK) to, based on this review, establish the instruments that offer the most sensitivity and specificity.
Moreover, there is a need for exploration of alternative instruments that can complement the information provided by behavioral scales, including facial recognition systems or physiological signals. Such exploration can help mitigate the observer-dependent, subjective nature of observational assessment systems.
Availability of data and materials
The datasets generated and/or analysed during the current study are available from the corresponding author on reasonable request.
References
Fox MA, Ayyangar R, Parten R, Haapala HJ, Schilling SG, Kalpakjian CZ. Self-report of pain in young people and adults with spastic cerebral palsy: interrater reliability of the revised face, legs, activity, cry, and consolability (r-FLACC) scale ratings. Dev Med Child Neurol. 2019;61(1):69–74. https://doi.org/10.1111/dmcn.13980. (Epub 2018 Jul 27 PMID: 30051908).
von Baeyer CL, Spagrud LJ. Systematic review of observational (behavioral) measures of pain for children and adolescents aged 3 to 18 years. Pain. 2007;127(1–2):140–50. https://doi.org/10.1016/j.pain.2006.08.014. (Epub 2006 Sep 25 PMID: 16996689).
McKinnon C, White J, Morgan P, Harvey A, Clancy C, Fahey M, Antolovich G. Clinician perspectives of chronic pain management in children and adolescents with cerebral palsy and dyskinesia. Phys Occup Ther Pediatr. 2021;41(3):244–58. https://doi.org/10.1080/01942638.2020.1847236. (Epub 2020 Nov 29 PMID: 33251932).
New perspectives on the definition of pain. Pain. 1996;67(1):3–6. https://doi.org/10.1016/0304-3959(96)03135-1. (PMID: 8895225).
Ostojic K, Paget S, Kyriagis M, Morrow A. Acute and chronic pain in children and adolescents with cerebral palsy: prevalence, interference, and management. Arch Phys Med Rehabil. 2020;101(2):213–9. https://doi.org/10.1016/j.apmr.2019.08.475. (Epub 2019 Sep 12 PMID: 31521713).
Penner M, Xie WY, Binepal N, Switzer L, Fehlings D. Characteristics of pain in children and youth with cerebral palsy. Pediatrics. 2013;132(2):e407–13. https://doi.org/10.1542/peds.2013-0224. (Epub 2013 Jul 15 PMID: 23858420).
Yorkston KM, Bourgeois MS, Baylor CR. Communication and aging. Phys Med Rehabil Clin N Am. 2010;21(2):309–19. https://doi.org/10.1016/j.pmr.2009.12.011. PMID:20494279;PMCID:PMC3074568.
Bernal-Celestino RJ, León-Martín A, Martín-López MM, Ruiz-García J, Muñoz-Romera S, Lozano-Diaz AI. Evaluating and handling the pain of people with intellectual disability. Pain Manag Nurs. 2022;23(3):311–7. https://doi.org/10.1016/j.pmn.2021.08.005. (Epub 2021 Sep 4 PMID: 34493439).
Morrison RS, Siu AL. A comparison of pain and its treatment in advanced dementia and cognitively intact patients with hip fracture. J Pain Symptom Manage. 2000;19(4):240–8. https://doi.org/10.1016/s0885-3924(00)00113-5. (PMID: 10799790).
Vincent JL. Communication in the ICU. Intensive Care Med. 1997;23(10):1093–8. https://doi.org/10.1007/s001340050462. (PMID: 9407247).
Inelmen EM, Mosele M, Sergi G, Toffanello ED, Coin A, Manzato E. Chronic pain in the elderly with advanced dementia. Are we doing our best for their suffering? Aging Clin Exp Res. 2012;24(3):207–12. https://doi.org/10.3275/8020. Epub 2011 Oct 3. PMID: 21969056.
Jang SE, Bradshaw YS, Carr DB. Comparison of the impacts of under-treated pain and opioid pain medication on cognitive impairment. Cureus. 2022;14(2):e22037. https://doi.org/10.7759/cureus.22037. PMID:35155054;PMCID:PMC8824639.
Gélinas C. Pain assessment in the critically ill adult: recent evidence and new trends. Intensive Crit Care Nurs. 2016;34:1–11. https://doi.org/10.1016/j.iccn.2016.03.001. (Epub 2016 Apr 5 PMID: 27067745).
Krupić F, Bišćević M, Spahić E, Jašarević A, Jašarević M, Grbić K, Hamrin-Senorski E, Svantesson E, Čustović S, Westin O. Experience of nurses in assessing postoperative pain in hip fracture patients suffering from dementia in nursing homes. Med Glas (Zenica). 2020;17(1):216–23. https://doi.org/10.17392/1042-20. (PMID: 31663321).
Lechowicz K, Karolak I, Drożdżal S, Żukowski M, Szylińska A, Białecka M, Rotter I, Kotfis K. Acute and Chronic pain learning and teaching in medical school-an observational cross-sectional study regarding preparation and self-confidence of clinical and pre-clinical medical students. Medicina (Kaunas). 2019;55(9):533. https://doi.org/10.3390/medicina55090533. PMID:31454932;PMCID:PMC6780207.
Gutysz-Wojnicka A, Ozga D, Mayzner-Zawadzka E, Dyk D, Majewski M, Doboszyńska A. Psychometric assessment of physiologic and behavioral pain indicators in polish versions of the pain assessment scales. Pain Manag Nurs. 2019;20(3):292–301. https://doi.org/10.1016/j.pmn.2018.07.006. (Epub 2018 Sep 27 PMID: 30269914).
Kappesser J, Voit S, Lautenbacher S, Hermann C. Pain assessment for cognitively impaired older adults: do items of available observer tools reflect pain-specific responses? Eur J Pain. 2020;24(4):851–62. https://doi.org/10.1002/ejp.1536. (Epub 2020 Feb 11 PMID: 31981281).
Klarer N, Rickenbacher H, Kasser S, Depoorter A, Wellmann S. Electrophysiological measurement of noxious-evoked brain activity in neonates using a flat-tip probe coupled to electroencephalography. J Vis Exp. 2017;129:56531. https://doi.org/10.3791/56531. PMID:29286456;PMCID:PMC5755512.
Nerella S, Cupka J, Ruppert M, Tighe P, Bihorac A, Rashidi P. Pain Action Unit Detection in Critically Ill Patients. Proc COMPSAC. 2021;2021:645–51. https://doi.org/10.1109/compsac51774.2021.00094. Epub 2021 Sep 9. PMID: 34723289; PMCID: PMC8552410.
Roué JM, Morag I, Haddad WM, Gholami B, Anand KJS. Using sensor-fusion and machine-learning algorithms to assess acute pain in non-verbal infants: a study protocol. BMJ Open. 2021;11(1):e039292. https://doi.org/10.1136/bmjopen-2020-039292. PMID:33408199;PMCID:PMC7789448.
Payen JF, Gélinas C. Measuring pain in non-verbal critically ill patients: which pain instrument? Crit Care. 2014;18(5):554. https://doi.org/10.1186/s13054-014-0554-5. PMID:25429706;PMCID:PMC4281924.
Martínez-Ricarte F, Castro A, Poca MA, Sahuquillo J, Expósito L, Arribas M, Aparicio J. Basic principles and their application in the non-invasive monitoring of neurocritical patients. Neurologia. 2013;28(1):41–51. https://doi.org/10.1016/j.nrl.2010.07.028. Epub 2010 Nov 11. PMID: 21163229.
Rich-Ruiz M, Moreno-Casbas MT, Ramírez-Expósito MJ, Martínez-Martos JM, Carrera-González MDP. Correlation between Biomarkers of Pain in Saliva and PAINAD Scale in Elderly People with Cognitive Impairment and Inability to Communicate. J Clin Med. 2021;10:1424. https://doi.org/10.3390/jcm1007142.
Benromano T, Pick CG, Granovsky Y, Defrin R. [a] Increased evoked potentials and behavioral indices in response to pain among individuals with intellectual disability. Pain Med. 2017;18(9):1715–30. https://doi.org/10.1093/pm/pnw349. (PMID: 28339959).
Benromano T, Pick CG, Merick J, Defrin R. [b] Physiological and behavioral responses to calibrated noxious stimuli among individuals with cerebral palsy and intellectual disability. Pain Med. 2017;18(3):441–53. https://doi.org/10.1093/pm/pnw155. (PMID: 27473634).
Al Darwish ZQ, Hamdi R, Fallatah S. Evaluation of pain assessment tools in patients receiving mechanical ventilation. AACN Adv Crit Care. 2016;27(2):162–72. https://doi.org/10.4037/aacnacc2016287. PMID: 27153305.
Raeside L. Physiological measures of assessing infant pain: a literature review. Br J Nurs. 2011;20(21):1370–6. https://doi.org/10.12968/bjon.2011.20.21.1370. PMID: 22241428.
Jersak T, Noritz G. Evaluation of pain in adults with childhood-onset disabilities and communication difficulties. Front Neurol. 2021;5(12) PMID:34675866;PMCID:PMC8523837.
Higgins JP, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, Savovic J, Schulz KF, Weeks L, Sterne JA. Cochrane Bias Methods Group; Cochrane Statistical Methods Group. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928 PMID: 22008217; PMCID: PMC3196245.
Olmo RS. Programa de habilidades en lectura crítica español (CASPe). NefroPlus. 2017;9(1):100–1.
Miller J. The Scottish intercollegiate guidelines network (SIGN). The British Journal of Diabetes & Vascular Disease. 2002;2(1):47–9.
Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155–63. https://doi.org/10.1016/j.jcm.2016.02.012. Epub 2016 Mar 31. Erratum in: J Chiropr Med. 2017 Dec;16(4):346. PMID: 27330520; PMCID: PMC4913118.
van Rhee, H., Suurmond, R., & Hak, T. User manual for meta-essentials: Workbooks for meta-analysis. SSRN Electronic Journal, 2018, (February), 1–49. https://doi.org/10.2139/ssrn.3241355
Grissom, R. J., & Kim, J. J. Effect sizes for research: Univariate and multivariate applications. (2012). Routledge.
Hedges, L. V. Distribution theory for Glass's estimator of effect size and related estimators. journal of Educational Statistics, (1981). 6(2), 107-128
Sánchez-Meca, J. Revisiones sistemáticas y meta-análisis en Educación: un tutoríal [Systematic reviews and meta-analysis in Education: a tutorial]. RiiTE. 2022: 5-40. Doi: https://doi.org/10.6018/riite.545451
Garritty C, Gartlehner G, Nussbaumer-Streit B, King VJ, Hamel C, Kamel C, Affengruber L, Stevens A. Cochrane rapid reviews methods group offers evidence-informed guidance to conduct rapid reviews. J Clin Epidemiol. 2021;130:13–22. https://doi.org/10.1016/j.jclinepi.2020.10.007. Epub 2020 Oct 15. PMID: 33068715; PMCID: PMC7557165.
Moher D, Liberati A, Tetzlaff J, Altman DG. PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097 Epub 2009 Jul 21. PMID: 19621072; PMCID: PMC2707599.
Neville C, Ostini R. A psychometric evaluation of three pain rating scales for people with moderate to severe dementia. Pain Manag Nurs. 2014;15(4):798–806. https://doi.org/10.1016/j.pmn.2013.08.001.
Lautenbacher S, Walz AL, Kunz M. Using observational facial descriptors to infer pain in persons with and without dementia. BMC Geriatr. 2018;18(1):88. https://doi.org/10.1186/s12877-018-0773-8. PMID:29642850;PMCID:PMC5896123.
López-López C, Pérez-Pérez T, Beneit-Montesinos JV, García-Klepzig JL, Martinez-Ureta MV, Murillo-Pérez MDA, Torrente-Vela SA, García-Iglesias M. Pain assessment in mechanically ventilated, noncommunicative severe trauma patients. J Trauma Nurs. 2018;25(1):49–59. https://doi.org/10.1097/JTN.0000000000000342. PMID: 29319652.
Le Q, Gélinas C, Arbour C, Rodrigue N. Description of behaviors in nonverbal critically ill patients with a traumatic brain injury when exposed to common procedures in the intensive care unit: a pilot study. Pain Manag Nurs. 2013;14(4):e251–61. https://doi.org/10.1016/j.pmn.2012.02.005. (Epub 2012 Mar 30 PMID: 24315278).
Linde SM, Badger JM, Machan JT, Beaudry J, Brucker A, Martin K, Opaluch-Bushy NB, Navedo Roy RD. Reevaluation of the critical-care pain observation tool in intubated adults after cardiac surgery. Am J Crit Care. 2013;22(6):491–7. https://doi.org/10.4037/ajcc2013700. (PMID: 24186820).
Rahu MA, Grap MJ, Cohn JF, Munro CL, Lyon DE, Sessler CN. Facial expression as an indicator of pain in critically ill intubated adults during endotracheal suctioning. Am J Crit Care. 2013;22(5):412–22. https://doi.org/10.4037/ajcc2013705. PMID:23996421;PMCID:PMC3913066.
Chatelle C, Majerus S, Whyte J, Laureys S, Schnakers C. A sensitive scale to assess nociceptive pain in patients with disorders of consciousness. J Neurol Neurosurg Psychiatry. 2012;83(12):1233–7. https://doi.org/10.1136/jnnp-2012-302987. (Epub 2012 Aug 20 PMID: 22906615).
Meir L, Strand LI, Alice K. A model for pain behavior in individuals with intellectual and developmental disabilities. Res Dev Disabil. 2012;33(6):1984–9. https://doi.org/10.1016/j.ridd.2012.05.028. Epub 2012 Jun 28. PMID: 22750353.
Jeitziner MM, Schwendimann R, Hamers JP, Rohrer O, Hantikainen V, Jakob SM. Assessment of pain in sedated and mechanically ventilated patients: an observational study. Acta Anaesthesiol Scand. 2012;56(5):645–54. https://doi.org/10.1111/j.1399-6576.2012.02660.x. (Epub 2012 Mar 7 PMID: 22404146).
Vázquez M, Pardavila MI, Lucia M, Aguado Y, Margall MÁ, Asiain MC. Pain assessment in turning procedures for patients with invasive mechanical ventilation. Nurs Crit Care. 2011;16(4):178–85. https://doi.org/10.1111/j.1478-5153.2011.00436.x. PMID: 21651658.
Arbour C, Gélinas C, Loiselle CG, Bourgault P. An exploratory study of the bilateral bispectral index for pain detection in traumatic-brain-injured patients with altered level of consciousness. J Neurosci Nurs. 2015;47(3):166–77. https://doi.org/10.1097/JNN.0000000000000137. (PMID: 25943998).
Thé KB, Gazoni FM, Cherpak GL, Lorenzet IC, Santos LA, Nardes EM, Santos FC. Pain assessment in elderly with dementia: Brazilian validation of the PACSLAC scale. Einstein (Sao Paulo). 2016;14(2):152–7. https://doi.org/10.1590/S1679-45082016AO3628. PMID: 27462888; PMCID: PMC4943348.
Poulsen I, Brix P, Andersen S, Westergaard L, Guldager R. Pain assessment scale for patients with disorders of consciousness: a preliminary validation study. J Neurosci Nurs. 2016;48(3):124–31. https://doi.org/10.1097/JNN.0000000000000206. (PMID: 27045289).
Atee M, Hoti K, Parsons R, Hughes JD. Pain assessment in dementia: evaluation of a point-of-care technological solution. J Alzheimers Dis. 2017;60(1):137–50. https://doi.org/10.3233/JAD-170375. PMID:28800333;PMCID:PMC5611807.
Rahu MA, Grap MJ, Ferguson P, Joseph P, Sherman S, Elswick RK Jr. Validity and sensitivity of 6 pain scales in critically ill, intubated adults. Am J Crit Care. 2015;24(6):514–23. https://doi.org/10.4037/ajcc2015832. (PMID: 26523009).
Roulin MJ, Ramelet AS. Generating and selecting pain indicators for brain-injured critical care patients. Pain Manag Nurs. 2015;16(3):221–32. https://doi.org/10.1016/j.pmn.2014.06.003. (Epub 2014 Nov 1 PMID: 25439115).
Shinde SK, Danov S, Chen CC, Clary J, Harper V, Bodfish JW, Symons FJ. Convergent validity evidence for the Pain and Discomfort Scale (PADS) for pain assessment among adults with intellectual disability. Clin J Pain. 2014;30(6):536–43. https://doi.org/10.1097/AJP.0000000000000020. PMID:24135902;PMCID:PMC3989463.
Latorre-Marco I, Acevedo-Nuevo M, Solís-Muñoz M, Hernández-Sánchez L, López-López C, Sánchez-Sánchez MM, Wojtysiak-Wojcicka M, de Las Pozas-Abril J, Robleda-Font G, Frade-Mera MJ, De Blas-García R, Górgolas-Ortiz C, De la Figuera-Bayón J, Cavia-García C. Psychometric validation of the behavioral indicators of pain scale for the assessment of pain in mechanically ventilated and unable to self-report critical care patients. Med Intensiva. 2016;40(8):463–73. https://doi.org/10.1016/j.medin.2016.06.004.
Chanques G, Pohlman A, Kress JP, Molinari N, de Jong A, Jaber S, Hall JB. Psychometric comparison of three behavioural scales for the assessment of pain in critically ill patients unable to self-report. Crit Care. 2014;18(5):R160. https://doi.org/10.1186/cc14000. PMID:25063269;PMCID:PMC4220092.
Soares CD, Panuganti PK, Shrivastava A, Aroor S, Keinath KM, Bromagen MC, Howard ME, Carlson C, Smith JH. Experimental pain assessment in patients with poststroke aphasia. Neurology. 2018;91(9):e793–9. https://doi.org/10.1212/WNL.0000000000006081.
Malara A, De Biase GA, Bettarini F, Ceravolo F, Di Cello S, Garo M, Praino F, Settembrini V, Sgrò G, Spadea F, Rispoli V. Pain assessment in elderly with behavioral and psychological symptoms of dementia. J Alzheimers Dis. 2016;50(4):1217–25. https://doi.org/10.3233/JAD-150808.PMID:26757042;PMCID:PMC4927851.
Atee M, Hoti K, Hughes JD. A technical note on the PainChek™ System: a web portal and mobile medical device for assessing pain in people with dementia. Front Aging Neurosci. 2018;12(10):117. https://doi.org/10.3389/fnagi.2018.00117. PMID:29946251;PMCID:PMC6006917.
Atee M, Hoti K, Parsons R, Hughes JD. A novel pain assessment tool incorporating automated facial analysis: interrater reliability in advanced dementia. Clin Interv Aging. 2018;16(13):1245–58. https://doi.org/10.2147/CIA.S168024. PMID:30038491;PMCID:PMC6052926.
Gélinas C, Joffe AM, Szumita PM, Payen JF, Bérubé M, Shahiri TS, Boitor M, Chanques G, Puntillo KA. A psychometric analysis update of behavioral pain assessment tools for noncommunicative, critically ill adults. AACN Adv Crit Care. 2019;30(4):365–87. https://doi.org/10.4037/aacnacc2019952. (PMID: 31951666).
Ayasrah SM. Pain among non-verbal critically Ill mechanically ventilated patients: Prevalence, correlates and predictors. J Crit Care. 2019;49:14–20. https://doi.org/10.1016/j.jcrc.2018.10.002. (Epub 2018 Oct 13 PMID: 30339991).
Kotfis K, Zegan-Barańska M, Szydłowski Ł, Żukowski M, Ely EW. Methods of pain assessment in adult intensive care unit patients - Polish version of the CPOT (Critical Care Pain Observation Tool) and BPS (Behavioral Pain Scale). Anaesthesiol Intensive Ther. 2017;49(1):66–72. https://doi.org/10.5603/AIT.2017.0010. (PMID: 28362033).
Kim YS, Park JM, Moon YS, Han SH. Assessment of pain in the elderly: a literature review. Natl Med J India. 2017;30(4):203–7. https://doi.org/10.4103/0970-258X.218673. PMID: 29162753.
Lichtner V, Dowding D, Esterhuizen P, Closs SJ, Long AF, Corbett A, Briggs M. Pain assessment for people with dementia: a systematic review of systematic reviews of pain assessment tools. BMC Geriatr. 2014;17(14):138. https://doi.org/10.1186/1471-2318-14-138. PMID:25519741;PMCID:PMC4289543.
Ersek M, Herr K, Hilgeman MM, Neradilek MB, Polissar N, Cook KF, Nash P, Snow AL, McDarby M, Nelson FX. Developing a pain intensity measure for persons with dementia: initial construction and testing. Pain Med. 2019;20(6):1078–92. https://doi.org/10.1093/pm/pny180. PMID:30285252;PMCID:PMC9513703.
Kunz M, de Waal MWM, Achterberg WP, et al. The Pain Assessment in Impaired Cognition scale (PAIC15): a multidisciplinary and international approach to develop and test a meta-tool for pain assessment in impaired cognition, especially dementia. Eur J Pain. 2020;24(1):192–208. https://doi.org/10.1002/ejp.1477.
de Vries NJ, van der Steen JT, Achterberg WP, Smaling HJA. Measuring pain in aphasia: validity and reliability of the PACSLAC-D. Pain Manag Nurs. 2023;24(4):e68–74. https://doi.org/10.1016/j.pmn.2023.03.010.
Haghi M, Fadayevatan R, Alizadeh-Khoei M, Kaboudi B, Foroughan M, Mahdavi B. Validation of Pain Assessment Checklist for Seniors with Limited Ability to Communicate-II (PACSLAC-II) in Iranian older adults with dementia living in nursing homes. Psychogeriatrics. 2020;20(3):278–87. https://doi.org/10.1111/psyg.12496.
Morrison RA, Jesdale BM, Dubé CE, et al. Differences in staff-assessed pain behaviors among newly admitted nursing home residents by level of cognitive impairment. Dement Geriatr Cogn Disord. 2020;49(3):243–51. https://doi.org/10.1159/000508096.
Muñoz-Narbona L, Cabrera-Jaime S, Lluch-Canut T, et al. Validation of the Spanish Version of the Pain Assessment in Advanced Dementia Scale (PAINAD-Sp) in hospitalized patients with neurologic disorders and oncologic patients unable to self-report their pain. Pain Manag Nurs. 2019;20(4):323–30. https://doi.org/10.1016/j.pmn.2018.08.004.
Riquelme I, Pades Jiménez A, Montoya P. Parents and physiotherapists recognition of non-verbal communication of pain in individuals with cerebral palsy. Health Commun. 2018;33(12):1448–53. https://doi.org/10.1080/10410236.2017.1358243.
Pickering G, Monacelli F, Pérez-Castejón Garrote JM, et al. Reliability study in five languages of the translation of the pain observational scale algoplus. Pain Med. 2018;19(2):252–61. https://doi.org/10.1093/pm/pnw356.
Moon Y, Kim YS, Lee J, Han SH. Validity of the Korean version of the face, legs, activity, cry, and consolability scale for assessment of pain in dementia patients. J Korean Med Sci. 2017;32(11):1852–6. https://doi.org/10.3346/jkms.2017.32.11.1852.
Gregersen M, Melin AS, Nygaard IS, Nielsen CH, Beedholm-Ebsen M. Reliability of the danish abbey pain scale in severely demented and non-communicative older patients. Int J Palliat Nurs. 2016;22(10):482–8. https://doi.org/10.12968/ijpn.2016.22.10.482.
Ford B, Snow AL, Herr K, Tripp-Reimer T. Ethnic differences in nonverbal pain behaviors observed in older adults with dementia. Pain Manag Nurs. 2015;16(5):692–700. https://doi.org/10.1016/j.pmn.2015.03.003.
Apinis C, Tousignant M, Arcand M, Tousignant-Laflamme Y. Can adding a standardized observational tool to interdisciplinary evaluation enhance the detection of pain in older adults with cognitive impairments? Pain Med. 2014;15(1):32–41. https://doi.org/10.1111/pme.12297.
Chan S, Hadjistavropoulos T, Williams J, Lints-Martindale A. Evidence-based development and initial validation of the pain assessment checklist for seniors with limited ability to communicate-II (PACSLAC-II). Clin J Pain. 2014;30(9):816–24. https://doi.org/10.1097/AJP.0000000000000039.
Takai Y, Yamamoto-Mitani N, Suzuki M, Furuta Y, Sato A, Fujimaki Y. Developing and validating a Japanese version of the assessment of pain in elderly people with communication impairment. Arch Gerontol Geriatr. 2013;57(3):403–10. https://doi.org/10.1016/j.archger.2013.06.002.
Pickering ME, Bunna P, Rat P, et al. Acute pain evaluation with Algoplus scale in Cambodian patients. Pain Med. 2013;14(12):1971–6. https://doi.org/10.1111/pme.12174.
Paulson-Conger M, Leske J, Maidl C, Hanson A, Dziadulewicz L. Comparison of two pain assessment tools in nonverbal critical care patients. Pain Manag Nurs. 2011;12(4):218–24. https://doi.org/10.1016/j.pmn.2010.05.008.
Sheu E, Versloot J, Nader R, Kerr D, Craig KD. Pain in the elderly: validity of facial expression components of observational measures. Clin J Pain. 2011;27(7):593–601. https://doi.org/10.1097/AJP.0b013e31820f52e1.
Gélinas C, Arbour C, Michaud C, Vaillant F, Desjardins S. Implementation of the critical-care pain observation tool on pain assessment/management nursing practices in an intensive care unit with nonverbal critically ill adults: a before and after study. Int J Nurs Stud. 2011;48(12):1495–504. https://doi.org/10.1016/j.ijnurstu.2011.03.012.
Acknowledgements
The authors thank Mónica Vázquez Clatayud, Zainab Aldarwish and Ruth Defrin for providing us with unpublished data from their studies to perform this meta-analysis.
Funding
This research was funded by MCIN/AEI/10.13039/501100011033, Spain, grant PID2020-114967GA-I00.
Author information
Authors and Affiliations
Contributions
A.S.: Formal analysis, Conceptualization, Investigation, Data Curation, Writing - Original Draft, Visualization. J.M.: Methodology, Validation, Formal analysis, Writing - Review & Editing, Supervision. P.M.: Writing - Review & Editing, Data Curation, Supervision. I.R.: Conceptualization, Writing - Review & Editing, Project administration.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1:
Table S1. Description of selected studies [69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84]. Table S2. Population, pain observational scales and painful procedure of the included studies. Table S3. Facial recognition measures, population and painful procedure of the included studies. Table S4. Physiological measures, population and painful procedure of the included studies. Table S5. Reliability findings of pain observational scales included in the systematic review. Table S6. Methodological quality of the studies included in the meta-analysis.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Sabater-Gárriz, Á., Molina-Mula, J., Montoya, P. et al. Pain assessment tools in adults with communication disorders: systematic review and meta-analysis. BMC Neurol 24, 66 (2024). https://doi.org/10.1186/s12883-024-03539-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12883-024-03539-w