Skip to main content

Functional Capacity Evaluation in Different Societal Contexts: Results of a Multicountry Study

A Correction to this article was published on 26 June 2018

This article has been updated

Abstract

Purpose To examine factors associated with Functional Capacity Evaluation (FCE) results in patients with painful musculoskeletal conditions, with focus on social factors across multiple countries. Methods International cross-sectional study was performed within care as usual. Simple and multiple multilevel linear regression analyses which considered measurement’s dependency within clinicians and country were conducted: FCE characteristics and biopsychosocial variables from patients and clinicians as independent variables; and FCE results (floor-to-waist lift, six-minute walk, and handgrip strength) as dependent variables. Results Data were collected for 372 patients, 54 clinicians, 18 facilities and 8 countries. Patients’ height and reported pain intensity were consistently associated with every FCE result. Patients’ sex, height, reported pain intensity, effort during FCE, social isolation, and disability, clinician’s observed physical effort, and whether FCE test was prematurely ended were associated with lift. Patient’s height, Body Mass Index, post-test heart-rate, reported pain intensity and effort during FCE, days off work, and whether FCE test was prematurely ended were associated with walk. Patient’s age, sex, height, affected body area, reported pain intensity and catastrophizing, and physical work demands were associated with handgrip. Final regression models explained 38‒65% of total variance. Clinician and country random effects composed 1–39% of total residual variance in these models. Conclusion Biopsychosocial factors were associated with every FCE result across multiple countries; specifically, patients’ height, reported pain intensity, clinician, and measurement country. Social factors, which had been under-researched, were consistently associated with FCE performances. Patients’ FCE results should be considered from a biopsychosocial perspective, including different social contexts.

Introduction

The use of functional capacity evaluations (FCEs) has become part of common clinical practice in several areas of occupational and rehabilitation medicine on patients with musculoskeletal diseases [1,2,3]. FCEs have been defined as: “An evaluation of capacity of activities that is used to make recommendations for participation in work while considering the person’s body functions and structures, environmental factors, personal factors and health status” [4]. Due to the influence these tests have on return-to-work, disability claims, compensation, and treatment planning decisions [5], a considerable amount of research has been conducted to determine the psychometric properties of various FCE protocols, especially construct validity and what factors influence FCE results [6,7,8].

Multiple factors including personal, health care, professional, legal, administrative, and cultural characteristics have been shown to influence work participation [9]. Due to the significant associations found between FCE results and physical, psychological, and social factors in healthy workers and in different patient groups [4, 10], a similar biopsychosocial explanatory model could be applied to FCE. However, to date, the majority of research on FCE has focused on physical and psychological factors, among which are sex, age, functional self-efficacy, and patients’ reported pain and disability [11,12,13].

Within the International Classification of Functioning disability and health (ICF) framework, social factors have been defined as “Factors that make up the physical, social and attitudinal environment in which people live and conduct their lives. These factors are external to individuals and can have a positive or negative influence on the individual’s performance as a member of society, on the individual’s capacity to execute actions or tasks, or on the individual’s body function or structure” [14]. Only a few studies have highlighted the relevance of social factors on FCE results [15]. International studies have shown differences in FCE results between individuals from different cultural groups within a country [16, 17] and between countries [18]. Furthermore, some studies suggest that functional capacity depends on the clinician’s level of fear-avoidance behavior and instructional strategy, as demonstrated in samples of healthy subjects and of patients, respectively [19, 20]. The evidence of these studies, although limited, suggests that FCE results vary between societal contexts. Additionally, the majority of the research on determinants of FCE performance has been performed on relatively small patient samples (n < 100 patients), making large multiple regression prediction models unstable. These studies have also come from a limited number of countries. Considering that countries differ in their insurance, compensation, and health system characteristics, the generalizability of such studies beyond those countries’ individual characteristics may be limited.

The present study was designed to further examine the determinants of FCE performance in patients from different societal contexts. The obtained knowledge may help better explain the underlying differences in FCE results and, in turn, allow better interpretation. More knowledge of a patient’s biopsychosocial context, including personal, health care, professional, legal, administrative, and cultural characteristics, and how it influences performance may lead to more effective and efficient delivery and interpretation of FCE services. Therefore, the aim of the current study was to examine what biopsychosocial factors are associated with FCE results in patients with painful musculoskeletal conditions, with a focus on social factors across multiple countries or societal contexts.

Methods

Design

A cross-sectional, observational study was performed within care as usual between September 2015 and April 2016. Ten participating countries joined the study: The Netherlands, Canada, Switzerland, Germany, Austria, South Africa, Australia, New Zealand, China, and the United States of America.

Procedure

Initially, the project team developed a study protocol. Next, participants for the study were recruited through snowball sampling. Contacts involved in FCE research from different countries were approached and asked to join the study as representatives of their countries. In addition to being in charge of the development of the study in their country and data collection as per protocol standards, the representatives were responsible for recruiting clinicians involved in FCE assessments from various facilities within their country. Participating clinicians assisted in the enrollment of patients undergoing FCE assessments. Informed consent was obtained from participating patients and clinicians. Participating clinicians were asked to complete a set of questionnaires prior to patient’s study enrollment. Participating patients were asked to complete additional questionnaires before performing FCE tests. Data from three FCE domains were collected: material handling (floor-to-waist lift), energetic capacity (six-minute walk test), and hand and finger strength (handgrip strength).

Approval to perform the study was obtained from the relevant research ethics board of the countries where data were collected. All procedures were in accordance with the ethical standards of the Helsinki Declaration of 1975 as revised in 2014 [21].

Participants and Societal Context

Patients

Patients who were to be tested with FCE and met the inclusion criteria were eligible to participate in the study. Inclusion criteria for patients were: adult patients over 18 years of age with non-specific sub-acute or chronic musculoskeletal pain, and with sufficient language skills to understand the instructions. Excluded were patients who were pregnant, retired, on permanent sick-leave, who had specific musculoskeletal diagnoses (i.e. fractures, tumors, radicular syndromes), or who had co-morbidities affecting performance or safety during FCE (i.e. cardiovascular conditions).

Clinicians

Because clinicians’ characteristics were considered a potentially relevant social variable that could influence FCE results, clinician data were collected. Clinicians who administered FCE in routine clinical practice and met the inclusion criteria were eligible to participate. Inclusion criteria for clinicians were: FCE-trained clinicians with at least 1 year of experience conducting FCE, more than 20 FCEs administered, and sufficient understanding of English to complete the compulsory questionnaires.

Societal Context

Participants were recruited from one or more facilities from each country. System or societal characteristics of the eight countries that participated in the study were collected and are presented in Online Resource 1.

The total sample was composed of patients from different contexts. Dutch sample was obtained from two outpatient rehabilitation centers referred by their company doctor for a multidisciplinary assessment. Canadian sample was obtained from one rehabilitation center, where individuals undergoing FCE were injured during motor vehicle accidents or were off work due to non-work related injuries. Patients were tested to determine disability related to previous employment (return-to-work) or activities of daily living (ADL), depending on whether the person was working prior to the injury. Swiss sample was obtained from three inpatient and outpatient rehabilitation centers. Inpatients were referred for a 3-week rehabilitation program, and underwent FCE for therapy planning and return-to-work assessment; whereas outpatients were referred by their disability insurance company to determine level of work related disability. German sample was recruited from six multi-professional work-related medical rehabilitation settings. These patients had musculoskeletal disorders and were performing FCE prior to admission to a 3-week rehabilitation program. Austrian sample was obtained from one rehabilitation center run by the AUVA (General Accident Insurance Institute). Patients were manual workers who had experienced an accident at work and were performing FCE for return-to-work assessment. South African sample was obtained from three facilities. One facility performed FCEs to determine work-related disability for insurance companies; whereas the others were a medico-legal practices where the FCE was done to assist in case settlements after road accidents. New Zealander sample was comprised of long-term claimants who had not returned to work after failure to respond to rehabilitation. Patients underwent FCEs for return-to-work assessments, therapy continuation assessments, or to determine disability. Chinese sample was obtained from one hospital in Hong Kong. Patients performed the FCE for return-to-work assessments and prior to participating in work hardening rehabilitation programs.

Measurements

FCE Variables

This study allowed for a variety of FCE protocols as long as they had demonstrated reliability on the lifting test in peer-reviewed articles. The compulsory FCE measurements included are discussed in detail below.

Floor-to-Waist Lift Test

The test characteristics described below are in accordance with the WorkWell protocol (former Isernhagen Work Systems) [6], the WEST-EPIC protocol [22] or the Blankenship protocol [23, 24]. These protocols differ in the type of material and the standardization of the instruction. The WorkWell protocol was operated as a progressive performance test, which began with an easily lifted weight that was gradually increased until the evaluator determined a “safe maximum lift” or until the patient stopped lifting. Patients were instructed to perform repetitive lifting series of a loaded box with as much weight as safely possible from a shelf at waist height to the floor, and back to the shelf. From the initial weight until the “safe maximum lift” weight, five lift repetitions were made with each weight. The safe lifting endpoint has been defined as the maximum load a patient could lift five times, while maintaining a stable spine and without exceeding the patient’s physiological limits [i.e. heart-rate (HR)]. The WEST-EPIC protocol was conducted as a progressive performance testing. The lift test was divided in cycles, which were composed of three subtests (knuckle-to-shoulder, floor-to-knuckle and floor-to-shoulder). These cycles were performed at two frequencies each before incrementing the weight, one lift per subtest and, if the patient was capable, four times. The lift test began with an empty standardized crate of 4.5 kg, which was gradually loaded with masked weights. Patients were blind to any load during the test. After each cycle they were asked whether they would be able to perform that task on a “safe and dependable manner eight to twelve times a day”. The “maximum acceptable load” was identified by observing the patient’s HR, posture and body mechanics, and psychophysical response. The Blankenship protocol was performed as a progressive lifting test. The lift test was used to determine how much weight the patient was able to lift at an occasional frequency (0–33% of the workday). The lift test began with an empty standardized crate of 4 kg, which was gradually loaded with weights to a maximum weight decided by the patient. Aspects of reliability and validity have been studied for all FCE protocols performed in this study [22, 23, 25, 26].

Clinicians recorded patient’s maximum weight lifted in kilograms along with HR before and after the test, patient-reported effort measured with Borg’s CR-10 scale [27], and clinician’s observed physical effort [28, 29]. In addition, the reason for ending the test was recorded [30].

Six-Minute Walk Test (6MWT)

The 6MWT was performed according to the recommendations of the American Thoracic Society [31]. The test was carried out on a flat hard surface, where two markers (i.e. tape, traffic cones) were set 30 m apart. Patients were instructed to walk back and forth between the two markers as much as possible at their own pace for 6 min. Running or jogging was not allowed; however, patients were able to stop and rest during the test. The 6MWT has shown acceptable test–retest and inter-rater reliability, criterion validity and acceptability in adults with chronic pain, fibromyalgia and chronic fatigue [32]. In addition to the distance walked in meters, patient’s HR before and after the test, patient-reported effort measured with Borg’s CR-10 scale [27], whether the test was prematurely stopped, and the reason for ending the test [30] was recorded.

Handgrip Strength Test

Grip strength measurements were taken with an adjustable-handle dynamometer. For standardization, Jamar dynamometer (or compatible device) was set in the second handle position. Following the procedure described by Mathiowetz et al. [33], patients were seated with their shoulder adducted and neutrally rotated, elbow flexed at 90°, forearm in neutral position, and wrist between 0° and 30° dorsiflexion and between 0° and 15° ulnar deviation. In that position, they were instructed to squeeze the dynamometer as hard as possible for three successive trials, left and right hand separately. The mean grip-strength of each hand was calculated and recorded in kilograms. The handgrip strength test has demonstrated acceptable reliability in healthy patients and patients with cervical radiculopathy [34].

Biopsychosocial Variables

Data from healthcare, workplace, legislative, and personal systems as well as clinician and patient characteristics were collected [35].

Patients’ Demographic Characteristics

Age; sex; height, weight, body mass index (BMI); affected body area, duration of pain; country whose social system applied to the patient; cultural background as measured by nationality; mother language; educational level; employment characteristics: job and physical work demands per Dictionary of Occupational Titles (DOT); work status; days off work due to pain; and compensation status.

Brief Psychological Screening

Eight self-reported screening questions for five psychosocial risk factors associated with pain [36]: depression, anxiety, social isolation, catastrophizing, and fear of movement. The response options were standardized in a 0 to 10 scale, where lower scores indicated lower risk. Moderate to high correlations with full-length questionnaires have been demonstrated for anxiety, depression, social isolation, catastrophizing, and fear of movement [36].

Disability (Pain Disability Index—PDI)

A 7-item self-reported questionnaire measuring the degree to which pain interferes with functioning across a range of activities: family/home responsibilities, recreation, social activity, occupation, sexual behavior, self-care, and life-support activity. The score for each item ranges from 0 (no interference) to 10 (total interference) and the total score can range from 0 to 70, where 70 indicates a total interference on life activities. The PDI has been shown to be a valid and reliable measure of pain-related disability, and shows sufficient internal consistency [37].

Pain Intensity (Numeric Rating Scale—NRS)

A self-reported scale to measure the current pain intensity in adults. The scale ranges from 0 (no pain) to 10 (worst possible pain). The reliability and validity of the NRS has been established for patients with rheumatic pain conditions [38].

Work Ability (Work Ability Score—WAS)

A single-item question of the Work Ability Index (WAI), which measures patients’ current work ability compared with their lifetime best. This item yields a score between 0 (unable to work) and 10 (work ability at its best). The WAS has been shown to be a good alternative to the full 28-item WAI [39].

Clinicians’ Demographic Characteristics

Age; sex; profession; workplace: facility, canton/province/state, country; clinical; and FCE experience.

Clinicians’ Pain Beliefs (Adapted Back Beliefs Questionnaire—BBQ)

A questionnaire measuring an individual’s beliefs about back trouble. For the purpose of this study, this questionnaire was adapted to measure clinicians’ beliefs about musculoskeletal pain, for which ‘back trouble’ was changed into ‘musculoskeletal pain’. The BBQ assesses the level of agreement for nine statements on a 5-point Likert scale (no agreement–total agreement). The total score can range from 9 to 45, where lower scores are related to more negative beliefs on pain. The original questionnaire has shown internal consistency and excellent reliability in workers in a manufacturing factory [40] as well as construct validity and test–retest reliability in the general population [41, 42].

FCE Characteristics

Purpose for undergoing FCE, whether results had a direct effect on the patient’s financial situation, type of protocol performed.

Data Analysis

Data records from all the participating countries were merged into a single database. Some variables were recoded for statistical purposes due to uneven variable distributions (pain duration and days off work were transformed into six categories and amount of compensation into five), and to form groups of similar characteristics (work status and affected body part were converted into new variables of six and five categories each).

The dataset was checked for missing data and outliers. If more than 5% of the cases missed information, the distribution of the missing values per variable was checked by comparing the results of the FCE tests of those with missing data to those without missing data. For continuous dependent variables, t tests or Mann–Whitney tests for independent samples were used. The relevance of the variables with statistically significant differences was further examined by comparing the medians of the two groups with boxplots. The influence of outliers (larger than three SD) was examined with Cook’s distance and leverage values.

Descriptive statistics were calculated for patients’, clinicians’, and FCE characteristics, and presented as means and standard deviations for continuous variables, and counts and percentages for categorical variables. In order to assess the explanatory value of biopsychosocial determinants for FCE results, while considering the nested design (participants within clinicians within countries), multilevel regression analyses were performed. The models were created with patients as level 1, clinicians as level 2, and measurement countries as level 3. These multilevel models involved biopsychosocial variables as independent variables and FCE test results as dependent variables.

The multilevel modeling with MLwiN software was conducted. MLwiN uses the Restricted Iterative Generalized Least-Squares (RIGLS) method to examine a model’s goodness of fit. To establish whether the addition of a variable was a significant improvement to the model’s fit, the most recent model’s deviance (− 2 * LogLikelihood) was compared to the previous model’s. The following process was applied:

  • First, 1-level and 3-level null models were built per dependent variable. To evaluate whether clinician and country had a significant effect on the dependent variables, 1-level null models were compared to 3-level null models (i.e. accounted for variance within clinicians and countries).

  • Second, biopsychosocial variables were separately added as fixed effects to the 3-level null model. To determine the association of each of these with FCE test results, the 3-level null model was compared to each biopsychosocial variable’s 3-level model.

  • Third, a selection of the variables to be entered into the multiple multilevel models was made. A minimum of ten measurements per variable is required for valid multiple regression models [43, 44]; therefore, the number of biopsychosocial variables included in the multiple multilevel regression models was limited. This selection of variables was made based on the statistical significance level from the simple multilevel models.

  • Fourth, a series of multiple multilevel models were performed with biopsychosocial variables entered in a stepwise-forward method. When building the multiple multilevel models, only the independent variables that significantly improved the model’s fit (p < 0.05) remained. The statistical significance of the final models was established at p < 0.05.

The reported results of the simple multilevel regression analyses were fixed effect’s explained variance (R2) and p value. R2 was calculated as \((\upsigma _{0}^{2} - \upsigma _{1}^{2})/(\upsigma _{0}^{2}),\) where \(\upsigma _{0}^{2}\)is the variance of the 3-level null model and \(\upsigma _{1}^{2}\)the variance of the 3-level model with the variable [45]. The reported results of the multiple multilevel regression analyses were fixed effect’s unstandardized coefficient and its standard error. Total variance explained by fixed effects was reported as a measure of the relevance of all fixed effects in the final models. To determine the total residual variance which was due to clinicians and countries, or, in other words, the correlation of the outcomes within clinicians and countries, the intraclass correlation (ICC) was calculated.

Diagnostic and descriptive analyses were performed using SPSS software version 22.0 (IBM Corp., NY) and multilevel regression analyses with MLwiN software version 2.35 (Centre for Multilevel Modelling, University of Bristol, UK).

Results

Characteristics of the Sample and Context

A total of 376 patients, 54 clinicians, 18 facilities and 8 different countries participated in the study. Of this sample, it was reported that three patients did not sign the informed consent form and one did not have any FCE measurement. These patients were excluded. Of the 372 patients, 261 had information on all 4 FCE measurements and 363 had either lift capacity and walk and/or handgrip strengths capacity results. In total 341 patients and all of the clinicians filled in all self-reported questionnaire items. Full datasets were therefore collected for 242 patients (64.4%).

Multicollinearity was checked before building the multiple multilevel regression models. It was found that cultural background as measured by nationality and/or mother language were also very strongly related to the measurement country in lift and handgrip strength tests. Therefore, these variables were not included in the final multiple multilevel regression models.

Patients’ biopsychosocial characteristics are shown in Table 1. Additionally, these biopsychosocial characteristics for each of the samples can be found in Online Resource 2.

Table 1 Biopsychosocial characteristics of the study population (n = 372); mean ± SD or n (%) are shown

Floor-to-Waist Lift Results

The simple multilevel regression analyses showed that 24 biopsychosocial variables were statistically significantly associated with floor-to-waist lifting performance (Online Resource 3). The final multilevel model included eight biological and psychological variables, these fixed effects explained 42.0% of total variance (Table 2). Altogether, greater weight lifted was associated with taller and male subjects, and with lower reported pain intensity, disability, effort during FCE test, and social isolation. Patients that performed to their maximum effort as observed by clinicians or who did not prematurely end the test lifted more weight. Clinician and country random effects composed approximately 39% of the total residual variance.

Table 2 Results from multiple multilevel regression analyses with FCE test performances as dependent variables are given; unstandardized regression coefficients and their standard errors (b(SE)), and model’s deviance (− 2 * LogLikelihood) by the addition of random and fixed effects are shown

Six-Minute Walk Results

The associations between 6MWT performance and 19 of the collected biopsychosocial variables were statistically significant (Online Resource 3). The final multilevel model included seven biopsychosocial variables, these fixed effects explained 64.6% of total variance (Table 2). Altogether, longer distances covered were related to participants that were taller, had lower BMI, higher post-test HR, and patients reporting lower pain intensity and effort during FCE test. Those that were out of work for 3 months and more, or ended the test prematurely showed lower walking performance. Clinician and country random effects composed approximately 1% of the total residual variance.

Handgrip Strengths Results

A total of 14 biopsychosocial variables were significantly associated with right handgrip strength test and 12 with left handgrip strength test. Both handgrip strength performances showed statistically significant associations with similar characteristics, differing only in the association of right handgrip performance with patient-reported anxiety and depression scores (Online Resource 3). The final models included seven biopsychosocial variables for right handgrip and five for left handgrip. These fixed effects of these models explained 38.6 and 39.8% of total variance, respectively (Table 2). Altogether, patients who were younger, taller, and male, with reported lower pain intensity and catastrophizing scores performed better on handgrip strength tests. Also, if they were not affected by upper or lower extremity, neck or generalized pain, or their work physical demands were light, heavy or very heavy, their handgrip strength was greater. Clinician and country random effects composed approximately 25% of the total residual variance for right handgrip, and 19% for left handgrip.

Discussion

This international cross-sectional study was performed to examine what biopsychosocial factors were associated with FCE results in patients with painful musculoskeletal conditions, with a focus on social factors across multiple countries. Patients’ sex, height, reported pain intensity, effort during FCE test, social isolation, and disability, clinician’s observed physical effort, and whether FCE test was prematurely ended were associated with lift test results. Patient’s height, BMI, post-test HR, their reported pain intensity and effort during FCE test, days off work, and whether FCE test was prematurely ended were associated with walk test results. Patient’s age, sex, height, affected body area, reported pain intensity and catastrophizing, and physical work demands were associated with handgrip test results. All these results were independently associated with FCE performance when considering dependency of measurements within clinician and country. Overall, biopsychosocial factors were consistently associated with performance on every FCE test, although factors differed between tests.

Compared to a previous study performed in three different countries [18], the present study included a larger number of countries spread worldwide to study the association of FCE tests with a comprehensive quantity of variables, including a variety of patients, clinicians, and settings, which makes our results unique. The data collected in eight participating countries has produced a large sample of patients with chronic musculoskeletal pain who differ in physical, personal and social characteristics, including system and FCE characteristics. This heterogeneity in sample characteristics reveals a more profound understanding of the reasons for the differences in FCE results.

The important finding in the current study is that biopsychosocial factors contributed significantly to the models. Literature on FCE shows evidence of biological and psychological factors’ association with FCE, while research on social factors is limited [46]. The influence of social and/or environmental factors within the occupational field on individual’s functioning and disability due to conditions such as low back pain has been stressed [47, 48]. This is supported in the present study where social factors were found to be related to all FCE tests. Specifically, all FCE tests were significantly related to the healthcare environment in which the measurements were taken. The clinician and the measurement country were both significantly associated with all FCE test results, the latter result being supported by previous research [18].

It is noteworthy to state that simple regression models showed that participant’s cultural background as measured by nationality and/or mother language were also significantly related to three of the tests (lift and handgrip strength tests). Although these variables were not included in the final regression models due to the risk of multicollinearity with the measurement country, their associations should not be overlooked. Such associations may relate differences in FCE performance to the cultural background of the patients, in agreement with previous research [16, 17].

Taking a closer look at the relationship between clinicians’ characteristics and FCE tests performance, it is seen that the clinician is significantly related, but clinician fear beliefs were not associated. Former studies on lift capacity as assessed by clinicians with different levels of fear-avoidance behavior showed differences in lifting performance in healthy young participants [19]. A plausible explanation for this difference may be that the current study was performed with patients with chronic musculoskeletal pain, and that the scores obtained with the pain beliefs questionnaire were similar across clinicians regardless of their professional experience (3.5–45 years). In contrast to the absence of influence of clinician’s psychological characteristics, the observed physical effort during lifting capacity remained in the final model. This further supports the importance of clinician’s observation as a way to determine patient’s effort levels, in accordance with a previous study that validated this tool [49].

Analogous to studies performed within a specific societal context, the present research has identified relevant associations of patient-reported psychological factors with FCE results. The information collected from patients has shown that pain intensity was associated with all FCE tests. Patient-reported disability and social isolation were associated with weight lifted; patient-reported effort was associated with both lifted weight and walked distance; while patient-reported catastrophizing was associated with right handgrip strength. Although previous research supports these findings, some variables expected to be associated with FCE results were missing in the final models. Patient-reported anxiety, depression, fear of movement, secondary gain or compensation, and disability were not associated with walk distance or handgrip strength, patient-reported catastrophizing was not associated with left handgrip strength, all of which are not consistent with previous systematic and literature reviews [46, 50], or opinions of scientists, clinicians, and patients [10]. This study does, therefore, provide a new perspective of the magnitude of the psychological factors associated with FCE tests.

A major strength of this study is the heterogeneity of patients’ social context characteristics. A plural sample such as the one created for this study with the large number of variables investigated, allows for greater external validity of the results. However, this added to complexity of variable measurement due to differences in legislation, policy and definitions across countries.

The study also has some limitations. First, due to the international nature of the study, English was not an official language for some participating countries. In those cases, liaisons were in charge of finding valid translations of the questionnaires or of translating them into one of the official languages of the country. These translations’ validity was not tested, and the extent to which this could produce bias is not known. Second, for the purpose of measuring clinician’s pain beliefs, BBQ was used. The questionnaire has been used and tested in the general population, including people with and without back pain and clinical students (nursing students) [41, 42]. Therefore, we believe that it is unlikely that the BBQ may have introduced bias to the results of this study. Additionally, such questionnaire was adapted in the wording, ‘back trouble’ was changed into ‘musculoskeletal pain’. Again, its validity was not tested but we assumed that no important bias was introduced through this minor change. Third, to ensure that the samples would be representative of the population undergoing FCE in each of the participating countries, more than one facility per country was asked to participate. However, we cannot be completely certain that our sample is generalizable to the participating countries. Fourth, some countries and facilities willing to participate experienced methodological, recruitment or time barriers, which led to their exclusion from the study. Nevertheless, from our point of view, the sample varies sufficiently as to allow the generalization of results. Fifth, only direct effects were tested on FCE test performances. Future research may use structural equation modeling to describe indirect effects and causal pathways. Finally, the categorization of biopsychosocial factors is not beyond debate. For the present study the division of bio-psycho-social factors was made within the ICF framework [51]. Nevertheless, readers can, based on the tables, report different choices. This would change the distribution of explained variance among the three types of factors, but not the explained variance of the full models.

Our findings bring some implications in the assessment of individuals undergoing FCEs. The large sample size, the heterogeneity of patients, and the plethora of measured factors, make this study unique and puts the results obtained so far into perspective. Many of the previously expected and studied associations of biopsychosocial factors with FCE within a certain societal context have been supported. However, other biopsychosocial factors as anxiety, depression, fear of movement, secondary gain or compensation, or clinician’s fear beliefs during lift test, have been shown to conflict with previous studies. Around 40% of the variance was explained in lift and handgrip models while for the walk model, it was 60%, thus, there is still a large proportion that remains unexplained. Additionally, the correlation among participants within clusters (within clinician and country) was between 18 and 39% in the lift and handgrip models and 1% in the walk model, but an explanation on the mechanism of such association is so far unknown. This further knowledge of the association of the context in which individuals perform FCEs and their results, supports the importance of the biopsychosocial framework. More evidence with a similar design as the current one is needed to disentangle nature of the associations of individuals’ context with the measurements, to identify the factors that remain unknown, and to allow for the generalization and for a more balanced interpretation of results, which in time will empower not only the FCE, but also other similar instruments.

Conclusion

Biopsychosocial factors were associated with performance on every FCE test across multiple countries; specifically patients’ height, reported pain intensity, clinician, and measurement country. Social factors, which had been under-researched, showed a consistent association with FCE performances. This supports the concept of considering patients from a biopsychosocial perspective in combination with different social contexts, and allows for the generalizability of the findings. Further research to replicate these results and to increase our understanding of the differences across the different societal contexts is needed.

Change history

  • 26 June 2018

    The original version of this article unfortunately contained a mistake in the Table 2. The data under column head “Left handgrip strength (n = 336)” was erroneously omitted during the production process. The corrected Table 2 is given below.

References

  1. Kool JP, Oesch PR, Bachmann S, Knuesel O, Dierkes JG, Russo M, et al. Increasing days at work using function-centered rehabilitation in nonacute nonspecific low back pain: a randomized controlled trial. Arch Phys Med Rehabil. 2005;86(5):857–864.

    PubMed  Google Scholar 

  2. Wind H, Gouttebarge V, Kuijer PPF, Sluiter JK, Frings-Dresen MH. Effect of functional capacity evaluation information on the judgment of physicians about physical work ability in the context of disability claims. Int Arch Occup Environ Health. 2009;82(9):1087–1096.

    PubMed  PubMed Central  Google Scholar 

  3. Bethge M, Herbold D, Trowitzsch L, Jacobi C. Work status and health-related quality of life following multimodal work hardening: a cluster randomised trial. J Back Musculoskelet Rehabil. 2011;24(3):161–172.

    CAS  PubMed  Google Scholar 

  4. Soer R, van der Schans CP, Groothoff JW, Geertzen JH, Reneman MF. Towards consensus in operational definitions in functional capacity evaluation: a Delphi Survey. J Occup Rehabil. 2008;18(4):389–400.

    PubMed  Google Scholar 

  5. Occupational Health Special Interest Group. Guidelines: occupational heatlh physical therapy: evaluating functional capacity BOD 10-08-0101. Orthop Phys Ther Pract. 2009;21(4):157–163.

    Google Scholar 

  6. Isernhagen SJ, Hart DL, Matheson LM. Reliability of independent observer judgments of level of lift effort in a kinesiophysical Functional Capacity Evaluation. Work. 1999;12(2):145–150.

    PubMed  Google Scholar 

  7. Gross DP, Battie MC. Reliability of safe maximum lifting determinations of a functional capacity evaluation. Phys Ther. 2002;82(4):364–371.

    PubMed  Google Scholar 

  8. Cheng AS, Cheng SW. The predictive validity of job-specific functional capacity evaluation on the employment status of patients with nonspecific low back pain. J Occup Environ Med. 2010;52(7):719–724.

    PubMed  Google Scholar 

  9. Loisel P, Durand MJ, Berthelette D, Vezina N, Baril R, Gagnon D, Lariviere C, Tremblay C. Disability prevention—new paradigm for the management of occupational back pain. Dis Manag Health Outcomes. 2001;9(7):351–360.

    Google Scholar 

  10. Lakke SE, Wittink H, Geertzen JH, van der Schans CP, Reneman MF. Factors that affect functional capacity in patients with musculoskeletal pain: a Delphi study among scientists, clinicians, and patients. Arch Phys Med Rehabil. 2012;93(3):446–457.

    PubMed  Google Scholar 

  11. Reneman MF, Geertzen JH, Groothoff JW, Brouwer S. General and specific self-efficacy reports of patients with chronic low back pain: are they related to performances in a functional capacity evaluation? J Occup Rehabil. 2008;18(2):183–189.

    PubMed  PubMed Central  Google Scholar 

  12. Gross DP, Battie MC. Factors influencing results of functional capacity evaluations in workers’ compensation claimants with low back pain. Phys Ther. 2005;85(4):315–322.

    PubMed  Google Scholar 

  13. Kaplan GM, Wurtele SK, Gillis D. Maximal effort during functional capacity evaluations: an examination of psychological factors. Arch Phys Med Rehabil. 1996;77(2):161–164.

    CAS  PubMed  Google Scholar 

  14. World Health Organization (WHO). ICF: International classification of functioning disability and health. Geneva: WHO; 2002.

    Google Scholar 

  15. Ansuategui Echeita J, van Holland BJ, Gross DP, Kool J, Oesch P, Trippolini MA, Reneman MF. Association between social factors and performance during Functional Capacity Evaluations: a systematic review. Disabil Rehabil. 2018. https://doi.org/10.1080/09638288.2018.1448120.

    Article  PubMed  Google Scholar 

  16. Owen TR, Wilkins MJ. Sincerity of effort differences in functional capacity evaluations. J Rehabil. 2014;80(3):53–61.

    Google Scholar 

  17. Trippolini MA, Dijkstra PU, Geertzen JH, Reneman MF. Construct validity of functional capacity evaluation in patients with whiplash-associated disorders. J Occup Rehabil. 2015;25(3):481–492.

    CAS  PubMed  Google Scholar 

  18. Reneman M, Kool J, Oesch P, Geertzen J, Battie M, Gross D. Material handling performance of patients with chronic low back pain during functional capacity evaluation: a comparison between three countries. Disabil Rehabil. 2006;28(18):1143–1149.

    CAS  PubMed  Google Scholar 

  19. Lakke SE, Soer R, Krijnen WP, van der Schans CP, Reneman MF, Geertzen JH. Influence of physical therapists’ kinesiophobic beliefs on lifting capacity in healthy adults. Phys Ther. 2015;95(9):1224–1233.

    PubMed  Google Scholar 

  20. Weir NA, Brown AW, Shlobin OA, Smith MA, Reffett T, Battle E, et al. The influence of alternative instruction on 6-min walk test distance. Chest. 2013;144(6):1900–1905.

    PubMed  Google Scholar 

  21. World Medical Association. World Medical Association Declaration of Helsinki. Ethical principles for medical research involving human subjects. JAMA. 2013;310(20):2191–2194.

    Google Scholar 

  22. Matheson LN, Mooney V, Grant JE, Affleck M, Hall H, Melles T, et al. A test to measure lift capacity of physically impaired adults. Part 1-development and reliability testing. Spine. 1995;20(19):2119–2129.

    CAS  PubMed  Google Scholar 

  23. Brubaker PN, Fearon FJ, Smith SM, McKibben RJ, Alday J, Andrews SS, et al. Sensitivity and specificity of the blankenship FCE system’s indicators of submaximal effort. J Orthop Sports Phys Ther. 2007;37(4):161–168.

    PubMed  Google Scholar 

  24. King PM, Tuckwell N, Barrett TE. A critical review of functional capacity evaluations. Phys Ther. 1998;78(8):852–866.

    CAS  PubMed  Google Scholar 

  25. Matheson LN. Relationships among age, body weight, resting heart rate, and performance in a new test of lift capacity. J Occup Rehabil. 1996;6(4):225–237.

    CAS  PubMed  Google Scholar 

  26. Innes E. Reliability and validity of functional capacity evaluations: an update. Int J Disabil Manag. 2006;1(01):135–148.

    Google Scholar 

  27. Borg G. Borg’s perceived exertion and pain scales. Champaign: Human kinetics; 1998.

    Google Scholar 

  28. Trippolini MA, Dijkstra PU, Jansen B, Oesch P, Geertzen JH, Reneman MF. Reliability of clinician rated physical effort determination during functional capacity evaluation in patients with chronic musculoskeletal pain. J Occup Rehabil. 2014;24(2):361–369.

    CAS  PubMed  Google Scholar 

  29. Isernhagen S, Hart D, Matheson L. Reliability of independent observer judgments of level of lift effort in a kinesiophysical Functional Capacity Evaluation. Work. 1999;12(2):145–150.

    PubMed  Google Scholar 

  30. Soer R, van der Schans CP, Geertzen JH, Groothoff JW, Brouwer S, Dijkstra PU, et al. Normative values for a functional capacity evaluation. Arch Phys Med Rehabil. 2009;90(10):1785–1794.

    PubMed  Google Scholar 

  31. ATS Committee on Proficiency Standards for Clinical Pulmonary Function Laboratories. ATS statement: guidelines for the six-minute walk test. Am J Respir Crit Care Med. 2002;166(1):111–117.

    Google Scholar 

  32. Ratter J, Radlinger L, Lucas C. Several submaximal exercise tests are reliable, valid and acceptable in people with chronic pain, fibromyalgia or chronic fatigue: a systematic review. J Physiother. 2014;60(3):144–150.

    PubMed  Google Scholar 

  33. Mathiowetz V, Kashman N, Volland G, Weber K, Dowe M, Rogers S. Grip and pinch strength: normative data for adults. Arch Phys Med Rehabil. 1985;66(2):69–74.

    CAS  PubMed  Google Scholar 

  34. Peolsson A, Hedlund R, Öberg B. Intra-and inter-tester reliability and reference values for hand strength. J Rehabil Med. 2001;33(1):36–41.

    CAS  PubMed  Google Scholar 

  35. Loisel P, Buchbinder R, Hazard R, Keller R, Scheel I, Van Tulder M, et al. Prevention of work disability due to musculoskeletal disorders: the challenge of implementing evidence. J Occup Rehabil. 2005;15(4):507–524.

    PubMed  Google Scholar 

  36. Kent P, Mirkhil S, Keating J, Buchbinder R, Manniche C, Albert HB. The concurrent validity of brief screening questions for anxiety, depression, social isolation, catastrophization, and fear of movement in people with low back pain. Clin J Pain. 2014;30(6):479–489.

    PubMed  Google Scholar 

  37. Tait RC, Chibnall JT, Krause S. The pain disability index: psychometric properties. Pain. 1990;40(2):171–182.

    CAS  PubMed  Google Scholar 

  38. Hawker GA, Mian S, Kendzerska T, French M. Measures of adult pain: visual analog scale for pain (vas pain), numeric rating scale for pain (nrs pain), mcgill pain questionnaire (mpq), short-form mcgill pain questionnaire (sf-mpq), chronic pain grade scale (cpgs), short form-36 bodily pain scale (sf-36 bps), and measure of intermittent and constant osteoarthritis pain (icoap). Arthritis Care Res. 2011;63(S11):S240–S252.

    Google Scholar 

  39. Ahlstrom L, Grimby-Ekman A, Hagberg M, Dellve L. The work ability index and single-item question: associations with sick leave, symptoms, and health—a prospective study of women on long-term sick leave. Scand J Work Environ Health. 2010;36(5):404–412.

    PubMed  Google Scholar 

  40. Symonds TL, Burton AK, Tillotson KM, Main CJ. Do attitudes and beliefs influence work loss due to low back trouble? Occup Med. 1996;46(1):25–32.

    CAS  Google Scholar 

  41. Gross DP, Russell AS, Ferrari R, Battié MC, Schopflocher D, Hu R, Waddell G, Buchbinder R. Evaluation of a Canadian back pain mass media campaign. Spine. 2010;35(8):906–913.

    PubMed  Google Scholar 

  42. Bostick GP, Schopflocher D, Gross DP. Validity evidence for the back beliefs questionnaire in the general population. Eur J Pain. 2013;17(7):1074–1081.

    CAS  PubMed  Google Scholar 

  43. Concato J, Peduzzi P, Holford TR, Feinstein AR. Importance of events per independent variable in proportional hazards analysis I. Background, goals, and general strategy. J Clin Epidemiol. 1995;48(12):1495–1501.

    CAS  PubMed  Google Scholar 

  44. Peduzzi P, Concato J, Feinstein AR, Holford TR. Importance of events per independent variable in proportional hazards regression analysis II. Accuracy and precision of regression estimates. J Clin Epidemiol. 1995;48(12):1503–1510.

    CAS  PubMed  Google Scholar 

  45. Snijders TAB, Bosker RJ. Multilevel analysis: an introduction to basic and advanced multilevel modeling. 2nd ed. Thousand Oaks: Sage; 2012.

    Google Scholar 

  46. Abbema R, Lakke S, Reneman M, Schans C, Haastert C, Geertzen J, et al. Factors associated with functional capacity test results in patients with non-specific chronic low back pain: a systematic review. J Occup Rehabil. 2011;21(4):455–473.

    PubMed  Google Scholar 

  47. Heerkens YF, de Brouwer CP, Engels JA, van der Gulden JW, Kant IJ. Elaboration of the contextual factors of the ICF for Occupational Health Care. Work. 2017;57(2):187–204.

    PubMed  Google Scholar 

  48. Bartys S, Fredriksen P, Bendix T, Burton K. System influences on work disability due to low back pain: an international evidence synthesis. Health Policy. 2017;121(8):903–912.

    PubMed  Google Scholar 

  49. Reneman MF, Fokkens AS, Dijkstra PU, Geertzen JH, Groothoff JW. Testing lifting capacity: validity of determining effort level by means of observation. Spine. 2005;30(2):E40–E46.

    PubMed  Google Scholar 

  50. Geisser ME, Robinson ME, Miller QL, Bade SM. Psychosocial factors and functional capacity evaluation among persons with chronic pain. J Occup Rehabil. 2003;13(4):259–276.

    PubMed  Google Scholar 

  51. Waddell G, Burton AK. Concepts of rehabilitation for the management of common health problems. London: The Stationery Office; 2004.

    Google Scholar 

Download references

Acknowledgements

Authors wish to thank A. R. den Otter for his advice and guidance on the development of the project, and the clinicians for performing FCEs and collecting data.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jone Ansuategui Echeita.

Ethics declarations

Conflict of interest

All authors declare that they have no conflict of interest.

Ethical Approval

Formal ethical approval to perform the study was obtained from the University of Alberta’s Health Research Ethics Board, Alberta (Canada); the Queen’s University Health Sciences & Affiliated Teaching Hospitals Research Ethics Board, Ontario (Canada); the Ethical Committee of St. Gallen (Switzerland); the Ethical Committee of the University of Lübeck (Germany); the Faculty of Health Sciences Research Ethics Committee of the University of Pretoria (South Africa); the Human Research Ethics Committee of the University of Newcastle (Australia); and the New Territories West Cluster Clinical and Research Ethics Committee (Hong Kong, China); the Physiotherapy Associates Institutional Review Board (United States of America). Because the study was performed within care as usual, a formal ethical approval was not required for the University Medical Center Groningen (The Netherlands); the Ethical Committee of Niederösterreich (Austria); and the ACC Research Ethics Committee (New Zealand).

Informed Consent

All procedures followed were in accordance with the ethical standards of the responsible research committees on human experimentation (institutional and national) and with the Helsinki Declaration of 1975, as revised in 2014 [21]. Informed consent was obtained from all patients for being included in the study.

Additional information

The original version of this article was revised: In Table 2, the results of left grip and right grip was corrected.

Electronic supplementary material

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Ansuategui Echeita, J., Bethge, M., van Holland, B.J. et al. Functional Capacity Evaluation in Different Societal Contexts: Results of a Multicountry Study. J Occup Rehabil 29, 222–236 (2019). https://doi.org/10.1007/s10926-018-9782-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10926-018-9782-x

Keywords

  • Internationality
  • Occupational health
  • Sociological factors
  • Lifting
  • Chronic pain