Abstract
Purpose Sensibility refers to a tool’s comprehensiveness, understandability, relevance, feasibility, and length. It is used in the early development phase to begin assessing a new tool or intervention. This study examined the sensibility of the job demands and accommodation planning tool (JDAPT). The JDAPT identifies job demands related to physical, cognitive, interpersonal, and working conditions to better target strategies for workplace supports and accommodations aimed at assisting individuals with chronic health conditions. Methods Workers with a chronic health condition and workplace representatives were recruited from health charities, workplaces, and newsletters using convenience sampling. Cognitive interviews assessed the JDAPT’s sensibility. A 70% endorsement rate was the minimum level of acceptability for sensibility concepts. A short screening tool also was administered, and answers compared to the complete JDAPT. Results Participants were 46 workers and 23 organizational representatives (n = 69). Endorsements highly exceeded the 70% cut-off for understandability, relevance, and length. Congruence between screening questions and the complete JDAPT suggested both workers and organizational representatives overlooked job demands when completing the screener. Participants provided additional examples and three new items to improve comprehensiveness. The JDAPT was rated highly relevant and useful, although not always easy to complete for someone with an episodic condition. Conclusions This study highlights the need for tools that facilitate accommodations for workers with episodic disabilities and provides early evidence for the sensibility of the JDAPT.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Avoid common mistakes on your manuscript.
Introduction
Increasing numbers of people living with chronic health conditions are employed [1, 2]. New treatments and health care procedures have enabled individuals who were previously unable to work because of their health to find, sustain, or return to work (RTW) [3,4,5,6,7], while technological improvements, including more opportunities for remote working, can help to make employment more accessible for people living with chronic health conditions [8]. Frequently, the activity limitations experienced by people working with chronic conditions are episodic. That is, workers with a chronic condition report experiencing periods of wellness with no job limitations (i.e., no disability) punctuated by periods of more severe symptoms that contribute to an intermittent disability at work [9,10,11,12]. Examples of chronic conditions associated with episodic disability include mental health conditions like depression and anxiety, Crohn’s disease, colitis, multiple sclerosis, migraine, rheumatic diseases like arthritis and lupus, chronic fatigue syndrome, and many musculoskeletal conditions (e.g., low back pain, tendinopathies). Extended life expectancies for individuals living with conditions like HIV/AIDS and some types of cancer have meant that these conditions also are associated with episodic disabilities at work. Although different in their etiology, many conditions causing episodic disability have similar impacts on employment, with individuals finding it challenging to meet the demands of their job.
In addition to their episodic nature, the signs and symptoms of many chronic conditions are often “invisible” to others until a person experiences an episode or flare or chooses to disclose the condition. That is, others are often unaware that an individual is living with a chronic condition that can cause an episodic disability [10,11,12,13,14,15]. The episodic and invisible nature of many chronic health conditions can create challenges for workers in seeking and obtaining workplace support because of the uncertainty about whether to disclose their condition and, if disclosed, because of uncertainty about what type of information to share in the workplace. Disclosing personal health information may result in greater support, but there may be accompanying stigma and concerns about one’s future career [12, 15,16,17,18,19,20,21,22,23,24,25,26,27]. Not sharing information may protect a worker from stigma but may mean delays in receiving support until there is a crisis, fewer support options, and misinterpretations of workplace behaviours as reflecting a lack of motivation, skills, or as a negative interpersonal style [12, 14, 20, 28,29,30]. Moreover, research finds that reports of unmet accommodation needs are associated with greater workplace activity limitations, more job disruptions (arriving late/leaving early), and perceived productivity losses [6, 7, 10, 31,32,33,34,35,36].
Job Demands and Accommodation Planning Tool (JDAPT)
Several measures and tools have been developed to address the complexity of disclosure decisions and provision of workplace support [37,38,39,40,41,42,43]. Legislation in many industrialized countries also provides regulations and protections to prevent discrimination and to promote the full participation in employment of people living with disabilities [44,45,46,47]. The legislation is often rooted in fundamental values of equality and diversity, which are increasingly being tackled by global bodies and individual workplaces [48]. For example, in Canada, laws protect personal health information and require that organizations make reasonable accommodations for workers living with disabilities [47, 49]. Workplaces are encouraged to focus on social and environmental barriers that can make employment difficult and not on medical diagnoses and symptoms. A variety of research tools exist to measure perceptions of work, including job demands and the psychosocial work environment. For example, the Work Ability Index is often used in clinical occupational health and workplace surveys to estimate current work ability, a workers health status and the potential need for future resources [50, 51]. Other research tools like the Job Content Questionnaire (JCQ) and the Copenhagen Psychosocial Questionnaire (COPSOQ) have been extensively used to assess a workers perceptions of their work environment [52, 53]. However, existing research tools do not help a worker think through the intermittent or ongoing challenges of their various job demands or provide strategies for self-management, informal and formal support relevant to each demand. A recent scan of publicly available self-help resources and supports found that many existing resources were disease-specific and focused largely on management of condition symptoms [43]. Resources often did not provide material focused on diverse job demands, and most were not interactive but provided general pros and cons related to decision making with limited information about informal and formal supports and accommodations [43].
To address these gaps, we created the JDAPT. The purpose of the JDAPT is to help a worker, or an organizational representative like a supervisor, identify key job demands at a broad level without having to discuss health diagnostic or symptom information. Respondents input information pertinent to their own or another’s job demands and indicate whether health issues create challenges in meeting job demands on an intermittent or ongoing basis. They are then provided with ideas for informal and formal self-management and supports tailored to the areas where they report difficulties. The JDAPT is intended to be flexible and relevant to a wide variety of health conditions, job types, and workplace contexts. It is broader than functional workplace assessments that focus primarily on the physical working demands of a job (e.g., repetition, load and time spent on tasks like standing and lifting) or cognitive demands assessments (e.g., memory, problem solving, executive functioning in tasks like concentration) by measuring job demands across four domains—the physical demands of a job, cognitive demands, interpersonal demands, and working conditions—which are then linked to examples of self management, support, and accommodations.
As a first step to evaluating the JDAPT, we wanted to assess the “sensibility” of the job demands questions. “Sensibility” is a term originally used by Feinstein [54] to highlight the necessity for new measures and tools in their early development phase to demonstrate fundamental attributes like comprehensiveness, understandability, relevance, and feasibility. Similar approaches have been emphasized in health care studies when examining the clinical utility, practicality, or applicability of a tool [55,56,57,58], as well as in research discussing content validity [59,60,61]. Essential to the process is a method that provides opportunities for the individuals who will ultimately use the measure or tool to provide their perspectives on whether the concepts and questions are meaningful to them and whether there are gaps and omissions in the tool. Irrespective of assessing the psychometric qualities and robustness of a tool, if it does not meet the needs of workers with chronic conditions, or if it is impractical to apply, it is unlikely to be the optimal choice for use in the workplace. The objective of this study was to test the sensibility of the JDAPT across a variety of chronic health conditions and job types and sectors as part of initial development testing. We assessed two versions of the JDAPT, one for workers and one for workplace representatives (e.g., supervisors, HR personnel, disability managers) who provide support to workers living with chronic conditions giving rise to episodic disabilities. We focused on the JDAPT’s comprehensiveness, understandability, relevance, feasibility, and length.
Methods
Participants
Study participants were workers living with diverse chronic health conditions, as well as organizational representatives, all of whom were recruited using convenience sampling. Recruitment took place from September 2019 to May 2020. We contacted Canadian health charities serving individuals living with physical or mental health conditions, workplace contacts established through the Institute for Work & Health, where the project is based, the research project website, and newsletters. Recruitment material informed potential worker participants that we were interested in interviewing individuals “currently employed and living with a chronic physical or mental health condition that can sometimes make working difficult.” Potential organizational representatives like supervisors, human resources professionals and disability managers were told we were interested in interviewing individuals “with experience supporting employees with chronic physical or mental health conditions.” Some materials stemming from health charities noted specific health conditions (e.g., multiple sclerosis, Crohn’s disease). Interested individuals contacted the study team by email or telephone. Eligible participants were employed, lived with a chronic physical or mental health condition causing an episodic disability (worker participants) or had workplace experience supporting workers with chronic conditions causing episodic disability (organizational participants). Participants were ≥ 18 years of age and able to complete an English-language interview. The research team worked to recruit a diverse sample in terms of gender, age, ethnic diversity, and occupational type (e.g., including non-office work). Participants received an honorarium of CAD $75.00. Informed consent was obtained from all participants. Ethics approval was received from the University of Toronto Research Ethics Board (#37970).
Measure: Job Demands and Accommodation Planning Tool
The JDAPT identifies broad areas of work related to physical, cognitive, interpersonal (i.e., working with others) and working conditions where self-management, informal supports or formal accommodations may be useful in managing difficulties with job tasks, and where a worker might be able to avail themselves of supports without having to disclose a health diagnosis or disability type. Two versions of the JDAPT were developed: an employee version for someone with a chronic condition causing an episodic disability to complete, and an organizational version, for someone supporting an employee. The latter version could be completed by the organizational representative on their own or with the worker. The two user-versions were identical except for small changes in the instructions and in the framing of the questions (e.g., “your job” and “my health” in the employee version were replaced with “this employee’s job” and “their health” in the organizational version).
Prior to filling out the complete JDAPT questionnaire, a short number of screening questions were developed to potentially decrease the number of items completed as part of the full JDAPT. The screening questions would allow respondents to skip an entire domain of the JDAPT (e.g., physical demands) if the respondent reported that the domain was not relevant to their job, if they were not having any difficulties with the domain, or if they were not interested in learning more about supports relevant to the domain. Examples of job demands were provided for each screening domain that were similar to those for the specific job demands asked in the complete JDAPT. For the purposes of the current study, all participants completed both the screening questions and the complete JDAPT questionnaire regardless of their responses to the screening questions. This allowed us to examine concordance in the perceived relevance of JDAPT domains assessed through the screening questions with the complete assessment using the full JDAPT.
The complete JDAPT comprised 21 job demands (see Appendix A). Four items asked about the physical aspects of a job (e.g., working with your hands, physical endurance or stamina); six items asked about cognitive or “thinking” aspects of a job (e.g., paying attention to detail, concentrating for long periods of time, managing time pressures); four items asked about interpersonal demands or working with others (e.g., supervising others, dealing with distressed or angry people); and seven items asked about working conditions (e.g., working with hazardous equipment or situations, isolated work, changing schedules or shifts, working in situations where making an error has critical consequences). Multiple examples were provided to illustrate each job demand, and that considered different types of jobs and industrial sectors. Participants were first asked whether a particular job demand was important to their job. If they indicated that it was not an important part of their job, they moved to the next job demand. If an individual indicated that a job demand was important to their work, they were asked about their ability to meet the job demand (no difficulty, some difficulty, a lot of difficulty/unable to do) and whether their difficulty was stable or variable (no change over time, sometimes changes depending on their health, changes a lot because of their health). An opportunity to add additional job demands was provided after each of the four domains. Upon completion of the JDAPT, participants would normally be given a personalized report and ideas for a range of self management and work-related support and accommodation strategies that are tailored to each specific job demand. Because this study focused on examining the JDAPT questions themselves, participants did not receive a summary or support/accommodation ideas and strategies.
Procedure and Sensibility Assessment:
Although the JDAPT was designed to be an online tool, for the purposes of sensibility testing, all participants were provided with a paper workbook which contained the screening questionnaire and job demands questions. Participants were interviewed face-to-face or by telephone. An in-depth cognitive interview was developed [58, 62,63,64,65]. As part of the interview, workers living with a chronic condition causing an episodic disability were asked to complete the questions for their current health and job demands. Organizational representatives were asked to think about a particular experience with a worker and complete the JDAPT with that person in mind.
Participants were asked to first complete the screening questions. The interviewer recorded the time to complete the items. After completing the screening questions, respondents were asked questions about its understandability, relevance, and feasibility. Table 1 provides an overview of the concepts assessed. Participants then filled out the complete JDAPT. Similar to the screening questionnaire, the interviewer recorded the time to finish the questions. This was followed by an in-depth cognitive interview that assessed overall comprehensiveness, understandability, feasibility, relevance, and perceived length, as well as questions about each item in the JDAPT and the examples and concepts addressed (i.e., importance, ability/difficulty, change over time) (see Table 1). Questions were answered as Yes/No (e.g., Was this question easy to understand? Were the examples helpful? Is there a need for a tool like the JDAPT?). Each question was followed with an open-ended response option for the respondent to explain their answer and provide details. The interviews took about 60–90 min to complete. They were conducted between October 2019 to April 2020, with most conducted before the first COVID-19 lockdown in Canada.
Analyses and Performance Criteria
Frequencies for each question were compiled. There exist few performance guidelines for sensibility assessments [58,59,60]. However, similar to other research, we adopted a 70% participant endorsement rate as the minimum level of acceptability for each of the sensibility concepts [58] with a higher percentage reflecting greater perceived comprehensiveness, understandability, relevance, feasibility, and acceptance of the length of the questionnaire. Open-ended responses were content analyzed for major themes by two authors (JB & ST) [66]. Participant suggestions for new examples and items were collected and reviewed by MAMG, JB, and ST prior to discussion with the research team. The concordance of the screening responses with the full JDAPT questionnaire also was examined. We focused on respondents’ assessments of their global ability/difficulty for each of the four broad domains (physical, cognitive, working with others, working conditions) in the screening questions and whether it corresponded with their assessments of ability/difficulty once they had completed the specific job demands questions from each domain.
Results
Forty-six workers living with a chronic condition causing an episodic disability and 23 organizational stakeholders (total n = 69) participated in the study (see Table 2). Most participants were women (78.3%). We recruited a range of ages among workers and organizational representatives. Most participants had some post-secondary education (89.9%). Among workers, 71.7% lived with a chronic physical condition causing an episodic disability, 13.0% lived with a mental health condition and 15.2% lived with both a physical and a mental health condition. Examples of conditions reported by participants include rheumatoid arthritis, epilepsy, multiple sclerosis, depression, anxiety disorders, fibromyalgia, Crohn’s disease, vertigo, bipolar disease, chronic fatigue syndrome, mild traumatic brain injury and ulcerative colitis. Most organizational representatives did not report having a chronic health condition (60.9%), although 13.0% reported a physical condition, 17.4% reported a mental health condition, and 8.7% reported having both.
Participants worked in diverse sectors with about half of workers employed in either education, health, sciences, arts, or professional jobs. Example job types among workers included being a transport and delivery driver, baker, nurse, accounts manager, teacher, administrative assistant, software engineer, clinical researcher, and client manager. About 70% of workers were employed in large organizations of over 500 employees compared to 40.9% of organizational representatives. Most workers were employed full-time (73.9%), 23.9% had supervisory responsibilities, and 26.1% were contract workers. Not surprisingly, more organizational representatives worked full-time (95.7%), had supervisory responsibilities (78.3%), with fewer reporting contract work (13.0%) (see Table 2).
Screening Questions
Table 3 presents the findings for the screening questions. In all cases, worker and organizational respondents’ endorsements exceeded the 70% threshold for understandability, relevance, and feasibility of the questions. Endorsement levels for worker and organizational respondents were relatively similar and often exceeded 85%. Nearly all participants reported that the instructions were clear and that examples were helpful (all endorsements over 93%). Over 70% of respondents rated the domain labels as clear, especially with the use of examples to explain what was meant by cognitive or “thinking” tasks and working with others. Workers rated the relevance of questions in helping them to think about their job and in willingness to continue completing the JDAPT as greater than 95%. This was somewhat greater than for organizational representatives, although this group rated the relevance of the screening questions at 87%, which highly exceeds the minimum performance criteria. On average, worker and organizational representatives took between 3–4 min to complete the screening questions, with workers taking a little longer than organizational respondents.
Despite high levels of endorsement provided for the sensibility concepts in the screening questions, a comparison of the screening questions with the complete JDAPT questionnaire found that congruence between them was problematic (see Table 3). Specifically, when asked about their ability/difficulty with each of the four domains on the screening questions, many respondents reported no difficulties. However, when completing the full JDAPT and the more specific questions within a domain, respondents sometimes changed their answers and reported at least some difficulty with at least one job demand within that domain. Rarely did a respondent report difficulty with a domain in the screening questions but no difficulty after reviewing the detailed job demands. Discordance was more common among worker respondents than organizational respondents and was noted for the domains working with others and working conditions. For example, when asked in the screening questionnaire about their overall ability/difficulty in working with others, 60.5% of workers with chronic conditions provided answers that were congruent with their answers to the four specific job demands comprising working with others in the complete JDAPT. However, nearly 40% (39.5%) of workers with chronic conditions reported no difficulties with working with others in the screening questionnaire, but upon answering the individual items, reported at least some difficulty with at least one job demand in this domain. Across the four domains, worker congruence ranged from 60.5 (working with others) to 76.1% (cognitive demands) leaving approximately 25 to 40% of respondents reporting discordance between the screening questions and complete JDAPT. Organizational respondent congruence ranged from 69.6 (working with others) to 95.6% (cognitive demands). Overall, 47 (68.1%) worker or organizational participants had some discordance between the screening questions and the complete JDAPT.
Complete JDAPT Questions
Table 4 presents the results for the sensibility of the complete JDAPT questions. Responses reached or exceeded the performance criteria for comprehensiveness of domain questions for three of the four job demand domains. Endorsement thresholds were below 70% for working with others (worker = 63.0%; organizational = 65.2%). An examination of the open-ended responses for all domains found several trends. First, several respondents added items that were already encompassed by a job demand but that were more nuanced and detailed. This could be addressed by adding examples to an existing job demand. For example, one respondent added “pushing and pulling objects” to their physical job demands. Instead of creating a new job demand, we added this as an exemplar to an existing job demand of work activities that required strength. Respondents also sometimes suggested adding aspects of work like commuting to and from their job which was not part of their job demands but because it was difficult for them. The JDAPT focuses only on aspects of a person’s required job demands where an employer might be asked to provide support or accommodations. As a result, work-related travel (e.g., visiting clients, visiting job sites, traveling to meetings) was included as a job demand, but general commuting to and from work was not included. Similarly, within the domain of working with others, where participants made the most suggestions for additions, comments were largely about getting along (or not) with colleagues and perceptions of support. Although interpersonal dynamics are an important component of an organization’s climate, for the most part the support appraisals provided by respondents did not constitute a required part of workers’ job activities. In other cases, it was judged that suggestions were already captured by existing JDAPT questions related to working with others.
After reviewing the comments, three new job demands were created to enhance comprehensiveness. For physical job demands, we added a question asking whether using one or more of a person’s senses (i.e., touch, taste, smell, hearing, and seeing) was important to the job and provided examples related to each sense like food tasting and distinguishing fine visual details. For working with others, we added a job demand asking about participating in social activities and meeting social expectations with examples like networking, attending after hours events, and volunteering for workplace committees. Finally, for working conditions, we added a job demand that asked participants whether they had to work in locations where they did not have easy access to facilities that would meet their personal needs, such as having no easy access to a washroom, no running water, or access to a refrigerator for food or medication.
Endorsements for understandability of the complete JDAPT was excellent with responses from workers and organizational representatives often exceeding 85% (see Table 4). This included asking questions about the understandability of response keys that assessed the importance of a job demand, ability/difficulty with the demand, and changes over time. Endorsement of domain labels exceeded 70% but were somewhat lower (worker = 76.1%; organizational representatives = 73.9%). Comments from participants noted that terms like “cognitive or thinking demands,” “working with others” and “working conditions” weren’t always immediately clear. However, respondents consistently reported that examples clarified the labels, and that they were able to understand the areas of their job to which the labels referred.
Endorsements of the relevance of the JDAPT also were excellent and often approached or exceeded 90%. Workers and organizational representatives reported that the JDAPT helped them to think about the job, understand a worker’s challenges and perceived need, and that they would use the JDAPT (see Table 4). For example, a worker living with a mental health condition stated:
I go in and just say, “I’m dealing with a mental illness” and my boss says to me, “what do you need?” And I say, “I don’t know”—which is what happened. I think [the JDAPT] might be better to help me understand actually, that these three aspects of the job are what are actually difficult for me, so let’s think about what we do with those. (Worker: Policy advisor living with depression and PTSD; government)
An organizational representative who was a manager in a hospital echoed this perspective, noting “[The JDAPT] forces you to think about all the ways that a person could have difficulty that you wouldn’t necessarily think about.”
Feasibility of the complete JDAPT varied. Endorsement of the overall ease of completion was 89.1% in workers and 78.3% in organizational participants. Endorsements for the ease of completion of questions about the importance of a job demand were excellent and exceeded 80%. However, assessments of ease of completion of questions about the ability/difficulty questions were 69.6% for both workers and organizational representatives. Questions about changes in ability over time were endorsed by 76.1% of workers and 73.9% of organizational representatives. Open-ended responses explaining the lower endorsements indicated that, although workers understood the questions, answering about ability/difficulty and changes over time when one lives with an episodic disability can take time to consider. Arriving at an answer was do-able, but not “easy.” This did not diminish the perceived importance of the tool. Time taken to consider one’s answer was viewed as a necessary step that enhanced the validity of the JDAPT. Similarly, organizational representatives reported that the questions were easy to understand. However, in considering their answer, they reported not always being certain whether a worker’s difficulties or changes in performance were related to their health condition or some other aspect of their skills or motivation. Yet, despite not always being sure about the attribution of a problem to a worker’s health, organizational participants were confident that there was a difficulty with the performance of a job demand.
On average, participants took 12–15 min to complete the JDAPT. Endorsements of the length as acceptable were 76.1% of workers with a chronic condition and 78.2% of organizational representatives. Comments providing an overall assessment of the JDAPT highlighted that the questions were clear and easy to understand and covered the relevant job demands (see Table 5). Participants also reported that the examples and the use of a clear pattern to lay out the job demands followed by the importance to the job, any difficulties, and any changes over time aided them in understanding and responding to the items. Questions were assessed as thought provoking and ensured that a person considered specific demands of the job.
Discussion
Guidance on ways to communicate workplace support and accommodation needs is an important priority among workers living with chronic health conditions. This study examined the sensibility of the JDAPT questions, focusing on comprehensiveness, understandability, relevance, feasibility, and length from the perspective of workers living with chronic conditions causing episodic disabilities, and organizational representatives who often provide support to these workers. Sensibility testing allows researchers to assess early development issues in a tool prior to additional psychometric testing and outcome evaluation. The JDAPT was created to fill an important gap related to the ease with which workers and organizational representatives could appraise a job’s demands and identify areas where support might be beneficial. The study yielded similar findings from women and men across different ages, health conditions and job types. The findings highlighted high endorsement of the JDAPTs comprehensiveness and feasibility, although study participants noted additional job examples and demands that could enhance the tool. Perceived relevance of the JDAPT was excellent and highly exceeded our minimum threshold of endorsement, pointing to the need for and potential usefulness of the tool. Research examining sensibility is sometimes overlooked in initial testing of a tool but is critical to ensure inclusivity and that the perspectives of users are paramount in real-world tool development and evaluation. This study provides a first step in that assessment.
An important aspect of sensibility testing is to engage potential users of a tool and draw on their insights and experiences. Our cognitive interviewing included people working with physical and mental health conditions, as well as organizational representatives with experiences supporting employees with episodic disability, some of whom also lived with a chronic health condition. Many previous workplace studies have focused exclusively on a particular type of condition (e.g., rheumatoid arthritis), have not included both physical and mental health conditions, and have not included workplace representatives who provide support to workers. We also drew participants from across industrial sectors, work arrangements, and organizational sizes, included participants from smaller workplaces, and part-time and contract workers. The diversity of our sample was helpful not only in the sensibility assessments, but also in enhancing the examples we were able to add to JDAPT questions and in identifying new job demands that have not typically been included as important aspects of employment in other studies. Across groups and sensibility constructs, JDAPT endorsements were high pointing to the potential wide applicability of the tool. At the same time, our sample was convenience-based. For example, we lacked representation from primary industries (e.g., agriculture/farming, mining, logging/forestry). Our participants also had high levels of education. Among organizational representatives, this is not surprising as supervisory and leadership roles often call for greater education. Among workers living with chronic health conditions, educational patterns may be changing. There is emerging evidence that younger adults living with episodic disabilities often pursue college and university education as a means of securing jobs with better benefits and a greater likelihood of accommodation availability [67, 68]. Unfortunately, data also suggest that many individuals living with a disability report underemployment where their jobs do not fully make use of their skills [69, 70]. Canada has relatively high levels of education with Statistics Canada finding that 86.3% of Canadians have a high school diploma or its equivalent and that 54% of Canadians have college or university certifications [71]. Despite increasing educational levels, additional testing with the JDAPT is needed to include individuals with less education and with English as a second language, as these factors are linked to the nature of the job demands undertaken by individuals. It is particularly important for assessment of the understandability and feasibility of the JDAPT.
As part of the JDAPT, we created a screening questionnaire with the goal of enhancing the feasibility of the tool and allowing a shortened version to be completed by participants who were not experiencing any difficulties within a broad job domain. Although the screening questions were highly understandable, relevant, easy, and quick to answer, the discordance between the screener and complete JDAPT questions suggested that, going forward, the screening questions should be omitted from the tool and that all participants complete the full JDAPT questions. Given that the length of the complete JDAPT was endorsed as acceptable, completing the full JDAPT should not be too onerous for most respondents. The lack of concordance also highlighted some positive elements of the complete JDAPT. Specifically, it provided initial evidence that, although many individuals may believe they have a good understanding of the challenges within a job, they may omit, or underestimate difficulties related to the work unless a more in-depth assessment of different job demands is undertaken. This was especially true when it came to thinking through the interpersonal aspects of a job and a job’s working conditions. These domains have not always received the same attention as the physical demands of a job, although recent research has highlighted the complexities of providing accommodations related to interpersonal aspects of working [12]. By asking diverse questions about job demands related to working with others and working conditions, workers and organizational representatives were able to better assess a full range of challenges with the job. Ultimately, this may translate into a more comprehensive assessment of support and accommodation needs.
As noted, the cognitive interviews enabled participants to draw from their experiences and enhance the examples and types of job demands included in the JDAPT. As a result of participant input, three new job demands were added. These were: whether the use of one or more of one’s senses was an important part of the job (e.g., being a taster in a kitchen), whether the job included social demands or meeting social expectations (e.g., attending after hours events, networking, committee volunteering), and whether the job required working in locations where access to facilities to meet personal needs was difficult (e.g., working in a kiosk in a shopping mall with no access to a refrigerator for medication). The addition of these types of job demands warrant additional attention in future research. They also challenge organizations to more comprehensively think about supports and accommodations that may be needed to make employment more accessible and inclusive to all workers.
There is no definitive approach or gold standard for assessing sensibility [54, 55, 57,58,59]. We used a 70% endorsement as our standard, which has been adopted elsewhere [58]. Ratings often highly exceeded this cut-off with overall ratings from workers’ endorsements of the JDAPT’s relevance ranging from 89 to 100% for willingness to use the JDAPT, perceived need, helping others understand a worker’s challenges, and thinking about their job. At the same time, responses indicated that appraising one’s ability/difficulty with work tasks, and assessing changes over time, was not always easy. Some participants, especially those with a highly variable chronic condition, needed time to think about their work and health needs so that they felt comfortable providing an answer that they believed captured their situation. Responses to open-ended questions suggested that participants believed the questions were helpful in thinking about their health in new ways and in better understanding the links between specific job demands and areas where support might make a difference. Many had not thought about their health condition in this way previously. At the same time, additional testing, especially longitudinal research measuring perceptions of job abilities and changes over time is needed, as well as outcome evaluation research that examines the efficacy of support and accommodations for different types of job difficulties.
Organizational representatives also rated the JDAPT as highly relevant with endorsements ranging from 87 to 91%. A key issue among organizational participants was the extent to which they had been given information by workers about a chronic health condition’s impact that they were then able to draw upon when completing the JDAPT. Responses to the open-ended questions suggested that organizational representatives were not always certain about the attribution of difficulties to a worker’s health, and whether other factors contributed to difficulties like a lack of skills or absence of motivation. Despite this, they were confident in recognizing that difficulties existed with a job demand. Further research with organizational representatives is needed. For example, it would be helpful to assess the congruence of JDAPT responses if completed by a worker for their health and an organizational representative like a worker’s supervisor. Research also would be beneficial to examine standard practices within organizations, which currently range from informal discussions to more comprehensive functional and cognitive assessments, and whether the JDAPT provides an equally comprehensive assessment of support needs and solutions.
There are several strengths and limitations to this research. Strengths include that the JDAPT goes beyond existing research tools and aims to provide a way for workers to assess their intermittent and ongoing job demands and support needs, and to receive a range of ideas and strategies to better manage challenges working. Strengths also include the inclusion of a diverse sample of workers and organizational representatives who drew on their personal experiences of working with (or supporting an employee with) a chronic condition causing an episodic disability. Our methods targeted several aspects of sensibility testing, established criteria for endorsement, and provided multiple opportunities for respondents to comment on the JDAPT in their own words. Limitations include that our sample was recruited using convenience-based methods and was cross-sectional in design. Future research needs to include a larger and more diverse group of respondents, including more men, individuals with lower levels of education and English as a second language, as well as longitudinal data to assess changes in difficulty over time. Efforts also need to be made to include more racial and ethnic diversity and to examine new immigrant worker needs in diverse occupations. Larger samples would reduce the potential for bias and would enable sub-group analyses. Because this study focused on sensibility perceptions from potential users of the JDAPT, it did not include a comprehensive evaluation of support and accommodation ideas that would be provided by the JDAPT.
Evaluation next steps for the JDAPT also include outcome and effectiveness evaluation to assess the validity and effects of the JDAPT in real-world conditions [72]. This evaluation process, sometimes labeled a holistic effectuality evaluation approach recognizes that real-world outcome evaluations are a hybrid containing both constructive and conclusive evaluation elements [72]. That is, implementation, adoption and usefulness of a tool will be influenced by external factors such as culture, workplace norms, and social support, and may also relate to personal factors like age, gender, and type of episodic condition. Going forward, evaluation needs to consider these elements as it examines the uptake of the JDAPT. Evaluation efforts also should examine whether there is meaningful change over time in worker and organizational representative perceptions and behaviours. Outcomes should include understanding whether use of the JDAPT is associated with behaviour changes at work like adoption of different support strategies and perceptions of the JDAPTs usefulness, whether there is ongoing use of the tool over time when a worker’s health or job needs change, and whether there are changes in work outcomes like improved productivity and job sustainability.
Conclusions
This study examined sensibility perceptions of a new tool, the JDAPT, among workers living with chronic physical and/or mental health conditions, as well as organizational representatives who provide supports to workers. Increasing numbers of people are working with chronic health conditions that cause episodic disability. They can find it challenging to identify and discuss workplace support and accommodation needs. Study findings highlight the need and relevance of the JDAPT and that it identifies job demands that often are not assessed in other tools, as well as being comprehensive, understandable, and relatively easy to complete. Improving the support provided to people living with chronic physical and mental health conditions is critical to create more inclusive employment opportunities and sustain long-term employment goals.
References
World Health Organization. The World Bank. World report on disability. Geneva: World Health Organization. 2011. Available from: https://apps.who.int/iris/handle/10665/44575. Accessed 21 Oct 2021
OECD. Sickness, disability and work: breaking the barriers: a synthesis of findings across OECD countries. Paris: OECD Publishing; 2010.
Au DWH, Crossley TF, Schellhorn M. The effect of health changes and long-term health on the work activity of older Canadians. Health Econ. 2005;14:999–1018.
Burton W, Morrison A, Maclean R, Ruderman E. Systematic review of studies of productivity loss due to rheumatoid arthritis. Occup Med. 2006;56:18–27.
Christensen BJ, Kallestrup-Lamb M. The impact of health changes on labor supply: evidence from merged data on individual objective medical diagnosis codes and early retirement behavior. Health Econ. 2012;21:56–100.
Gignac MAM, Cao X, McAlpine J. Availability, need for, and use of work accommodations and benefits: are they related to employment outcomes in people with arthritis? Arthritis Care Res (Hoboken). 2015;67:855–864.
Gignac MAM, Kristman V, Smith PM, Beaton DE, Badley EM, Ibrahim S, et al. Are there differences in workplace accommodation needs, use and unmet needs among older workers with arthritis, diabetes and no chronic conditions? Examining the role of health and work context. Work Aging Retire. 2018;4:381–398.
Jetha A, Shamaee A, Bonaccio S, Gignac MAM, Tucker LB, Tompa E, et al. Fragmentation in the future of work: a horizon scan examining the impact of the changing nature of work on workers experiencing vulnerability. Am J Ind Med. 2021;64:649–666.
Morris S, Fawcett G, Timoney LR, Hughes J. The dynamics of disability: progressive, recurrent or fluctuating limitations. Ottawa: Statistics Canada. 2019. Available from: https://www150.statcan.gc.ca/n1/pub/89-654-x/89-654-x2019002-eng.pdf. Accessed 21 Oct 2021
Prince MJ. Persons with invisible disabilities and workplace accommodation: findings from a scoping literature review. J Vocat Rehabil. 2017;46:75–86.
Gignac MAM, Backman CL, Kaptein S, Lacaille D, Beaton DE, Hofstetter C, et al. Tension at the borders: perceptions of role overload, conflict, strain and facilitation in work, family and health roles among employed individuals with arthritis. Rheumatology (Oxford). 2012;51:324–332.
Gignac MAM, Bowring J, Jetha A, Beaton DE, Breslin FC, Franche R-L, et al. Disclosure, privacy and workplace accommodation of episodic disabilities: organizational perspectives on disability communication-support processes to sustain employment. J Occup Rehabil. 2021;31:153–165.
Ragins BR. Disclosure disconnects: antecedents and consequences of disclosing invisible stigmas across life domains. Acad Manage Rev. 2008;33:194–215.
Vickers MH. Life at work with “invisible” chronic illness (ICI): the “unseen”, unspoken, unrecognized dilemma of disclosure. J Workplace Learn. 1997;9:240–252.
Jones KP, King EB. Managing concealable stigmas at work: a review and multilevel model. J Manag. 2014;40:1466–1494.
Bishop ML, Allen C. Employment concerns of people with epilepsy and the question of disclosure: report of a survey of the Epilepsy Foundation. Epilepsy Behav. 2001;2:490–495.
Brouwers EPM, Joosen MCW, van Zelst C, Van Weeghel J. To disclose or not to disclose: a multi-stakeholder focus group study on mental health sssues in the work environment. J Occup Rehabil. 2020;30:84–92.
Fesko SL. Disclosure of HIV status in the workplace: considerations and strategies. Health Soc Work. 2001;26:235–244.
Gignac MAM, Cao X. “Should I tell my employer and coworkers I have arthritis?” A longitudinal examination of self-disclosure in the work place. Arthritis Rheum. 2009;61:1753–1761.
Gignac MAM, Jetha A, Ginis KAM, Ibrahim S. Does it matter what your reasons are when deciding to disclose (or not disclose) a disability at work? The association of workers’ approach and avoidance goals with perceived positive and negative workplace outcomes. J Occup Rehabil. 2021;31:638–651.
Greene K. Disclosure of chronic illness varies by topic and target: the role of stigma and boundaries in willingness to disclose. In: Petronio S, editor. Balancing the secrets of private disclosures. 1st ed. New York: Psychology Press; 2000. p. 123–135.
Hielscher E, Waghorn G. Managing disclosure of personal information: an opportunity to enhance supported employment. Psychiatr Rehabil J. 2015;38:306–313.
Jetha A, Yanar B, Lay AM, Mustard C. Work disability management communication bottlenecks within large and complex public service organizations: a sociotechnical systems study. J Occup Rehabil. 2019;29:754–763.
MacDonald-Wilson KL. Managing disclosure of psychiatric disabilities to employers. J Appl Rehabil Couns. 2005;36:11–21.
Munir F, Leka S, Griffiths A. Dealing with self-management of chronic illness at work: predictors for self-disclosure. Soc Sci Med. 2005;60:1397–1407.
Norstedt M. Work and invisible disabilities: practices, experiences and understandings of (non)disclosure. Scand J Disabil Res. 2019;21:14–24.
Toth KE, Dewa CS. Employee decision-making about disclosure of a mental disorder at work. J Occup Rehabil. 2014;24:732–746.
Brohan E, Henderson C, Wheat K, Malcolm E, Clement S, Barley EA, et al. Systematic review of beliefs, behaviours and influencing factors associated with disclosure of a mental health problem in the workplace. BMC Psychiatry. 2012;12:11.
Dyck I, Jongbloed L. Women with multiple sclerosis and employment issues: a focus on social and institutional environments. Can J Occup Ther. 2000;67:337–346.
Irvine A. Something to declare? The disclosure of common mental health problems at work. Disabil Soc. 2011;26:179–192.
Gignac MAM, Cao X, Tang K, Beaton DE. Examination of arthritis-related work place activity limitations and intermittent disability over four-and-a-half years and its relationship to job modifications and outcomes. Arthritis Care Res (Hoboken). 2011;63:953–962.
Jetha A, Gignac MAM, Ibrahim S, Martin Ginis KA. Disability and sex/gender intersections in unmet workplace support needs: findings from a large Canadian survey of workers. Am J Ind Med. 2021;64:149–161.
Lindbohm ML, Viikari-Juntura E. Cancer survivors’ return to work: importance of work accommodations and collaboration between stakeholders. Occup Environ Med. 2010;67:578–579.
McDowell C, Fossey E. Workplace accommodations for people with mental illness: a scoping review. J Occup Rehabil. 2015;25:197–206.
Stergiou-Kita M, Pritlove C, Van Eerd D, Holness LD, Kirsh B, Duncan A, et al. The provision of workplace accommodations following cancer: survivor, provider, and employer perspectives. J Cancer Surviv. 2016;10:489–504.
Tremblay CH. Workplace accommodations and job success for persons with bipolar disorder. Work. 2011;40:479–487.
The Job Accommodation Network (JAN). A to Z of Disabilities and Accommodations [Internet]. The Job Accommodation Network. 2021. Available from: https://askjan.org/. Accessed 12 Oct 2021
Henderson C, Brohan E, Clement S, Williams P, Lassman F, Schauman O, et al. A decision aid to assist decisions on disclosure of mental health status to an employer: protocol for the CORAL exploratory randomised controlled trial. BMC Psychiatry. 2012;12:133.
Janssens KME, van Weeghel J, Henderson C, Joosen MCW, Brouwers EPM. Evaluation of an intervention to support decisions on disclosure in the employment setting (DECIDES): study protocol of a longitudinal cluster-randomized controlled trial. Trials. 2020;21:443.
Linton SJ, Boersma K, Traczyk M, Shaw W, Nicholas M. Early workplace communication and problem solving to prevent back disability: results of a randomized controlled trial among high-risk workers and their supervisors. J Occup Rehabil. 2016;26:150–159.
Shaw WS, Kristman VL, Williams-Whitt K, Soklaridis S, Huang YH, Cote P, et al. The Job Accommodation Scale (JAS): psychometric evaluation of a new measure of employer support for temporary job modifications. J Occup Rehabil. 2014;24:755–765.
Stratton E, Choi I, Calvo R, Hickie I, Henderson C, Harvey SB, et al. Web-based decision aid tool for disclosure of a mental health condition in the workplace: a randomised controlled trial. Occup Environ Med. 2019;76:595–602.
Van Eerd D, Bowring J, Jetha A, Breslin C, Gignac MAM. Online resources supporting workers with chronic episodic disabilities: an environmental scan. Int J Workplace Health Manag. 2021;14:129–148.
U.S. Department of Justice. Americans With Disabilities Act of 1990, As Amended. 42 U.S.C. § 12101 et seq. 2009. Available from: https://www.ada.gov/pubs/adastatute08.htm. Accessed 06 June 2022
Barnes C. Disabled people in Britain and discrimination: a case for anti-discrimination legislation. London: Hurst Co; 1991.
Hatfield R. Duty to accommodate. Just Labour. 2005;5:23–33.
Office of the Privacy Commissioner of Canada. Privacy in the workplace [Internet]. Gatineau: Office of the Privacy Commissioner of Canada. 2004 [updated 2004 Apr 01]. Available from: https://www.priv.gc.ca/en/privacy-topics/employers-and-employees/02_05_d_17/. Accessed 12 Oct 2022
UN General Assembly. Convention on the Rights of Persons with Disabilities: resolution / adopted by the General Assembly, 24 January 2007, A/RES/61/106. 2007. Available from: http://www.refworld.org/docid/45f973632.html. Accessed 12 May 2022
Ontario Human Rights Commission (OHRC). Human rights at work 2008. 3rd ed. Toronto: Carswell Thomson Publishing (Carswell), in partnership with the Human Resources Professionals Association of Ontario (HRPA of Ontario); 2008.
Ilmarinen J. The work ability index (WAI). Occup Med. 2007;57:160.
van den Berg T, Elders L, de Zwart B, Burdorf A. The effects of work-related and individual factors on the work ability index: a systematic review. Occup Environ Med. 2009;66:211–220.
Karasek R, Theorell T. Healthy work: stress, productivity, and reconstruction of working life. New York: Basic Books; 1990.
Kristensen TS, Hannerz H, Høgh A, Borg V. The Copenhagen Psychosocial Questionnaire-a tool for the assessment and improvement of the psychosocial work environment. Scand J Work Environ Health. 2005;31:438–449.
Feinstein AR. The theory and evaluation of sensibility. In: Feinstein AR, editor. Clinimetrics. New Haven: Yale University Press; 1987. p. 141–166.
Auger C, Demers L, Swaine B. Making sense of pragmatic criteria for the selection of geriatric rehabilitation measurement tools. Arch Gerontol Geriatr. 2006;43:65–83.
Terwee CB, Mokkink LB, van Poppel MNM, Chinapaw MJM, van Mechelen W, de Vet HCW. Qualitative attributes and measurement properties of physical activity questionnaires. Sports Med. 2010;40:525–537.
Beaton DE, Boers M, Tugwell P. Assessment of health outcomes. In: Firestein GS, editor. Kelley’s textbook of rheumatology. 8th ed. Philadelphia: WB Saunders; 2009. p. 463–474.
Tang K, Beaton DE, Lacaille D, Gignac MAM, Bombardier C, Canadian Arthritis Network (CAN) Work Productivity Group. Sensibility of five at-work productivity measures was endorsed by patients with osteoarthritis or rheumatoid arthritis. J Clin Epidemiol. 2013;66:546–556.
Lawshe CH. A quantitative approach to content validity. Pers Psychol. 1975;28:563–575.
Rubio DM, Berg-Weger M, Tebb SS, Lee ES, Rauch S. Objectifying content validity: conducting a content validity study in social work research. Soc Work Res. 2003;27:94–104.
MacDermid JC. ICF linking and cognitive interviewing are complementary methods for optimizing content validity of outcome measures: an integrated narrative methods review. Front Rehabil Sci. 2021;2:1–15.
Hughes KA. Comparing pretesting methods: cognitive interviews, respondent debriefing, and behavior coding. Surv Methodol. 2004;2:1–21.
Ikart EM. Questionnaire pretesting methods: a comparison of cognitive interviewing and respondent debriefing vis-à-vis the study of the adoption of decision support systems by knowledge workers. Int J Busi Inf. 2018;13:119–154.
Meadows K. Cognitive interviewing methodologies. Clin Nurs Res. 2021;30:375–379.
Sudman S, Bradburn NM, Schwarz N. Methods for determining cognitive processes and questionnaire problems. In: Sudman S, Bradburn NM, Schwarz N, editors. Thinking about answers: the application of cognitive processes to survery methodology. 1st ed. San Francisco: Jossey-Bass Publishers; 1996. p. 15–54.
Neuendorf KA. The content analysis guidebook. Thousand Oaks: Sage Publications; 2002.
Jetha A, Gignac MAM, Bowring J, Tucker S, Connelly CE, Proulx L, et al. Supporting arthritis and employment across the life course: a qualitative study. Arthritis Care Res (Hoboken). 2018;70:1461–1468.
Jetha A, Badley E, Beaton D, Fortin PR, Shiff NJ, Gignac MAM. Unpacking early work experiences of young adults with rheumatic disease: an examination of absenteeism, job disruptions and productivity loss. Arthritis Care Res (Hoboken). 2015;67:1246–1254.
Jetha A, Martin Ginis KA, Ibrahim S, Gignac MAM. The working disadvantaged: the role of age, job tenure and disability in precarious work. BMC Public Health. 2020;20:1900.
Mann DR, Wittenburg DC. Starting behind: wage and employment differentials between young adults with and without disabilities. J Disabil Policy Stud. 2015;26:89–99.
Statistics Canada. Education in Canada: key results from the 2016 Census. Ottawa: The Daily, Statistics Canada. 2017. Available from: https://www150.statcan.gc.ca/n1/en/daily-quotidien/171129/dq171129a-eng.pdf?st=OpQQLts_. Accessed 21 Oct 2021
Chen HT. Practical program evaluation. Thousand Oaks: Sage; 2015.
Acknowledgements
The authors would like to thank the many partner organizations involved in this research. They are the Arthritis Society, Canadian Mental Health Association, Crohn’s and Colitis Canada, Institute for Work & Health, Mindful Employer Canada, Multiple Sclerosis Society of Canada, Ontario Ministry of Labour, Training and Skills Development, Realize Canada, and Workplace Strategies for Mental Health. Thanks also to Cindy Moser, Uyen Vu, and Gemma Woticky for their review of JDAPT content.
Funding
This research was funded by a Healthy and Productive Work (HPW) partnership grant from the Social Sciences and Humanities Research Council of Canada (SSHRC) and the Canadian Institutes of Health Research (CIHR) #890-2016-3002 to the ACED: Accommodating and Communicating about Episodic Disabilities partnership team. An unrestricted grant also was received from Canada Life. The Institute for Work & Health operates with the support of the Province of Ontario. The views expressed herein are those of the authors and do not necessarily reflect those of the province of Ontario.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design, and commented on and approved the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no conflict of interest relating to the material presented in this article.
Ethical approval
Ethical approval was received from the University of Toronto Research Ethics Board (#37970).
Informed Consent
Informed consent was obtained from all participants.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix A
Appendix A
See Table 6.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Gignac, M.A.M., Bowring, J., Tonima, S. et al. A Sensibility Assessment of the Job Demands and Accommodation Planning Tool (JDAPT): A Tool to Help Workers with an Episodic Disability Plan Workplace Support. J Occup Rehabil 33, 145–159 (2023). https://doi.org/10.1007/s10926-022-10057-4
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10926-022-10057-4