Design and ethics
In this cross-sectional observational study, counselors discussed a multigene panel test with a SP. Creating so-called simulated consultations eliminates variation at patient level, enabling the use of one instead of multiple consultations per counselor. This method has previously been successfully applied [18]. The Medical Ethics Review Board of the Academic Medical Center approved the study and waived the need for ethico-legal adjudication as it would have no serious impact on participating counselors.
Scenario
All simulated consultations were based on the same scenario: a highly-educated male counselee who has had three types of cancer and visits for his first genetic counseling appointment concerning a pretest-counseling session about the option to perform a multigene panel test for cancer. One type of counselee was used in this study to enable standardization across consultations and thus to compare communication between counselors. A male counselee was chosen for practical reasons.
Simulated patients (SPs)
Two experienced male actors, comparable in age (± 60 years old), were trained to act as SP1 and SP2 according to a script (Supplement A). The script contained background information, e.g. the reason for seeking cancer genetic counseling, and instructions to provide two statements indicating uncertainty and to ask two specific questions during the consultation, e.g., ‘Oh, what if something unknown is determined... What am I supposed to do then..'. Further, SPs were instructed to follow the lead of the counselor, providing information or asking questions only when prompted.
SPs were trained twice in 2-h sessions to review the script and practice the case with a clinical geneticist in the presence of the research team. After the first session, the SPs acted in four pilot consultations with counselors not participating in this study, to test the script and SPs’ behavior, and to further adjust the script. During the second session, the final script was discussed and practiced.
Participants
In the Netherlands, genetic testing for cancer is performed at seven university medical centers and one oncology-specific tertiary referral center. Eligible for participation in the present study were all counselors (i.e., clinical geneticists, residents and interns, physician assistants (in training) and genetic counselors) affiliated with these centers and performing cancer genetic counseling. The study was advertised at all centers, and interested counselors received more details from the first author. To create a large and heterogeneous sample, clinical geneticists (both staff and residents), physician assistants and genetic counselors varying in years of working experience were recruited. To create an equal distribution across the centers, the aim was to recruit at least five counselors per institute, three of which were clinical geneticists.
Procedure
Data were collected between September 2017 and March 2018. When counselors agreed to participate, a consultation with a SP was scheduled at the counselors’ own institute. Three weeks before this consultation, counselors gave written informed consent and completed a questionnaire assessing their background characteristics (T0). One week before the consultation, they received a brief instruction letter, a simulated medical file, and the SP’s pedigree. Counselors were instructed to conduct their consultation as they would do in routine clinical care and to take the time commonly needed for this type of consultation, which was on forehand specified to vary between 30 and 60 minutes in standard practice. Consultations were video-recorded and counselors completed a questionnaire assessing their perception of realism and degree of SDM during this consultation (T1) immediately afterwards.
Measures
Background characteristics (at T0)
The following background characteristics of counselors were assessed:
-
(a)
Socio-demographic, i.e. age and gender, and practice characteristics, i.e. professional training, years of counseling experience, and experience in communication training.
-
(b)
Confidence in discussing uncertainty, using a 5-item questionnaire which was developed for this study based on previous literature and existing questionnaire items from measures assessing related constructs [19]. All items were answered on a 7-point Likert response scale (1 = completely disagree and 7 = completely agree), with a maximum total score of 35. An example of one item is: I am very capable in discussing uncertainty about a panel test.
-
(c)
Uncertainty tolerance, using the 5-item ‘Anxiety because of uncertainty’-scale of the Physicians’ Reaction to Uncertainty (PRU) questionnaire with a 6-point Likert response scale, with a maximum total score of 30 [20]. This questionnaire was translated to Dutch using forward–backward translation [21].
-
(d)
Attitude towards SDM, using a 4-item questionnaire with a 7-point Likert response scale [22]. Maximum total score was 24 and scores < 12 were classified as a positive attitude and scores ≥ 12 as negative. Items were translated to Dutch using forward–backward translation [21].
-
(e)
Perception of colleagues’ attitude towards SDM (i.e. perceived social norm) using a 2-item questionnaire which was developed based on previous literature [23]. Answers were given on a 7-point Likert response scale (1 = completely disagree and 7 = completely agree; maximum total score of 14). For example, one item is Most counselors working in my center think it is important to apply shared decision making in consultations about panel tests.
SDM (at T1)
We assessed counselors’ perception of the degree of SDM during the simulated consultation, using the Dutch version of the 9-item SDM-Q-Doc with a 6-point Likert response scale [24]. This questionnaire has been shown to have a good acceptance and reliability.
Realism (at T1)
Counselors’ perceived realism of the consultation was measured using a 3-item questionnaire with a 7-point Likert response scale (1 = completely disagree and 7 = completely agree). We used an adapted version of a questionnaire with a Cronbach’s alpha = 0.84, that has been used in previous studies of our research group (for example [25]). In addition, realism of SPs’ behavior was measured using a 2-item questionnaire (Cronbach’s alpha = 0.79) with a 7-point Likert response scale (1 = not at all and 7 = totally).
Content coding of consultations
Coding of counselors’ expressions of uncertainty
All consultations were coded by two coders (NM and PvM) independently. To identify counselors’ expressions of uncertainty and their responses to counselees’ utterances of uncertainty, videos were coded according to a coding scheme using The Observer XT software for observational analysis of video recordings [26]. Details of the development and content of the coding scheme are provided in Supplement B. The final coding scheme included 42 detailed codes covering 13 topics about which counselors could express uncertainty, categorized among four issues: scientific test-related, scientific disease-related, practical and personal uncertainties [4]. For each expression we also coded its initiation, i.e., counselor initiated or stimulated by the counselee, and framing, i.e., whether uncertainty was expressed directly, i.e. a decisive expression; e.g. Wedon’t knowwhat it means, or indirectly, i.e. a hesitant expression; e.g. This pathogenic variant isprobablynot related to your cancer. Moreover, we coded whether neutral, positive or negative terms were used when expressing uncertainty, i.e. respectively ‘only’ disclosing uncertainty, adding a positive value (e.g. uncertainty does not necessarily imply something detrimental) or adding a negative value (e.g. an uncertain finding may turn out to be a pathogenic variant) to emphasize either one of the implications of uncertainty.
Coding of counselors’ responses to counselee expressions of uncertainty
To code counselors’ responses to SPs’ utterances of uncertainty, the Verona Coding Definitions of Emotional Sequences (VR-CoDES) were used [16]. This system allows coding counselors’ responses to SPs’ scripted and spontaneous utterances of uncertainty in terms of their (a) explicitness, and (b) space. An explicit response includes a clear reference to counselees’ uncertainty whereas a non-explicit response does not. Space refers to whether counselors reduced or provided space for the counselee to further disclosure uncertainty. An example of a response that reduces space is when a counselor switches to another subject, e.g. SP: I’m worried about whether my children will develop cancer; Response of counselor: Does any of your children know that you’re here today?. Providing space is subdivided into content space, i.e., to explore the content of the uncertainty, for example; What is the reason you want to know whether you carry a pathogenic variant or not?, and affective space, i.e., to explore the affect associated with the uncertainty, for example; Why do you think you’ll have difficulty in dealing with an uncertain variant?. The combination of these characteristics results in five response categories: (1) non-explicit, reducing space; (2) non-explicit, providing space; (3) explicit, reducing space; (4) explicit, providing content space; and (5) explicit, providing affective space (categories of VR-CoDES responses are presented in Fig. 1 in Supplement C).
Coding of SDM and realism
The two coders independently assessed the degree of SDM, using the 9-item SDM-Q with a 6-point Likert response scale [27], adapted to be used as a coding instrument, and realism of SPs’ behavior, using a self-developed 3-item coding instrument with a maximum score of 6 per item.
Interrater reliability
After the two coders coded ten observations, interrater reliability of coded uncertainties, responses to uncertainty, SDM and realism was calculated. Since the interrater reliability of coded uncertainties and responses was sub-optimal (mean κ = 0.16; range 0.09–0.28), it was decided to double-code all observations independently. This would enable discussing and reaching consensus on any coding discrepancies, and thereby increase reliability. Reliability analyses on SDM data showed a moderate mean κ = 0.38; range 0.03–0.92. Reliability of realism was judged to be substantial (Cohen’s Kappa κ = 0.60). After every five observations, coders met to compare their coding and if they disagreed, consensus was reached through discussion.
Statistical analysis
All statistical tests were performed using SPSS Statistics, version 21. Data distributions were checked for normality using visual inspections combined with parametric tests. Descriptive statistics were used to summarize counselors’ background characteristics, i.e. level of experience, professional training, uncertainty tolerance, confidence in communicating uncertainty, attitude towards SDM and perceived social norm about SDM. As a manipulation check, differences between consultations of the two SPs (i.e., differences in type of counselor, work experience, received communication training and mean duration of consultation) were assessed using independent t test or χ2-test, whichever was deemed more appropriate. Further, a consensus score was calculated of how realistic SPs’ behavior was rated by the two observers. Differences in realism scores as rated by counselors as well as observers were assessed using independent t test or χ2-test.
Counselors’ expressed uncertainties, its initiation and framing, and the responses to uncertainties were summarized using descriptive statistics. To determine whether expressions of the four uncertainty issues (i.e. scientific test-related, scientific disease-related, practical and personal) differed in how they were framed, ratios of framing were calculated by dividing all uncertainty expressions related to one issue with one type of framing (e.g. all scientific test-related uncertainties framed in direct positive terms) by the total number of uncertainty expressions related to that particular issue. Subsequently, a χ2-test was performed to test for differences in ratios. Further, a consensus score of the ratings of SDM by the two observers was calculated after which differences between observers’ and counselors’ ratings of SDM were assessed using independent t-test or χ2-test. This consensus score of SDM was used in further analyses on SDM.
The associations between the frequency of the four uncertainty issues and counselors’ background characteristics were assessed using Pearson’s correlation or regression analyses. This was also done to determine whether counselors’ background characteristics were correlated with each other. Further, we examined whether counselors’ responses to uncertainties, e.g. providing space, and counselors’ SDM scores were correlated with counselors’ background characteristics using Pearson’s correlation or regression analyses. Moreover, associations between the frequency of uncertainty issues and counselors’ SDM scores, and between counselors’ responses to uncertainties, e.g. space providing, and counselors’ SDM scores were assessed using similar analyses.
Finally, a post-hoc power analysis was performed using G*Power version 3.1.9.2 [28]. Using an alpha of 0.05, we had a 50% power to determine medium effects (effect size of 0.3) with our sample size of 29. For all analyses, a significant level of p < .0.05 was used.