Clinical Trial Results Summary for Laypersons: A User Testing Study

Abstract

Objective

To apply “user testing” to maximize readability and acceptability of a Clinical Trial Results Laypersons Summary —a new European requirement.

Methods

“User testing” (using questionnaire and semistructured interview) assessed whether people could find and understand key points. Findings were used to improve content and design, prior to retesting. Participants had a range of levels of health literacy and there was a higher education group. Participants accessed the summary on screen. In round 1 we tested 12 points of information. In round 2 a revised summary addressing round 1 findings was tested, leading to a third final version.

Results

In round 1, 2 of 12 points of information did not reach the target and interviews raised further format and content issues (some distracting technical explanations and inability to find or understand the 2 main study purposes). These findings informed revisions for the version tested in round 2, with 2 different points not reaching the target (inclusion criteria relating to duration of seasonal allergies and how researchers found out about participants’ symptoms). Identified problems in both rounds were addressed and reflected in the final version. Despite improvements, participants did not consistently understand that summaries were intended for the public, or to only interpret results of single trials in the context of additional trials. All readers, including those with higher education, found the clear and straightforward language acceptable.

Conclusions

Applying “user testing” resulted in a largely health-literate summary suitable for people across a range of backgrounds.