Bond and colleagues examined the effectiveness of real-time feedback on improvement in quality metrics in the context of a pay-for-performance program.1 The study involved a natural experiment at a large health system, which had changed from quarterly reporting of quality metrics to a registry system that included performance metrics that were accessible to physicians in real time. The investigators found inconsistent effects in usage of the registry and variable impact on the metrics. The lowest performing physicians tended to have the largest improvement. Despite design limitations, the results are consistent with other results and have important implications.

Providing feedback to improve performance has a long history in quality improvement, presumably on the assumption that if we provide the opportunity for feedback, physicians will take advantage of it and performance will improve. Unfortunately, this assumption has not been borne out in the literature, either in terms of the impact of feedback on performance or in the willingness to seek out information. Ivers and colleagues conducted a systematic review of the effect of audit and feedback on performance and found inconsistent effects, but, as in the present study, they found that feedback was most effective for those at the lower performance levels.2 Inconsistent use of the registry has parallels from studies in clinical care. The classic study by Covell et al. on information seeking in clinical care showed clinicians had many questions, often about missing patient data, for which they never sought answers.3 Electronic Health Records and Health Information Exchanges have made patient information more accessible, but studies have shown that if the feedback or clinical information has to be “sought,” sometimes even within a single system, it may not be accessed.3,4,5 The lesson from the present study as well as others is that we need to be sure the feedback we provide is necessary and if so, that it reaches the intended audience without requiring clinicians to seek it out.