Theory and Decision

, Volume 73, Issue 4, pp 671–685

The Group Calibration Index: a group-based approach for assessing forecasters’ expertise when external outcome data are missing


DOI: 10.1007/s11238-011-9265-4

Cite this article as:
Fischer, I. & Bogaire, R. Theory Decis (2012) 73: 671. doi:10.1007/s11238-011-9265-4


The Group Calibration Index (GCI) provides a means of assessing the quality of forecasters’ predictions in situations that lack external feedback or outcome data. The GCI replaces the missing outcome data with aggregated ratings of a well-defined reference group. A simulation study and two experiments show how the GCI classifies forecaster performance and distinguishes between forecasters with restricted information and those with complete information. The results also show that under certain circumstances, where members of the reference group have high-quality information, the new GCI will outperform expert classification that is based on traditional calibration indices.


Group decisions Experts Calibration Uncertainty 

Copyright information

© Springer Science+Business Media, LLC. 2011

Authors and Affiliations

  1. 1.University of HaifaHaifaIsrael
  2. 2.The Open University of IsraelRaananaIsrael

Personalised recommendations