Emergent Diagnoses from a Collective of Radiologists: Algorithmic versus Social Consensus Strategies
Twelve radiologists independently diagnosed 74 medical images. We use two approaches to combine their diagnoses: a collective algorithmic strategy and a social consensus strategy using swarm techniques. The algorithmic strategy uses weighted averages and a geometric approach to automatically produce an aggregate diagnosis. The social consensus strategy used visual cues to quickly impart the essence of the diagnoses to the radiologists as they produced an emergent diagnosis. Both strategies provide access to additional useful information from the original diagnoses. The mean number of correct diagnoses from the radiologists was 50 and the best was 60. The algorithmic strategy produced 63 correct diagnoses and the social consensus produced 67. The algorithm’s accuracy in distinguishing normal vs. abnormal patients (0.919) was significantly higher than the radiologists’ mean accuracy (0.861; p = 0.047). The social consensus’ accuracy (0.951; p = 0.007) showed further improvement.
KeywordsCorrect Diagnosis Incorrect Diagnosis Social Consensus Algorithmic Strategy Inattentional Blindness
Unable to display preview. Download preview PDF.
- 1.Brutschy, A., Scheidler, A., Merkle, D., Middendorf, M.: Learning from house-hunting ants: collective decision-making in organic computing systems. In: Dorigo, M., Birattari, M., Blum, C., Clerc, M., Stützle, T., Winfield, A.F.T. (eds.) ANTS 2008. LNCS, vol. 5217, pp. 96–107. Springer, Heidelberg (2008)CrossRefGoogle Scholar
- 6.Surowiecki, J.: The Wisdom of Crowds. Doubleday, New York (2005)Google Scholar