Abstract
There is a growing reliance on imaging equipment in medical domain, hence medical experts’ specialized visual perceptual capability becomes the key of their superior performance. In this paper, we propose a principled generative model to detect and segment out dermatological lesions by exploiting the experts’ perceptual expertise represented by their patterned eye movement behaviors during examining and diagnosing dermatological images. The image superpixels’ diagnostic significance levels are inferred based on the correlations between their appearances and the spatial structures of the experts’ signature eye movement patterns. In this process, the global relationships between the superpixels are also manifested by the spans of the signature eye movement patterns. Our model takes into account these dependencies between experts’ perceptual skill and image properties to generate a holistic understanding of cluttered dermatological images. A Gibbs sampler is derived to use the generative model’s structure to estimate the diagnostic significance and lesion spatial distributions from superpixel-based representation of dermatological images and experts’ signature eye movement patterns. We demonstrate the effectiveness of our approach on a set of dermatological images on which dermatologists’ eye movements are recorded. It suggests that the integration of experts’ perceptual skill and dermatological images is able to greatly improve medical image understanding and retrieval.
The two authors have equal contributions to the work.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Palmeri, T.J., Wong, A.C.-N., Gauthier, I.: Computational approaches to the development of perceptual expertise. TRENDS Cogn. Sci. 8(8), 378–386 (2004)
Dempere-Marco, L., Hu, X.-P., Yang, G.-Z.: A novel framework for the analysis of eye movements during visual search for knowledge gathering. J. Cogn. Comput. 3, 206–222 (2011)
Hoffman, R., Fiore, M.S.: Perceptual (re)learning: a leverage point for human-centered computing. J. Intell. Syst. 22(3), 79–83 (2007)
Hu, X.-P., Dempere-Marco, L., Yang, G.-Z.: Hot spot detection based on feature space representation of visual search. IEEE Trans. Med. Imaging 22(9), 1152–1162 (2003)
Lotenberg, S., Gordon, S., Long, R., Antani, S., Jeronimo, J., Greenspan, H.: Automatic evaluation of uterine cervix segmentations using ground truth from multiple experts. Comput. Med. Imaging Graph. 33(3), 205–216 (2009)
Wang, L., Merrifield, R., Wang, G.-Z.: Reinforcement learning for context aware segmentation. In: Medical Image Computing and Computer-Assisted Intervention - MICCAI 2011, pp. 627–634. Springer, Heidelberg (2011)
Guo, X., Li, R., Yu, Q., Haake, A.R.: Modeling physicians’ utterarnces to explore diagnostic decision-making. In: The 26th International Joint Conference on Artificial Intelligence - IJCAI 2017, Melbourne, pp. 3700–3706 (2017)
Dempere-Marco, L., Hu, X.-P., Ellis, S.M., Hansell, D.M., Yang, G.-Z.: Analysis of visual search patterns with EMD metric in normalized anatomical space. IEEE Trans. Med. Imaging 25(8), 1011–1021 (2006)
Henderson, J., Malcom, G.: Searching in the dark cognitive relevance drives attention in real-world scenes. Psychon. Bull. Rev. 16(5), 850–856 (2009)
Castelhan, M., Mack, M., Henderson, J.: Viewing task influences eye movement control during active scene perception. J. Vis. 9(3), 1–15 (2009)
Li, R., Shi, P., Haake, A.R.: Image understanding from experts’ eyes by modeling perceptual skills of diagnostic reasoning processes. In: IEEE Conference on Computer Vison and Pattern Recognition - CVPR 2013, pp. 2187–2194. IEEE Press, New York (2013)
Li, R., Pelz, J., Shi, P., Alm, C.O., Haake, A.R.: Learning eye movement patterns for characterization of perceptual expertise. In: Proceedings of Symposium on Eye Tracking Research and Applications - ETRA 2012, California, pp. 393–396. ACM (2012)
Li, R., Pelz, J., Shi, P., Haake, A.R.: Learning image-derived eye movement patterns to characterize perceptual expertise. In: Proceedings of the 34th Annual Meeting of the Cognitive Science Society - CogSci 2012, pp. 190–195. IEEE, California (2012)
Krupinski, E., Tillack, A., Henderson, J., Bhatacharyya, A., Scott, K., Graham, A., Descour, M., Davis, J., Weinstein, R.: Eye-movement study and human performance using telepathology virtual slides: implications for medical education and differences with experience. J. Hum. Pathol. 37(12), 1543–1556 (2006)
Manning, D., Ethell, S., Donovan, T., Crawford, T.: How do radiologists do it? The influence of experience and training on searching for chest nodules. Radiography 12, 134–142 (2007)
Liang, Z., Fu, H., Zhang, Y., Chi, Z., Feng, D.: Content-based image retrieval using a combination of visual features and eye tracking data. In: Proceedings of Symposium on Eye-Tracking Research and Applications - ETRA 2010, Texas, pp. 22–24. ACM (2010)
Li, R., Curhan, J., Hoque, M.E.: Understanding social interpersonal interaction via synchronization templates of facial events. In: Proceedings of 32nd AAAI Conference on Artificial Intelligence - AAAI 2018, New Orleans, pp. 1579–1586 (2018)
Li, R., Kishan, KC., Cui, F., Domke, J., Haake, A.J.: Sparse covariance modeling in high dimensions with gaussian processes. In: Proceedings of Neural Information Processing Systems - NeurIPS 2018, Montreal, pp. 739–748 (2018)
Li, R., Shi, P., Pelz, J., Alm, C.O., Haake, A.R.: Modeling eye movement patterns to characterize perceptual skill in image-based diagnostic reasoning processes. Comput. Vis. Image Underst. 151, 138–152 (2016)
Ren, X., Malik, J.: Learning a classification model for segmentation. In: 9th IEEE International Conference on Computer Vision, pp. 10–17. IEEE Press, New York (2003)
Mori, G., Ren, X., Efros, A.A., Malik, J.: Recovering human body configurations: combining segmentation and recognition. In: IEEE Conference on Computer Vision and Pattern Recognition - CVPR 2004, pp. 326–333. IEEE Press, New York (2004)
Acknowledgments
The research is supported by Tianjin Philosophical and Social Science Program TJWW15-004.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Li, Q., Hou, W. (2020). Using Experts’ Perceptual Skill for Dermatological Image Segmentation. In: Bi, Y., Bhatia, R., Kapoor, S. (eds) Intelligent Systems and Applications. IntelliSys 2019. Advances in Intelligent Systems and Computing, vol 1038. Springer, Cham. https://doi.org/10.1007/978-3-030-29513-4_86
Download citation
DOI: https://doi.org/10.1007/978-3-030-29513-4_86
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-29512-7
Online ISBN: 978-3-030-29513-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)