Abstract
Contour “gist” creation (i.e., creating a simplified contour which represents an object) is always required in helping Visually Impaired People (VIP) to do an effective tactile exploration on painting images in a museum. However, this process is very labor intensive, and the existing contour/edge detection algorithms in the literature are not capable of creating the contour “gist” models automatically. In this paper, a method for semi-automatic contour “gist” creation for museum painting tactile exploration is proposed. It uses 2 databases (original image database and contour “gist” model database), an object detection algorithm (deep learning), and object-contour “gist” model matching algorithm. The output of this method would be transferred to Force-Feedback Tablet (F2T) (an original tactile device) to allow the VIP to explore the museum paintings more effectively.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
World Health Organization (WHO): Blindness and vision impairment. (2022). Accessed on 31 Jan 2022; Available from: https://www.who.int/news-room/fact-sheets/detail/blindness-and-visual-impairment
Souradi, A., et al.: Towards the tactile discovery of cultural heritage with multi-approach segmentation. In: International Conference on Image and Signal Processing. Springer International Publishing (2020)
Groen, I.I.A., et al.: From image statistics to scene gist: evoked neural activity reveals transition from low-level natural image structure to scene category. J. Neurosci. 33(48), 18814–18824 (2013)
La Tapisserie de Bayeux. (2022). Accessed on 05 Feb 02 022. Available from: https://www.bayeuxmuseum.com/la-tapisserie-de-bayeux/
Yang, H., et al.: ContourGAN: image contour detection with generative adversarial network. Knowl.-Based Syst. 164, 21–28 (2019)
Al-Bander, B., et al.: Improving fetal head contour detection by object localisation with deep learning. In: Annual Conference on Medical Image Understanding and Analysis. Springer International Publishing (2020)
Zhang, Q., Lin, C., Li, F.: Application of binocular disparity and receptive field dynamics: a biologically-inspired model for contour detection. Pattern Recogn. 110, 107657 (2021)
Melotti, D., et al.: A robust contour detection operator with combined push-pull inhibition and surround suppression. Inf. Sci. 524, 229–240 (2020)
Roussel, L.: Contribution to assisting the (re-)presentation of works of art to the visually impaired Master’s thesis. Université de Rouen Normandie, Litis (2021)
Gay, S.L., et al.: F2T: a novel force-feedback haptic architecture delivering 2D data to visually impaired people. IEEE Access 9, 94901–94911 (2021)
OpenCV: TensorFlow Object Detection API (2022). Accessed on 29 Feb 2022. Available from: https://github.com/opencv/opencv/wiki/TensorFlow-Object-Detection-API
Acknowledgement
The authors would like to thank their financial supporters: ANR (Agence Nationale de Recherche), Normandy University, Région Normandie, European Commission, CNRS and MEAE (France Embassy in London), Rouen University and its “Espace Handicap”.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Duy Dao, S., Truong, NT., Pissaloux, E., Romeo, K., Djoussouf, L. (2022). Semi-automatic Contour “Gist” Creation for Museum Painting Tactile Exploration. In: Miesenberger, K., Kouroupetroglou, G., Mavrou, K., Manduchi, R., Covarrubias Rodriguez, M., Penáz, P. (eds) Computers Helping People with Special Needs. ICCHP-AAATE 2022. Lecture Notes in Computer Science, vol 13341. Springer, Cham. https://doi.org/10.1007/978-3-031-08648-9_31
Download citation
DOI: https://doi.org/10.1007/978-3-031-08648-9_31
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-08647-2
Online ISBN: 978-3-031-08648-9
eBook Packages: Computer ScienceComputer Science (R0)