Abstract
In the context of virtual and augmented reality, computer vision plays a pivotal role. To benchmark performance, evaluation of computer vision models, such as edge detection is essential. Traditionally this has relied on subjective analysis of the resultant images. Alternatively, models have been assessed against ground truth images. However, ground truth images are highly subjective, relying on human judging to determine the appropriate location of features. Literature complains about the lack of objective quantitative measures for model evaluation, yet no solution has been presented. Ground truth is the objective verification of properties of an image. In the context of this paper it is a data set that includes an accurate and complete representation of the edges. The subjective nature of creating ground truth images has meant that true image analysis model evaluation has been limited. Reducing the level of subjective decisions can improve the confidence level when measuring the performance of computer vision image analysis models. This work describes a new method to improve ground truth image confidence through an automated computer vision feature detection model voting system.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
van Vliet, L.J., Young, I.T., Beckers, G.L.: A nonlinear laplace operator as edge detector in noisy images. Comput. Vis. Graph. Image Process. 45(2), 167–195 (1989)
Heath, M., Sarkar, S., Sanocki, T., Bowyer, K.: Comparison of edge detectors: a methodology and initial study. In: 1996 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Proceedings CVPR 1996, pp. 143–148. IEEE (1996)
Jeschke, S., Thomsen, C., Richter, T., Scheel, H.: On remote and virtual experiments in elearning in statistical mechanics and thermodynamics. J. Softw. 2(6), 76–85 (2007)
Kist, A.A., Maxwell, A.D., Gibbings, P.: Expanding the concept of remote access laboratories. In: ASEE 2012 Annual Conference & Exposition: Spurring Big Ideas in Education, San Antonio, TX, USA. American Society for Engineering Education (2012)
Ijsselsteijn, W.A., de Ridder, H., Freeman, J., Avons, S.E.: Presence: concept, determinants and measurement. Hum. Vis. Electron. Imaging 3959, 520–529 (2000)
Lindsay, E.D., Naidu, S., Good, M.C.: A different kind of difference: theoretical implications of using technology to overcome separation in remote laboratories. Int. J. Eng. Educ. 23(4), 72 (2007)
Barak, M.: Instructional principles for fostering learning with ICT: teachers’ perspectives as learners and instructors. Educ. Inf. Technol. 11(2), 121–135 (2006)
Bowtell, L.A., Moloney, C., Kist, A.A., Parker, V., Maxwell, A.D., Reedy, N.: Enhancing nursing education with remote access laboratories. Int. J. Online Eng. (iJOE) 8(S4), 52–59 (2012)
Smith, S.M., Brady, J.M.: SUSAN—a new approach to low level image processing. Int. J. Comput. Vision 23(1), 45–78 (1997)
Bowyer, K., Kranenburg, C., Dougherty, S.: Edge detector evaluation using empirical ROC curves. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 354–359. IEEE (1999)
Fram, J.R., Deutsch, E.S.: On the quantitative evaluation of edge detection schemes and their comparison with human performance. IEEE Trans. Comput. 100(6), 616–628 (1975)
Peli, T., Malah, D.: A study of edge detection algorithms. Comput. Graph. Image Process. 20(1), 1–21 (1982)
Arbelaez, P., Maire, M., Fowlkes, C., Malik, J.: Contour detection and hierarchical image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 33(5), 898–916 (2011)
Torre, V., Poggio, T.A.: On edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 2, 147–163 (1986)
Marr, D., Hildreth, E.: Theory of edge detection. Proc. Roy. Soc. Lond. B Biol. Sci. 207(1167), 187–217 (1980)
Sobel, I.: An Isotropic 3 × 3 Image Gradient Operator, Presentation at Stanford Artificial Intelligence Project (SAIL). Stanford, California (1968
Prewitt, J.M.: Object enhancement and extraction. Picture Process. Psychopictorics 10(1), 15–19 (1970)
Kirsch, R.A.: Computer determination of the constituent structure of biological images. Comput. Biomed. Res. 4(3), 315–328 (1971)
Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698 (1986)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Smith, M., Maiti, A., Maxwell, A., Kist, A.A. (2021). Objective Construction of Ground Truth Images. In: Auer, M., May, D. (eds) Cross Reality and Data Science in Engineering. REV 2020. Advances in Intelligent Systems and Computing, vol 1231. Springer, Cham. https://doi.org/10.1007/978-3-030-52575-0_24
Download citation
DOI: https://doi.org/10.1007/978-3-030-52575-0_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-52574-3
Online ISBN: 978-3-030-52575-0
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)