Image Recognition Model over Augmented Reality Based on Convolutional Neural Networks Through Color-Space Segmentation

  • Andrés Ovidio Restrepo-RodríguezEmail author
  • Daniel Esteban Casas-MateusEmail author
  • Paulo Alonso Gaona-GarcíaEmail author
  • Carlos Enrique Montenegro-MarínEmail author
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 943)


Currently the image recognition and classification implementing Convolutional Neural Networks is highly used, where one of the most important factors is the identification and extraction of characteristics, events, among other aspects; but in many situations this task is left only in charge of the neural network, without establish and apply a previous phase of image processing that facilitates the identification of patterns. This can cause errors at the time of image recognition, which in critical mission scenarios such as medical evaluations can be highly sensitive. The purpose of this paper is to implement a prediction model based on convolutional neural networks for geometric figures classification, applying a previous phase of color-space segmentation as image processing method to the test dataset. For this, it will be carried out the approach, development and testing of a scenario focused on the image acquisition, processing and recognition using an AR-Sandbox and data analysis tools. Finally, the results, conclusions and future works are presented.


Image acquisition Image processing Image recognition Convolutional neural network Dataset Loss function Accuracy ROC curve AR-SANDBOX 


  1. 1.
    Rosyadi, H., Çevik, G.: Augmented reality sandbox (AR sandbox) experimental landscape for fluvial, deltaic and volcano morphology and topography models (2016)Google Scholar
  2. 2.
    Neha, S., Vibhor, J., Anju, M.: An analysis of convolutional neural networks for image classification. Procedia Comput. Sci. 132, 377–384 (2018)CrossRefGoogle Scholar
  3. 3.
    Niioka, H., Asatani, S., Yoshimura, A., Ohigashi, H., Tagawa, S., Miyake, J.: Classification of C2C12 cells at differentiation by convolutional neural network of deep learning using phase contrast images. Hum. Cell 31, 87–93 (2018)CrossRefGoogle Scholar
  4. 4.
    Zhang, C., et al.: White blood cell segmentation by color-space-based K-means clustering. Sensors 14(9), 16128–16147 (2014)CrossRefGoogle Scholar
  5. 5.
    Lee, K., Lee, J., Lee, J., Hwang, S., Lee, S.: Brightness-based convolutional neural network for thermal image enhancement. IEEE Access 5, 26867–26879 (2017)CrossRefGoogle Scholar
  6. 6.
    Yao, C., Zhang, Y., Liu, H.: Application of convolutional neural network in classification of high resolution agricultural remote sensing images. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. (2017)Google Scholar
  7. 7.
    Wald, N.J., Bestwick, J.P.: Is the area under an ROC curve a valid measure of the performance of a screening or diagnostic test? J. Med. Screen. 21, 51–56 (2014)CrossRefGoogle Scholar
  8. 8.
    Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Computer Vision Foundation (2015)Google Scholar
  9. 9.
    Shi, W., Caballero, J., Husz, F., Totz, J., Aitken, A.: Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In: Computer Vision Foundation (2015)Google Scholar
  10. 10.
    Giorgis, S., Mahlen, N., Anne, K.: Instructor-led approach to integrating an augmented reality sandbox into a large-enrollment introductory geoscience course for nonmajors produces no gains. J. Geosci. Educ. 65, 283–291 (2017)CrossRefGoogle Scholar
  11. 11.
    Woods, T., Reed, S., His, S., Woods, J., Woods, M.: Pilot study using the augmented reality sandbox to teach topographic maps and surficial processes in introductory geology labs. J. Geosci. Educ. 64, 199–214 (2016)CrossRefGoogle Scholar
  12. 12.
    Restrepo Rodríguez, A.O., Casas Mateus, D.E., García, G., Alonso, P., Montenegro Marín, C.E., González Crespo, R.: Hyperparameter optimization for image recognition over an AR-sandbox based on convolutional neural networks applying a previous phase of segmentation by color–space. Symmetry 10, 743 (2018). Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Universidad Distrital Francisco José de CaldasBogotáColombia

Personalised recommendations