Embedded Real-Time Visual Search with Visual Distance Estimation

  • Marco ParacchiniEmail author
  • Emanuele Plebani
  • Mehdi Ben Iche
  • Danilo Pietro Pau
  • Marco Marcon
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10485)


Visual Search algorithms are a class of methods that retrieve images by their content. In particular, given a database of reference images and a query image the goal is to find an image among the database that depicts the same object as in the query, if any. Moreover, in many different real case applications more than one object of interest could be viewed in the query image. Furthermore, in this kind of situations, often, it is not sufficient to identify the object depicted on a query image but its precise localization inside the scene viewed by the camera is also requested. In this paper we propose to couple a Visual Search system, which can retrieve multiple objects from the same query image, with an additional Distance Estimation module that exploits the localization information already computed inside the Visual Search stage to estimate localization of the object in three dimensions. In this work we implement the complete image retrieval and spatial localization pipeline (including relative distance estimation) on two different embedded devices, exploiting also their GPU in order to get near real time performances on low-power devices. Lastly, the accuracy of the proposed distance estimation is evaluated on a dataset of annotated query-reference pairs ad-hoc created.


Visual Search CBIR LoG SIFT Distance estimation 



This work was supported in part by the H2020 European project COSSIM.


  1. 1.
    Gill, H.: Cyber-physical systems: beyond ES, SNs, SCADA. In: Presentation in the Trusted Computing in Embedded Systems (TCES) Workshop (2010)Google Scholar
  2. 2.
    Niblack, W.C., Barber, R., Equitz, W., Flickner, M.D., Glasman, E.H., Petkovic, D., Yanker, P., Faloutsos, C., Taubin, G.: The QBIC project: Querying images by content, using color, texture, and shape. In: Storage and Retrieval for Image and Video Databases (SPIE) (1994)Google Scholar
  3. 3.
    Pentland, A., Picard, R.W., Sclaroff, S.: Photobook: content-based manipulation of image databases. Int. J. Comput. Vis. 18(3), 233–254 (1996)CrossRefGoogle Scholar
  4. 4.
  5. 5.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRefGoogle Scholar
  6. 6.
    Pagani, A., Stricker, D.: Structure from motion using full spherical panoramic cameras. In: ICCV Workshops, pp. 375–382. IEEE (2011)Google Scholar
  7. 7.
    Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I.D., Leonard, J.J.: Simultaneous localization and mapping: present, future, and the robust-perception age. CoRR, vol. abs/1606.05830 (2016)Google Scholar
  8. 8.
    Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, New York (2003)zbMATHGoogle Scholar
  9. 9.
    Paracchini, M., Marcon, M., Plebani, E., Pau, D.P.: Visual search of multiple objects from a single query. In: 2016 IEEE 6th International Conference on Consumer Electronics-Berlin (ICCE-Berlin), Berlin, Germany, pp. 41–45. IEEE (2016)Google Scholar
  10. 10.
    Haralick, R.M., Shapiro, L.G.: Computer and Robot Vision. Addison-Wesley Longman Publishing Co. Inc, Boston (1992)Google Scholar
  11. 11.
    Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698 (1986)CrossRefGoogle Scholar
  12. 12.
    Plebani, E., Buzzella, A., Pau, D.P., Marcon, M.: Mixing retrieval and tracking using compact visual descriptors. In: 2013 IEEE 3rd International Conference on Consumer Electronics-Berlin (ICCE-Berlin), Berlin, Germany. IEEE (2013)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Marco Paracchini
    • 1
    Email author
  • Emanuele Plebani
    • 2
  • Mehdi Ben Iche
    • 2
  • Danilo Pietro Pau
    • 2
  • Marco Marcon
    • 1
  1. 1.DEIB - Dipartimento di Elettronica, Informazione e BioingegneriaPolitecnico di MilanoMilanItaly
  2. 2.Advanced System TechnologySTMicroelectronicsAgrate BrianzaItaly

Personalised recommendations