Object Segmentation Using Multiple Neural Networks for Commercial Offers Visual Search

Conference paper
Part of the IFIP Advances in Information and Communication Technology book series (IFIPAICT, volume 363)


We describe a web application that takes advantage of new computer vision techniques to allow the user to make searches based on visual similarity of color and texture related to the object of interest. We use a supervised neural network strategy to segment different classes of objects. A strength of this solution is the high speed in generalization of the trained neural networks, in order to obtain an object segmentation in real time. Information about the segmented object, such as color and texture, are extracted and indexed as text descriptions. Our case study is the online commercial offers domain where each offer is composed by text and images. Many successful experiments were done on real datasets in the fashion field.


visual object segmentation visual search multiple neural networks 


  1. 1.
    Wang, J.Z., Li, J., Wiederhold, G.: Simplicity: Semantics-sensitive integrated matching for picture libraries. IEEE Trans. Pattern Anal. Mach. Intell. 23, 947–963 (2001)CrossRefGoogle Scholar
  2. 2.
    Liu, Y., Zhang, D., Lu, G., Ma, W.Y.: A survey of content-based image retrieval with high-level semantics. Pattern Recognition 40, 262–282 (2007)zbMATHCrossRefGoogle Scholar
  3. 3.
    Skopal, T.: Where are you heading, metric access methods?: a provocative survey. In: Proc. of SISAP 2010, pp. 13–21. ACM, New York (2010)Google Scholar
  4. 4.
    Cortes, C., Vapnik, V.: Support vector networks. Machine Learning 20, 273–297 (1995)zbMATHGoogle Scholar
  5. 5.
    Gallo, I., Nodari, A.: Learning object detection using multiple neural netwoks. In: VISAP 2011. INSTICC Press (2011)Google Scholar
  6. 6.
    Riedmiller, M., Braun, H.: A direct adaptive method for faster backpropagation learning: The rprop algorithm. In: IEEE Conf. on Neural Networks, pp. 586–591 (1993)Google Scholar
  7. 7.
    Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proc. CVPR, pp. 886–893 (2005)Google Scholar
  8. 8.
    Nodari, A., Gallo, I., Cavallaro, A.: Real time color image indexing using a textual approach. Submitted to ICIP 2011 (2011)Google Scholar
  9. 9.
    Everingham, M., Van Gool, L., et al.: The pascal visual object classes (voc) challenge. International Journal of Computer Vision 88, 303–338 (2010)CrossRefGoogle Scholar
  10. 10.
    Pedoia, V., Colli, V., et al.: fMRI analysis software tools: an evaluation framework. In: SPIE Medical Imaging 2011 (2011)Google Scholar
  11. 11.
    Landis, J.R., Koch, G.G.: The measurement of observer agreement for categorical data. Biometrics 33, 159–174 (1977)MathSciNetzbMATHCrossRefGoogle Scholar

Copyright information

© International Federation for Information Processing 2011

Authors and Affiliations

  1. 1.Dipartimento di Informatica e ComunicazioneUniversity of InsubriaVareseItaly

Personalised recommendations