Skip to main content

Multiple Instance Learning for Automatic Image Annotation

  • Conference paper
Book cover Advances in Multimedia Modeling

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7733))

Abstract

Most traditional approaches for automatic image annotation cannot provide reliable annotations at the object level because it could be very expensive to obtain large amounts of labeled object-level images associated to individual regions. To reduce the cost for manually annotating at the object level, multiple instance learning, which can leverage loosely-labeled training images for object classifier training, has become a popular research topic in the multimedia research community. One bottleneck for supporting multiple instance learning is the computational cost on searching and identifying positive instances in the positive bags. In this paper, a novel two-stage multiple instance learning algorithm is developed for automatic image annotation. The affinity propagation(AP) clustering technique is performed on the instances both in the positive bags and the negative bags to identify the candidates of the positive instances and initialize the maximum searching of Diverse Density likelihood in the first stage. In the second stage, the most positive instances are then selected out in each bag to simply the computing procedure of Diverse Density likelihood. Our experiments on two well-known image sets have provided very positive results.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Andrews, S., Tsochantaridis, I., Hofmann, T.: Support vector machines for multiple-instance learning. In: Advances in Neural Information Processing Systems, vol. 15, pp. 561–568 (2002)

    Google Scholar 

  2. Chen, Y., Bi, J., Wang, J.: Miles: Multiple-instance learning via embedded instance selection. PAMI 28(12), 1931–1947 (2006)

    Article  Google Scholar 

  3. Chua, T.-S., Tang, J., Hong, R., Li, H., Luo, Z., Zheng, Y.: Nus-wide: a real-world web image database from national university of singapore. In: CIVR, pp. 48:1–48:9. ACM (2009)

    Google Scholar 

  4. Deng, Y., Manjunath, B., Shin, H.: Color image segmentation. In: CVPR, vol. 2. IEEE (1999)

    Google Scholar 

  5. Dietterich, T., Lathrop, R., Lozano-Pérez, T.: Solving the multiple instance problem with axis-parallel rectangles. Artificial Intelligence 89(1-2), 31–71 (1997)

    Article  Google Scholar 

  6. Frey, B., Dueck, D.: Clustering by passing messages between data points. Science 315(5814), 972 (2007)

    Article  MathSciNet  Google Scholar 

  7. Lew, M., Sebe, N., Djeraba, C., Jain, R.: Content-based multimedia information retrieval: State of the art and challenges. TOMCCAP 2(1), 1–19 (2006)

    Article  Google Scholar 

  8. Liu, S., Yan, S., Zhang, T., Xu, C., Liu, J., Lu, H.: Weakly supervised graph propagation towards collective image parsing. IEEE Transactions on Multimedia 14(2), 361–373 (2012)

    Article  Google Scholar 

  9. Maron, O., Lozano-Pérez, T.: A framework for multiple-instance learning. In: Advances in Neural Information Processing Systems, pp. 570–576 (1998)

    Google Scholar 

  10. Qi, G., Hua, X., Rui, Y., Mei, T., Tang, J., Zhang, H.: Concurrent multiple instance learning for image categorization. In: CVPR, pp. 1–8. IEEE (2007)

    Google Scholar 

  11. Qiu, G.: Indexing chromatic and achromatic patterns for content-based colour image retrieval. Pattern Recognition 35(8), 1675–1686 (2002)

    Article  Google Scholar 

  12. Shen, Y., Fan, J.: Leveraging loosely-tagged images and inter-object correlations for tag recommendation. In: MM, pp. 5–14. ACM (2010)

    Google Scholar 

  13. Tang, J., Hong, R., Yan, S., Chua, T., Qi, G., Jain, R.: Image annotation by k nn-sparse graph-based label propagation over noisily tagged web images. ACM Transactions on Intelligent Systems and Technology 2(2), 14 (2011)

    Article  Google Scholar 

  14. Vijayanarasimhan, S., Grauman, K.: Keywords to visual categories: Multiple-instance learning forweakly supervised object categorization. In: CVPR, pp. 1–8. IEEE (2008)

    Google Scholar 

  15. Viola, P., Platt, J., Zhang, C.: Multiple instance boosting for object detection. In: Advances in Neural Information Processing Systems, vol. 18, p. 1417 (2006)

    Google Scholar 

  16. Wang, D., Li, J., Zhang, B.: Multiple-Instance Learning Via Random Walk. In: Fürnkranz, J., Scheffer, T., Spiliopoulou, M. (eds.) ECML 2006. LNCS (LNAI), vol. 4212, pp. 473–484. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  17. Wang, J., Zucker, J.: Solving multiple-instance problem: A lazy learning approach (2000)

    Google Scholar 

  18. Yang, J., Yan, R., Hauptmann, A.: Multiple instance learning for labeling faces in broadcasting news video. In: MM, pp. 31–40. ACM (2005)

    Google Scholar 

  19. Zhang, Q., Goldman, S.: Em-dd: An improved multiple-instance learning technique. In: Advances in Neural Information Processing Systems, vol. 14, pp. 1073–1080 (2001)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Xia, Z., Peng, J., Feng, X., Fan, J. (2013). Multiple Instance Learning for Automatic Image Annotation. In: Li, S., et al. Advances in Multimedia Modeling. Lecture Notes in Computer Science, vol 7733. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35728-2_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-35728-2_19

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-35727-5

  • Online ISBN: 978-3-642-35728-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics