Multi-Instance Learning from Positive and Unlabeled Bags

  • Jia Wu
  • Xingquan Zhu
  • Chengqi Zhang
  • Zhihua Cai
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8443)


Many methods exist to solve multi-instance learning by using different mechanisms, but all these methods require that both positive and negative bags are provided for learning. In reality, applications may only have positive samples to describe users’ learning interests and remaining samples are unlabeled (which may be positive, negative, or irrelevant to the underlying learning task). In this paper, we formulate this problem as positive and unlabeled multi-instance learning (puMIL). The main challenge of puMIL is to accurately identify negative bags for training discriminative classification models. To solve the challenge, we assign a weight value to each bag, and use an Artificial Immune System based self-adaptive process to select most reliable negative bags in each iteration. For each bag, a most positive instance (for a positive bag) or a least negative instance (for an identified negative bag) is selected to form a positive margin pool (PMP). A weighted kernel function is used to calculate pairwise distances between instances in the PMP, with the distance matrix being used to learn a support vector machines classifier. A test bag is classified as positive if one or multiple instances inside the bag are classified as positive, and negative otherwise. Experiments on real-world data demonstrate the algorithm performance.


Multi-instance learning unlabeled bags classification 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Dietterich, T., Lathrop, R., Lozano-Pérez, T.: Solving the multiple instance problem with axis-parallel rectangles. Artif. Intell. 89, 31–71 (1997)CrossRefzbMATHGoogle Scholar
  2. 2.
    Zhou, Z., Zhang, M., Huang, S., Li, Y.: Multi-instance multi-label learning. Artificial Intelligence 176, 2291–2320 (2012)CrossRefzbMATHMathSciNetGoogle Scholar
  3. 3.
    Qi, X., Han, Y.: Incorporating multiple SVMs for automatic image annotation. Pattern Recogn. 40, 728–741 (2007)CrossRefzbMATHGoogle Scholar
  4. 4.
    Zhang, B., Zuo, W.: Learning from positive and unlabeled examples: A survey. In: ISIP, pp. 650–654 (2008)Google Scholar
  5. 5.
    Liu, B., Dai, Y., Li, X., Lee, W.S., Yu, P.S.: Building text classifiers using positive and unlabeled examples. In: ICDM, Washington, DC, USA, p. 179 (2003)Google Scholar
  6. 6.
    Andrews, S., Tsochantaridis, I., Hofmann, T.: Support vector machines for multiple-instance learning. In: NIPS, pp. 561–568 (2003)Google Scholar
  7. 7.
    Shang, R., Jiao, L., Liu, F., Ma, W.: A novel immune clonal algorithm for mo problems. IEEE Trans. Evol. Comput. 16(1), 35–50 (2012)CrossRefGoogle Scholar
  8. 8.
    Fu, Z., Robles-Kelly, A., Zhou, J.: Milis: Multiple instance learning with instance selection. IEEE Trans. Pattern Anal. Mach. Intell. 33(5), 958–977 (2011)CrossRefGoogle Scholar
  9. 9.
    Zhong, Y., Zhang, L.: An adaptive artificial immune network for supervised classification of multi-/hyperspectral remote sensing imagery. IEEE Trans. Geosci. Remote Sens. 50(3), 894–909 (2012)CrossRefGoogle Scholar
  10. 10.
    Ray, S., Craven, M.: Supervised versus multiple instance learning: an empirical comparison. In: ICML, New York, NY, USA, pp. 697–704 (2005)Google Scholar
  11. 11.
    Zhao, Y., Kong, X., Yu, P.S.: Positive and unlabeled learning for graph classification. In: ICDM, pp. 962–971 (2011)Google Scholar
  12. 12.
    Friedman, N., Geiger, D., Goldszmidt, M.: Bayesian network classifiers. Mach. Learn. 29(2-3), 131–163 (1997)CrossRefzbMATHGoogle Scholar
  13. 13.
    Tang, J., Zhang, J., Yao, L., Li, J., Zhang, L., Su, Z.: Arnetminer: extraction and mining of academic social networks. In: KDD, pp. 990–998 (2008)Google Scholar
  14. 14.
    He, J., Gu, H., Wang, Z.: Bayesian multi-instance multi-label learning using gaussian process prior. Mach. Learn. 88(1-2), 273–295 (2012)CrossRefzbMATHMathSciNetGoogle Scholar
  15. 15.
    Li, J., Wang, J.Z.: Real-time computerized annotation of pictures. IEEE Trans. Pattern Anal. Mach. Intell. 30(6), 985–1002 (2008)CrossRefGoogle Scholar
  16. 16.
    Carson, C., Thomas, M., Belongie, S., Hellerstein, J.M., Malik, J.: Blobworld: A system for region-based image indexing and retrieval. In: Huijsmans, D.P., Smeulders, A.W.M. (eds.) VISUAL 1999. LNCS, vol. 1614, pp. 509–517. Springer, Heidelberg (1999)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Jia Wu
    • 1
    • 3
  • Xingquan Zhu
    • 2
  • Chengqi Zhang
    • 1
  • Zhihua Cai
    • 3
  1. 1.Centre for Quantum Computation & Intelligent Systems, FEITUniversity of Technology SydneyAustralia
  2. 2.Dept. of Computer & Electrical Engineering and Computer ScienceFlorida Atlantic UniversityBoca RatonUSA
  3. 3.Dept. of Computer ScienceChina University of GeosciencesWuhanChina

Personalised recommendations