Robust classification of graph-based data
- 89 Downloads
A graph-based classification method is proposed for both semi-supervised learning in the case of Euclidean data and classification in the case of graph data. Our manifold learning technique is based on a convex optimization problem involving a convex quadratic regularization term and a concave quadratic loss function with a trade-off parameter carefully chosen so that the objective function remains convex. As shown empirically, the advantage of considering a concave loss function is that the learning problem becomes more robust in the presence of noisy labels. Furthermore, the loss function considered here is then more similar to a classification loss while several other methods treat graph-based classification problems as regression problems.
KeywordsClassification Graph data Semi-supervised learning
The authors would like to thank the following organizations. EU: The research leading to these results has received funding from the European Research Council under the European Union’s Seventh Framework Programme (FP7/2007-2013) / ERC AdG A-DATADRIVE-B (290923). This paper reflects only the authors’ views, the Union is not liable for any use that may be made of the contained information. Research Council KUL: GOA/10/09 MaNet, CoE PFV/10/002 (OPTEC), BIL12/11T; Ph.D./Postdoc Grants. Flemish Government: FWO: G.0377.12 (Structured systems), G.088114N (Tensor based data similarity); Ph.D./Postdoc Grants. IWT: SBO POM (100031); Ph.D./Postdoc Grants. iMinds Medical Information Technologies SBO 2014. Belgian Federal Science Policy Office: IUAP P7/19 (DYSCO, Dynamical systems, control and optimization, 2012–2017). Fundación BBVA: project FACIL–Ayudas Fundación BBVA a Equipos de Investigación Científica 2016. UAM–ADIC Chair for Data Science and Machine Learning. Concerted Research Action (ARC) programme supported by the Federation Wallonia-Brussels (contract ARC 14/19-060 on Mining and Optimization of Big Data Models).
- Adamic LA, Glance N (2005) The political blogosphere and the 2004 U.S. election: divided they blog. In: Proceedings of the 3rd international workshop on link discovery, ACM, New York, NY, USA, LinkKDD’05, pp 36–43Google Scholar
- Chapelle O, Schölkopf B, Zien A (2010) Semi-supervised learning, 1st edn. The MIT Press, CambridgeGoogle Scholar
- Gleich DF, Mahoney MW (2015) Using local spectral methods to robustify graph-based learning algorithms. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining, ACM, New York, NY, USA, KDD’15, pp 359–368Google Scholar
- Joachims T (2003) Transductive learning via spectral graphpartitioning. In: Proceedings of the 20th international conference on international conference on machine learning, AAAI Press, ICML’03, pp 290–297Google Scholar
- Natarajan N, Dhillon IS, Ravikumar PK, Tewari A (2013) Learning with noisy labels. In: Advances in neural information processing systems, MIT Press, pp 1196–1204Google Scholar
- Vahdat A (2017) Toward robustness against label noise in trainingdeep discriminative neural networks. In: Advances in neural information processing systems, MIT Press, pp 5596–5605Google Scholar
- Yang Z, Cohen W, Salakhudinov R (2016) Revisiting semi-supervised learning with graph embeddings. In: International conference on machine learning, pp 40–48Google Scholar
- Zhou D, Bousquet O, Lal TN, Weston J, Schölkopf B (2004) Learning with local and global consistency. In: Advances in neural information processing systems, MIT Press, pp 321–328Google Scholar
- Zhou X, Belkin M, Srebro N (2011) An iterated graph laplacian approach for ranking on manifolds. In: Proceedings of the 17th ACM SIGKDD international conference on knowledge discovery and data mining, ACM, KDD’11, pp 877–885Google Scholar
- Zhu X, Ghahramani Z, Lafferty JD (2003) Semi-supervised learning using Gaussian fields and harmonic functions. In: Proceedings of the 20th international conference on international conference on machine learning, AAAI Press, ICML’03, pp 912–919Google Scholar