Abstract
Attributed graphs are used to represent patterns composed of several parts in pattern recognition. The nature of these patterns can be diverse, from images, to handwritten characters, maps or fingerprints. Graph edit distance has become an important tool in structural pattern recognition since it allows us to measure the dissimilarity of attributed graphs. It is based on transforming one graph into another through some edit operations such as substitution, deletion and insertion of nodes and edges. It has two main constraints: it requires an adequate definition of the costs of these operations and its computation cost is exponential with regard to the number of nodes. In this paper, we first present a general framework to automatically learn these edit costs considering graph edit distance is computed in a sub-optima way. Then, we specify this framework in two different models based on neural networks and probability density functions. An exhaustive practical validation on 14 public databases, which have different features such as the size of the graphs, the number of attributes or the number of graphs per class have been performed. This validation shows that with the learned edit costs, the accuracy is higher than with some manually imposed costs or other costs automatically learned by previous methods.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Abu-Aisheh Z, Raveaux R, Ramel J (2016) Anytime graph matching. Pattern Recognit Lett 84:215–224
Algabli S, Serratosa F (2018) Embedding the node-to-node mappings to learn the graph edit distance parameters. Pattern Recognit Lett 112:353–360
Bongini M, Rigutini L, Trentin E (2018) Recursive neural networks for density estimation over generalized random graphs. IEEE Trans Neural Netw Learn Syst 29(11):5441–5458. https://doi.org/10.1109/TNNLS.2018.2803523
Bougleux S, Brun L, Carletti V, Foggia P, Gaüzère B, Vento M (2017) Graph edit distance as a quadratic assignment problem. Pattern Recognit Lett 87:38–46
Bunke H, Allermann G (1983) Inexact graph matching for structural pattern recognition. Pattern Recognit Lett 1(4):245–253. https://doi.org/10.1016/0167-8655(83)90033-8
Caelli T, Kosinov S (2004) An eigenspace projection clustering method for inexact graph matching. IEEE Trans Pattern Anal Mach Intell 26(4):515–519
Caetano TS, McAuley JJ, Cheng L, Le QV, Smola AJ (2009) Learning graph matching. IEEE Trans Pattern Anal Mach Intell 31(6):1048–1058
Conte D, Foggia P, Sansone C, Vento M (2004) Thirty years of graph matching in pattern recognition. Int J Pattern Recognit Artif Intell 18(03):265–298
Cortés X, Serratosa F (2015) An interactive method for the image alignment problem based on partially supervised correspondence. Expert Syst Appl 42(1):179–192
Cortés X, Serratosa F (2015) Learning graph-matching edit-costs based on the optimality of the oracle’s node correspondences. Pattern Recognit Lett 56:22–29
Cortés X, Serratosa F (2016) Cooperative pose estimation of a fleet of robots based on interactive points alignment. Expert Syst Appl 45:150–160
Cortés X, Serratosa F (2016) Learning graph matching substitution weights based on the ground truth node correspondence. Int J Pattern Recognit Artif Intell 30(02):1650005
Cortés X, Serratosa F, Riesen K (2016) On the relevance of local neighbourhoods for greedy graph edit distance. In: S+SSPR, lecture notes in computer science, vol 10029, pp 121–131
Defferrard M, Bresson X, Vandergheynst P (2016) Convolutional neural networks on graphs with fast localized spectral filtering. In: NIPS, pp 3837–3845
Duin RPW, Pekalska E (2011) The dissimilarity representation for structural pattern recognition. In: CIARP, lecture notes in computer science, vol 7042. Springer, pp 1–24
Dunn JC (1974) Well-separated clusters and optimal fuzzy partitions. J Cybern 4(1):95–104. https://doi.org/10.1080/01969727408546059
Ferrer M, Serratosa F, Riesen K (2015) Improving bipartite graph matching by assessing the assignment confidence. Pattern Recognit Lett 65:29–36
Foggia P, Percannella G, Vento M (2014) Graph matching and learning in pattern recognition in the last 10 years. Int J Pattern Recognit Artif Intell 28(01):1450001
Gao X, Xiao B, Tao D, Li X (2010) A survey of graph edit distance. Pattern Anal Appl 13(1):113–129. https://doi.org/10.1007/s10044-008-0141-y
Garey MR, Johnson DS (1990) Computers and intractability; a guide to the theory of NP-completeness. W. H. Freeman & Co., New York
Gibert J, Valveny E, Bunke H (2012) Graph embedding in vector spaces by node attribute statistics. Pattern Recognit 45(9):3072–3083
Gold S, Rangarajan A (1996) A graduated assignment algorithm for graph matching. IEEE Trans Pattern Anal Mach Intell 18(4):377–388. https://doi.org/10.1109/34.491619
Hart PE, Nilsson NJ, Raphael B (1968) A formal basis for the heuristic determination of minimum cost paths. IEEE Trans Syst Sci Cybern 4(2):100–107. https://doi.org/10.1109/TSSC.1968.300136
Leordeanu M, Sukthankar R, Hebert M (2012) Unsupervised learning for graph matching. Int J Comput Vis 96(1):28–45
Livi L, Rizzi A (2013) The graph matching problem. Pattern Anal Appl 16(3):253–283
Luqman MM, Ramel JY, Lladós J, Brouard T (2013) Fuzzy multilevel graph embedding. Pattern Recognit 46(2):551–565. https://doi.org/10.1016/j.patcog.2012.07.029
Moreno-García Carlos Francisco CX, Serratosa F (2016) A graph repository for learning error-tolerant graph matching. In: Syntactic and structural pattern recognition
Myers R, Wilson RC, Hancock ER (2000) Bayesian graph edit distance. IEEE Trans Pattern Anal Mach Intell 22(6):628–635. https://doi.org/10.1109/34.862201
Neuhaus M, Bunke H (2005) Self-organizing maps for learning the edit costs in graph matching. IEEE Trans Syst Man Cybern Part B (Cybern) 35(3):503–514
Neuhaus M, Bunke H (2007) Automatic learning of cost functions for graph edit distance. Inf Sci 177(1):239–247
Riesen K (2015) Structural pattern recognition with graph edit distance. Advances in computer vision and pattern recognition. Springer, Cham
Riesen K, Bunke H (2009) Approximate graph edit distance computation by means of bipartite graph matching. Image Vis Comput 27(7):950–959
Riesen K, Ferrer M, Dornberger R, Bunke H (2015) Greedy graph edit distance. In: Proceedings of the 11th international conference on machine learning and data mining in pattern recognition—vol 9166, MLDM 2015. Springer, Berlin, pp 3–16. https://doi.org/10.1007/978-3-319-21024-7_1
Riesen K, Fischer A, Bunke H (2018) On the impact of using utilities rather than costs for graph matching. Neural Process Lett 48(2):691–707. https://doi.org/10.1007/s11063-017-9739-7
Sanfeliu A, Alquézar R, Andrade J, Climent J, Serratosa F, Vergés-Llahí J (2002) Graph-based representations and techniques for image processing and image analysis. Pattern Recognit 35:639–650
Sanfeliu A, Fu KS (1983) A distance measure between attributed relational graphs for pattern recognition. IEEE Trans Syst Man Cybern. https://doi.org/10.1109/TSMC.1983.6313167
Santacruz P, Serratosa F (2018) Error-tolerant graph matching in linear computational cost using an initial small partial matching. Pattern Recognit Lett. https://doi.org/10.1016/j.patrec.2018.04.003
Santacruz P, Serratosa F (2018) Learning the sub-optimal graph edit distance edit costs based on an embedded model. In: S+SSPR, lecture notes in computer science, vol 11004. Springer, pp 282–292
Serratosa F (2014) Fast computation of bipartite graph matching. Pattern Recognit Lett 45:244–250
Serratosa F (2014) Speeding up fast bipartite graph matching through a new cost matrix. Int J Pattern Recognit Artif Intell 29:1550010. https://doi.org/10.1142/S021800141550010X
Serratosa F (2015) Computation of graph edit distance: reasoning about optimality and speed-up. Image Vis Comput 40:38–48
Serratosa F (2015) Graph databases. http://deim.urv.cat/~francesc.serratosa/databases/
Serratosa F (2018) A methodology to generate attributed graphs with a bounded graph edit distance for graph-matching testing. IJPRAI 32(11):1850038
Serratosa F (2019) Graph edit distance: restrictions to be a metric. Pattern Recognit 90:250–256. https://doi.org/10.1016/j.patcog.2019.01.043
Serratosa F, Cortés X (2015) Graph edit distance: moving from global to local structure to solve the graph-matching problem. Pattern Recognit Lett 65:204–210
Solé-Ribalta A, Serratosa F, Sanfeliu A (2012) On the graph edit distance cost: properties and applications. IJPRAI 26(5):1260004
Trentin E, Di Iorio E (2018) Nonparametric small random networks for graph-structured pattern recognition. Neurocomputing 313:14–24. https://doi.org/10.1016/j.neucom.2018.05.095
Vento M (2015) A long trip in the charming world of graphs for pattern recognition. Pattern Recognit 48(2):291–301
Acknowledgements
This research is supported by the Spanish projects TIN2016-77836-C2-1-R and ColRobTransp MINECO DPI2016-78957-R AEI/FEDER EU; and also the European project AEROARMS, H2020-ICT-2014-1-644271.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Santacruz, P., Serratosa, F. Learning the Graph Edit Costs Based on a Learning Model Applied to Sub-optimal Graph Matching. Neural Process Lett 51, 881–904 (2020). https://doi.org/10.1007/s11063-019-10121-w
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11063-019-10121-w