Abstract
Entity Resolution (ER) is a crucial process in the field of data management and integration. The primary goal of ER is to identify different profiles (or records) that refer to the same real-world entity across databases. The challenging problem is that labeling a large sample of profiles can be very expensive and time-consuming. Active Machine Learning (ActiveML) addresses this issue by selecting the most representative or informative profiles pairs to be labeled. The informativeness is determined by the capacity to diminish the uncertainty of the model. Conversely, representativeness evaluates whether a selected instance effectively reflects the overall input patterns of unlabeled data. Traditional ActiveML techniques typically rely on one strategy, Which may severely restrict the performance of the ActiveML process and lead to slow convergence. Especially in ER problems with a lack of initial training data. In this paper, we overcame this issue by inventing an approach for balancing the two above strategies. The implemented solution named EBEES (Epsilon-based Balancing Exploration and Exploitation Strategy), Which contains two variations: Adaptive-\(\epsilon \) and \(\epsilon \)-decreasing. We evaluated the EBEES on twelve datasets. Comparing the EBEES strategy against the state-of-the-art methods, without an initial training data, showed an enhanced performance in terms of F1-score, model stability, and rapid convergence.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Availability of supporting data
Datastes are available from github.
Code availability
The code is available upon reasonable request.
References
Alexakis, T., Peppes, N., Demestichas, K., et al. (2022). A machine learning-based method for content verification in the e-commerce domain. Information, 13(3), 116. https://doi.org/10.3390/info13030116
Bahri, D., Jiang, H., Tay, Y., et al. (2022). Scarf: Self-supervised contrastive learning using random feature corruption. arXiv:2106.15147. https://doi.org/10.48550/ARXIV.2106.15147
Bianco, G. D., Galante, R., Goncalves, M. A., et al. (2015). A practical and effective sampling selection strategy for large scale deduplication. IEEE Transactions on Knowledge and Data Engineering, 27(9), 2305–2319. https://doi.org/10.1109/tkde.2015.2416734
Brunner, U., & Stockinger, K. (2020). Entity matching with transformer architectures - a step forward in data integration. OpenProceedings. https://doi.org/10.21256/ZHAW-19637
Chen, A., Yang, P., & Cheng, P. (2021). ACTSSD: social spammer detection based on active learning and co-training. The Journal of Supercomputing, 78(2), 2744–2771. https://doi.org/10.1007/s11227-021-03966-3
Chen, D., Lin, Y., Li, W., et al. (2020). Measuring and relieving the over-smoothing problem for graph neural networks from the topological view. Proceedings of the AAAI Conference on Artificial Intelligence, 34(04), 3438–3445. https://doi.org/10.1609/aaai.v34i04.5747
Chen, R., Shen, Y., & Zhang, D. (2021). GNEM: A generic one-to-set neural entity matching framework. In: Proceedings of the Web Conference 2021. ACM. https://doi.org/10.1145/3442381.3450119
Chen, Z., Chen, Q., Hou, B., et al. (2020). Towards interpretable and learnable risk analysis for entity resolution. In: Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data. ACM. https://doi.org/10.1145/3318464.3380572
Christen, P., Vatsalan, D., & Wang, Q. (2015). Efficient entity resolution with adaptive and interactive training data selection. In: 2015 IEEE International Conference on Data Mining. IEEE. https://doi.org/10.1109/icdm.2015.63
Christophides, V., Efthymiou, V., Palpanas, T., et al. (2021). An overview of end-to-end entity resolution for big data. ACM Computing Surveys, 53(6), 1–42. https://doi.org/10.1145/3418896
Dharavath, R., & Singh, A.K. (2015). Entity Resolution-Based Jaccard Similarity Coefficient for Heterogeneous Distributed Databases (pp. 497–507) Springer India. https://doi.org/10.1007/978-81-322-2517-1_48
Dong, X. L., & Rekatsinas, T. (2018). Data integration and machine learning. In: Proceedings of the 2018 International Conference on Management of Data. ACM. https://doi.org/10.1145/3183713.3197387
Fu, C., Han, X., He, J., et al. (2020). Hierarchical matching network for heterogeneous entity resolution. In: C. Bessiere (ed.) Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, IJCAI-20 (pp. 3665–3671). International Joint Conferences on Artificial Intelligence Organization. https://doi.org/10.24963/ijcai.2020/507. main track
Getoor, L., & Machanavajjhala, A. (2012). Entity resolution. Proceedings of the VLDB Endowment, 5(12), 2018–2019. https://doi.org/10.14778/2367502.2367564
Hand, D., & Christen, P. (2017). Using the f-measure for evaluating record linkage algorithms. Statistics and Computing, 28(3), 539–547. https://doi.org/10.1007/s11222-017-9746-6
Helgertz, J., Price, J., Wellington, J., et al. (2021). A new strategy for linking U.S. historical censuses: A case study for the IPUMS multigenerational longitudinal panel. Historical Methods: A Journal of Quantitative and Interdisciplinary History, 55(1), 12–29. https://doi.org/10.1080/01615440.2021.1985027
Hou, B., Chenm, Q., Shen, J., et al. (2019). Gradual machine learning for entity resolution. In: The World Wide Web Conference. ACM. https://doi.org/10.1145/3308558.3314121
Jain, A., Sarawagi, S., & Sen, P. (2021). Deep indexed active learning for matching heterogeneous entity representations. Proceedings of the VLDB Endowment, 15(1), 31–45. https://doi.org/10.14778/3485450.3485455
Jaro, M. A. (1989). Advances in record-linkage methodology as applied to matching the 1985 census of tampa, florida. Journal of the American Statistical Association, 84(406), 414–420. https://doi.org/10.1080/01621459.1989.10478785
Jurek, A., Hong, J., Chi, Y., et al. (2017). A novel ensemble learning approach to unsupervised record linkage. Information Systems, 71, 40–54. https://doi.org/10.1016/j.is.2017.06.006
Levenshtein, V. I. (1965). Binary codes capable of correcting deletions, insertions, and reversals. Soviet Physics Doklady, 10, 707–710. https://api.semanticscholar.org/CorpusID:60827152
Li, S., & Wu, H. (2023). Transformer-based denoising adversarial variational entity resolution. Journal of Intelligent Information Systems. https://doi.org/10.1007/s10844-022-00773-x
Li, Y., Li, J., Suhara, Y., et al. (2023). Effective entity matching with transformers. The VLDB Journal. https://doi.org/10.1007/s00778-023-00779-z
Meduri, V. V., Popa, L., Sen, P., et al. (2020). A comprehensive benchmark framework for active learning methods in entity matching. In: Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data. ACM. https://doi.org/10.1145/3318464.3380597
Mozafari, B., Sarkar, P., Franklin, M., et al. (2014). Scaling up crowd-sourcing to very large datasets. Proceedings of the VLDB Endowment, 8(2), 125–136. https://doi.org/10.14778/2735471.2735474
Mudgal, S., Li, H., Rekatsinas, T., et al. (2018). Deep learning for entity matching. In: Proceedings of the 2018 International Conference on Management of Data. ACM. https://doi.org/10.1145/3183713.3196926
Nafa, Y., Chen, Q., Chen, Z., et al. (2022). Active deep learning on entity resolution by risk sampling. Knowledge-Based Systems, 236, 107729. https://doi.org/10.1016/j.knosys.2021.107729
Niknam, M., Minaei-Bidgoli, B., & Dianat, R. (2021). The role of transitive closure in evaluating blocking methods for dirty entity resolution. Journal of Intelligent Information Systems, 58(3), 561–590. https://doi.org/10.1007/s10844-021-00676-3
Papadakis, G., Ioannou, E., Thanos, E., et al. (2021). The Four Generations of Entity Resolution. Springer International Publishing. https://doi.org/10.1007/978-3-031-01878-7
Papadakis, G., Kirielle, N., Christen, P., et al. (2023). A critical re-evaluation of benchmark datasets for (deep) learning-based matching algorithms. https://doi.org/10.48550/ARXIV.2307.01231
Peeters, R., & Bizer, C. (2021). Dual-objective fine-tuning of BERT for entity matching. Proceedings of the VLDB Endowment, 14(10), 1913–1921. https://doi.org/10.14778/3467861.3467878
Petrovski, P., & Bizer, C. (2020). Learning expressive linkage rules from sparse data. Semantic Web, 11(3), 549–567. https://doi.org/10.3233/sw-190356
Petrovski, P., Primpeli, A., Meusel, R., et al. (2017). The wdc gold standards for product feature extraction and matching. In: D. Bridge, H. Stuckenschmidt (eds.) E-Commerce and Web Technologies (pp. 73–86). Springer International Publishing. https://doi.org/10.1007/978-3-319-53676-7_6
Primpeli, A., Bizer, C., & Keuper, M. (2020). Unsupervised bootstrapping of active learning for entity resolution. In: The Semantic Web (pp. 215–231). Springer International Publishing. https://doi.org/10.1007/978-3-030-49461-2_13
Qian, K., Popa, L., & Sen, P. (2017). Active learning for large-scale entity resolution. In: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. ACM. https://doi.org/10.1145/3132847.3132949
Reyes-Galaviz, O. F., Pedrycz, W., He, Z., et al. (2017). A supervised gradient-based learning algorithm for optimized entity resolution. Data & Knowledge Engineering, 112, 106–129. https://doi.org/10.1016/j.datak.2017.10.004
Sarawagi, S., & Bhamidipaty, A. (2002). Interactive deduplication using active learning. In: Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining - KDD’02. ACM Press. https://doi.org/10.1145/775047.775087
Settles, B. (2012). Active Learning. Springer International Publishing. https://doi.org/10.1007/978-3-031-01560-1
Shannon, C. E. (1948). A mathematical theory of communication. The Bell System Technical Journal, 27(3), 379–423. https://doi.org/10.1002/j.1538-7305.1948.tb01338.x
Somepalli, G., Goldblum, M., Schwarzschild, A., et al. (2021). Saint: Improved neural networks for tabular data via row attention and contrastive pre-training. arXiv:2106.01342. https://doi.org/10.48550/ARXIV.2106.01342
Tejada, S., Knoblock, C. A., & Minton, S. (2002). Learning domain-independent string transformation weights for high accuracy object identification. In: Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining. ACM. https://doi.org/10.1145/775047.775099
Vieira, P. K. M., Lóscio, B. F., & Salgado, A. C. (2019). Incremental entity resolution process over query results for data integration systems. Journal of Intelligent Information Systems, 52(2), 451–471. https://doi.org/10.1007/s10844-019-00544-1
Wu, R., Chaba, S., Sawlani, S., et al. (2020). ZeroER: Entity resolution using zero labeled examples. In: Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data. ACM. https://doi.org/10.1145/3318464.3389743
Yan, Y., Meyles, S., Haghighi, A., et al. (2020). Entity matching in the wild: A consistent and versatile framework to unify data in industrial applications. In: Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data. ACM. https://doi.org/10.1145/3318464.3386143
Zhang, D., Guo, L., He, X., et al. (2018). A graph-theoretic fusion framework for unsupervised entity resolution. In: 2018 IEEE 34th International Conference on Data Engineering (ICDE). IEEE. https://doi.org/10.1109/icde.2018.00070
Funding
The authors did not receive any financial support for this study.
Author information
Authors and Affiliations
Contributions
The initial concept was jointly devised by J.M. and H.I. . J.M. developed the theory and executed the computational work. The analytical methods were authenticated by H.I. and T.H., while R.Y. oversaw and reviewed the research outcomes. All authors engaged in discussions about the results and collaborated on the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
Authors declare that they have no conflict of interest.
Competing interests
The authors declare no competing interests.
Consent for publication
All authors agree with the content and give explicit consent to submit.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Mourad, J., Hiba, T., Yassir, R. et al. ERABQS: entity resolution based on active machine learning and balancing query strategy. J Intell Inf Syst (2024). https://doi.org/10.1007/s10844-024-00853-0
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10844-024-00853-0