SourceVote: Fusing Multi-valued Data via Inter-source Agreements
Data fusion is a fundamental research problem of identifying true values of data items of interest from conflicting multi-sourced data. Although considerable research efforts have been conducted on this topic, existing approaches generally assume every data item has exactly one true value, which fails to reflect the real world where data items with multiple true values widely exist. In this paper, we propose a novel approach, SourceVote, to estimate value veracity for multi-valued data items. SourceVote models the endorsement relations among sources by quantifying their two-sided inter-source agreements. In particular, two graphs are constructed to model inter-source relations. Then two aspects of source reliability are derived from these graphs and are used for estimating value veracity and initializing existing data fusion methods. Empirical studies on two large real-world datasets demonstrate the effectiveness of our approach.
KeywordsData integration Data fusion Multi-valued data items Inter-source agreements
This work was supported in part (for the co-author Mahmoud Barhamgi) by the Justice Programme of the European Union (2014-2020) 723180, RiskTrack, under Grant JUST-2015-JCOO-AG and Grant JUST-2015-JCOO-AG-1.
- 3.Dong, X.L., et al.: Knowledge vault: a web-scale approach to probabilistic knowledge fusion. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2014), New York, USA (2014)Google Scholar
- 4.Galland, A., et al.: Corroborating information from disagreeing views. In: Proceedings of the Third ACM International Conference on Web Search and Data Mining (WSDM 2010), New York, USA (2010)Google Scholar
- 5.Gleich, D.F., et al.: Tracking the random surfer: empirically measured teleportation parameters in pagerank. In: Proceedings of the 19th International World Wide Web Conference (WWW 2010), Raleigh, NC, USA (2010)Google Scholar
- 9.Pasternack, J., Roth, D.: Knowing what to believe (when you already know something). In: Proceedings of the 23th International Conference on Computational Linguistics (COLING 2010), Stroudsburg, PA, USA (2010)Google Scholar
- 10.Waguih, D.A., Berti-Equille, L.: Truth discovery algorithms: an experimental evaluation. arXiv preprint (2014). arXiv:1409.6428
- 11.Wang, X., et al.: An integrated Bayesian approach for effective multi-truth discovery. In: Proceedings of the 24th ACM International Conference on Information and Knowledge Management (CIKM 2015), Melbourne, Australia (2015)Google Scholar
- 12.Wang, X., et al.: Empowering truth discovery with multi-truth prediction. In: Proceedings of the 25th ACM International Conference on Information and Knowledge Management (CIKM 2016), pp. 881–890 (2016)Google Scholar
- 13.Wang, X., et al.: Truth discovery via exploiting implications from multi-source data. In: Proceedings of the 25th ACM International Conference on Information and Knowledge Management (CIKM 2016), pp. 861–870 (2016)Google Scholar
- 14.Yin, X., et al.: Truth discovery with multiple conflicting information providers on the web. In: Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2007), San Jose, California, USA (2007)Google Scholar