Faster Algorithm for Truth Discovery via Range Cover
Truth discovery is a key problem in data analytics which has received a great deal of attention in recent years. In this problem, we seek to obtain trustworthy information from data aggregated from multiple (possibly) unreliable sources. Most of the existing approaches for this problem are of heuristic nature and do not provide any quality guarantee. Very recently, the first quality-guaranteed algorithm has been discovered. However, the running time of the algorithm depends on the spread ratio of the input points and is fully polynomial only when the spread ratio is relatively small. This could severely restrict the applicability of the algorithm. To resolve this issue, we propose in this paper a new algorithm which yields a \((1+\epsilon )\)-approximation in near quadratic time for any dataset with constant probability. Our algorithm relies on a data structure called range cover, which is interesting in its own right. The data structure provides a general approach for solving some high dimensional optimization problems by breaking them down into a small number of parametrized cases.
Unable to display preview. Download preview PDF.
- 1.Ding, H., Gao, J., Xu, J.: Finding Global Optimum for Truth Discovery: Entropy Based Geometric Variance. In: Leibniz International Proceedings in Informatics (LIPIcs), 32nd International Symposium on Computational Geometry (SoCG 2016), vol. 51, 34: 1–34: 16(2016)Google Scholar
- 2.Ding, H., Xu, J.: A Unified Framework for Clustering Constrained Data without Locality Property. In: Proceedings of ACM-SIAM Symposium on Discrete Algorithms (SODA 2015), pp. January 4–6, San Diego, California, USA, 1471–1490 (2015)Google Scholar
- 3.Dong, X.L., Berti-Equille, L., Srivastava, D.: Integrating conflicting data: The role of source dependence. PVLDB 2(1), 550–561 (2009)Google Scholar
- 4.Li, Y., Gao, J., Meng, C., Li, Q., Su, L., Zhao, B., Fan, W., Han, J.: A Survey on Truth Discovery. CoRR abs/1505.02463 (2015)Google Scholar
- 5.Har-Peled, S.: Geometric approximation algorithms, vol. 173. American mathematical society, Boston (2011)Google Scholar
- 6.Li, H., Zhao, B., Fuxman, A.: The Wisdom of Minority: Discovering And Targeting The Right Group of Workers for Crowdsourcing. In: Proc. of the International Conference on World Wide Web (WWW 2014), pp. 165–176 (2014)Google Scholar
- 7.Li, Q., Li, Y., Gao, J., Su, L., Zhao, B., Demirbas, M., Fan, W., Han, J.: A Confidence- Aware Approach for Truth Discovery on Long-Tail Data. PVLDB 8(4), 425–436 (2014)Google Scholar
- 8.Li, Q., Li, Y., Gao, J., Zhao, B., Fan, W., Han, J.: Resolving Conflicts in Heterogeneous Data by Truth Discovery and Source Reliability Estimation. In: Proc. the 2014 ACM SIGMOD International Conference on Management of Data (SIGMOD 2014), pp. 1187–1198 (2014)Google Scholar
- 9.Pasternack, J., Roth, D.: Knowing what to believe (when you already know something). In: Proc. of the International Conference on Computational Linguistics (COLING 2010), pp. 877–885 (2010)Google Scholar
- 10.Whitehill, J., Ruvolo, P., Wu, T., Bergsma, J., Movellan, J.: Whose Vote Should Count More: Optimal Integration of Labelers of Unknown Expertise. In: Advances in Neural Information Processing Systems (NIPS 2009), pp. 2035–2043 (2009)Google Scholar
- 11.Yin, X., Han, J., Yu, P.S.: Truth discovery with multiple conflicting information providers on the web. In: Proc. of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2007), pp. 1048–1052 (2007)Google Scholar