Abstract
We introduce a new approach to empirical evaluation of the accuracy of the select statement results produced by a relational approximate query engine. We emphasize the meaning of a similarity of approximate and exact outcomes of queries from the perspective of practical applicability of approximate query processing solutions. We propose how to design the similarity-based procedure that lets us compare approximate and exact versions of the results of complex queries. We not only offer a measure of the accuracy of query results, but also describe the results of research on users intuition regarding the properties of such a measure, as well as perception query results as similar. The study is supported by theoretical and empirical analyses of different similarity functions and the case study of the investigative analytics over data sets related to network intrusion detection.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Nambiar, R.O., Poess, M.: The making of TPC-DS. In: Proceedings of 32nd International Conference on Very Large Data Bases, VLDB Endowment, pp. 1049–1058 (2006)
Ślęzak, D., Glick, R., Betliński, P., Synak, P.: A new approximate query engine based on intelligent capture and fast transformations of granulated data summaries. J. Intell. Inf. Syst. 50(2), 385–414 (2018)
Kimball, R., Ross, M.: The Data Warehouse Toolkit: The Complete Guide to Dimensional Modeling. Wiley, New York (2011)
Ślęzak, D., Chądzyńska-Krasowska, A., Holland, J., Synak, P., Glick, R., Perkowski, M.: Scalable cyber-security analytics with a new summary-based approximate query engine. In: Proceedings of Big Data 2017, pp. 1840–1849 (2017)
Deza, M.M., Deza, E.: Encyclopedia of distances. In: Deza, M.M., Deza, E. (eds.) Encyclopedia of Distances, pp. 1–583. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-00234-2_1
Chądzyńska-Krasowska, A., Stawicki, S., Ślęzak, D.: A metadata diagnostic framework for a new approximate query engine working with granulated data summaries. In: Polkowski, L., Yao, Y., Artiemjew, P., Ciucci, D., Liu, D., Ślęzak, D., Zielosko, B. (eds.) IJCRS 2017. LNCS (LNAI), vol. 10313, pp. 623–643. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-60837-2_50
Chądzyńska-Krasowska, A., Kowalski, M.: Quality of histograms as indicator of approximate query quality. In: Proceedings of FedCSIS 2016, pp. 9–15 (2016)
Ioannidis, Y.E., Poosala, V.: Histogram-based approximation of set-valued query-answers. In: Proceedings of VLDB 1999, pp. 174–185 (1999)
Cha, S.H.: Comprehensive survey on distance/similarity measures between probability density functions. Int. J. Math. Models Methods Appl. Sci. 4(1), 300–307 (2007)
Tversky, A.: Features of similarity. Psychol. Rev. 84(4), 327 (1977)
Verguts, T., Fias, W.: Representation of number in animals and humans: a neural model. J. Cogn. Neurosci. 16(9), 1493–1504 (2004)
Nieder, A., Miller, E.K.: Coding of cognitive magnitude: compressed scaling of numerical information in the primate prefrontal cortex. Neuron 37(1), 149–157 (2003)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Chądzyńska-Krasowska, A. (2018). Similarity-Based Accuracy Measures for Approximate Query Results. In: Medina, J., et al. Information Processing and Management of Uncertainty in Knowledge-Based Systems. Theory and Foundations. IPMU 2018. Communications in Computer and Information Science, vol 854. Springer, Cham. https://doi.org/10.1007/978-3-319-91476-3_43
Download citation
DOI: https://doi.org/10.1007/978-3-319-91476-3_43
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-91475-6
Online ISBN: 978-3-319-91476-3
eBook Packages: Computer ScienceComputer Science (R0)