Skip to main content

Bloom Filters for Efficient Coupling Between Tables of a Database

  • Conference paper
  • First Online:
Engineering Applications of Neural Networks (EANN 2017)

Abstract

Nowadays, digital data are the most valuable asset of almost every organization. Database management systems are considered as storing systems for efficient retrieval and processing of digital data. However, effective operation, in terms of data access speed and relational database is limited, as its size increases significantly [6]. Bloom filter is a special data structure with finite storage requirements and rapid control of an object membership to a dataset. It is worth mentioning that the Bloom filter structure has been proposed with a view to constructively increase data access in relational databases. Since the characteristics of a Bloom filter are consistent with the requirements of a fast data access structure, we examine the possibility of using it in order to increase the SQL query execution speed in a database. In the context of this research, a database in a RDBMS SQL Server that includes big data tables is implemented and in following the performance enhancement, using Bloom filters, in terms of execution time on different categories of SQL queries, is examined. We experimentally proved the time effectiveness of Bloom filter structure in relational databases when dealing with large scale data.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://odetocode.com/articles/237.aspx.

  2. 2.

    http://dataidol.com/tonyrogerson/2013/05/09/reducing-sql-server-io-and-access-times-using-Bloom-filters-part-2-basics-of-the-method-in-sql-server.

  3. 3.

    https://www.perl.com/pub/2004/04/08/bloom_filters.html.

  4. 4.

    https://blog.medium.com/what-are-bloom-filters-1ec2a50c68ff.

  5. 5.

    https://llimllib.github.io/bloomfilter-tutorial.

  6. 6.

    https://prakhar.me/articles/bloom-filters-for-dummies.

  7. 7.

    http://bugra.github.io/work/notes/2016-06-05/a-gentle-introduction-to-bloom-filter.

  8. 8.

    http://db-engines.com/en/ranking/relational+dbms.

  9. 9.

    http://www.w3schools.com/sql/sql_syntax.asp.

  10. 10.

    https://www.techonthenet.com/sql/in.php.

  11. 11.

    https://www.techonthenet.com/sql/exists.php.

  12. 12.

    https://docs.microsoft.com/en-us/sql/t-sql/queries/top-transact-sql.

  13. 13.

    https://www.simple-talk.com/sql/learn-sql-server/sql-server-index-basics.

References

  1. Blustein, J., El-Maazawi, A.: Bloom Filters: A Tutorial, Analysis and Survey (2002). https://www.cs.dal.ca/research/techreports/cs-2002-10

  2. Broder, A.Z., Mitzenmacher, M.: Survey: network applications of bloom filters: a survey. Internet Math. 1(4), 485–509 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  3. Chang, F., Dean, J., Ghemawat, S., Hsieh, W.C., Wallach, D.A., Burrows, M., Chandra, T., Fikes, A., Gruber, R.E.: Bigtable: a distributed storage system for structured data. ACM Trans. Comput. Syst. (TOCS) 26(2), 4:1–4:26 (2008)

    Article  Google Scholar 

  4. Christensen, K.J., Roginsky, A., Jimeno, M.: A new analysis of the false-positive rate of a bloom filter. Inf. Process. Lett. 110(21), 944–949 (2010)

    Article  MathSciNet  Google Scholar 

  5. Gupta, M.K., Chandra, P.: An empirical evaluation of like operator in Oracle. BVICAM’s Int. J. Inf. Technol. 3(2) (2011). https://scholar.google.co.in/citations?view_op=view_citation&citation_for_view=jab7XG0AAAAJ:MXK_kJrjxJIC

  6. Khan, M., Khan, M.N.A.: Exploring query optimization techniques in relational databases. Int. J. Database Theory Appl. 6(3), 11–20 (2013)

    Google Scholar 

  7. Kim, W.: On optimizing an SQL-like nested query. ACM Trans. Database Syst. (TODS) 7(3), 443–469 (1982)

    Article  MATH  Google Scholar 

  8. Kirsch, A., Mitzenmacher, M.: Less hashing, same performance: building a better bloom filter. In: Azar, Y., Erlebach, T. (eds.) ESA 2006. LNCS, vol. 4168, pp. 456–467. Springer, Heidelberg (2006). doi:10.1007/11841036_42

    Chapter  Google Scholar 

  9. Larson, P., Clinciu, C., Hanson, E.N., Oks, A., Price, S.L., Rangarajan, S., Surna, A., Zhou, Q.: SQL server column store indexes. In: ACM SIGMOD International Conference on Management of Data, pp. 1177–1184 (2011)

    Google Scholar 

  10. Lyons, M.J., Brooks, D.M.: The design of a bloom filter hardware accelerator for ultra low power systems. In: International Symposium on Low Power Electronics and Design, pp. 371–376 (2009)

    Google Scholar 

  11. Oktavia, T., Sujarwo, S.: Evaluation of sub query performance in SQL server. In: EPJ Web of Conferences, vol. 68 (2014)

    Google Scholar 

  12. Ramakrishnan, R., Donjerkovic, D., Ranganathan, A., Beyer, K.S., Krishnaprasad, M.: SRQL: sorted relational query language. In: International Conference on Scientific and Statistical Database Management (SSDBM), pp. 84–95 (1998)

    Google Scholar 

  13. Roozenburg, J.: A literature survey on bloom filters. Res. Assign. Comput. Sci. (2005). https://scholar.google.gr/scholar?cluster=8721372506493746175

  14. Vicknair, C., Macias, M., Zhao, Z., Nan, X., Chen, Y., Wilkins, D.: A comparison of a graph database and a relational database: a data provenance perspective. In: ACM Southeast Regional Conference, p. 42 (2010)

    Google Scholar 

  15. Winand, M.: SQL Performance Explained: Everything Developers Need to Know about SQL Performance (2012). http://sql-performance-explained.com/img/9783950307825_preview.pdf

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Andreas Kanavos .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Chioti, E., Dritsas, E., Kanavos, A., Liapakis, X., Sioutas, S., Tsakalidis, A. (2017). Bloom Filters for Efficient Coupling Between Tables of a Database. In: Boracchi, G., Iliadis, L., Jayne, C., Likas, A. (eds) Engineering Applications of Neural Networks. EANN 2017. Communications in Computer and Information Science, vol 744. Springer, Cham. https://doi.org/10.1007/978-3-319-65172-9_50

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-65172-9_50

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-65171-2

  • Online ISBN: 978-3-319-65172-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics