Skip to main content

Distributed Query Optimization by Query Trading

  • Conference paper
Advances in Database Technology - EDBT 2004 (EDBT 2004)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2992))

Included in the following conference series:

Abstract

Large-scale distributed environments, where each node is completely autonomous and offers services to its peers through external communication, pose significant challenges to query processing and optimization. Autonomy is the main source of the problem, as it results in lack of knowledge about any particular node with respect to the information it can produce and its characteristics. Inter-node competition is another source of the problem, as it results in potentially inconsistent behavior of the nodes at different times. In this paper, inspired by e-commerce technology, we recognize queries (and query answers) as commodities and model query optimization as a trading negotiation process. Query parts (and their answers) are traded between nodes until deals are struck with some nodes for all of them. We identify the key parameters of this framework and suggest several potential alternatives for each one. Finally, we conclude with some experiments that demonstrate the scalability and performance characteristics of our approach compared to those of traditional query optimization.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Navas, J.C., Wynblatt, M.: The Network is the Database: Data Management for Highly Distributed Systems. In: Proceedings of ACM SIGMOD 2001 Conference (2001)

    Google Scholar 

  2. Deshpande, A., Hellerstein, J.M.: Decoupled query optimization for federated database systems. In: Proc. of 18th. ICDE, San Jose, CA, pp. 716–727 (2002)

    Google Scholar 

  3. Kossmann, D.: The state of the art in distributed query processing. ACM Computing Surveys (2000)

    Google Scholar 

  4. Stonebraker, M., Aoki, P.M., Litwin, W., Pfeller, A., Sah, A., Sidell, J., Staelin, C., Yu, A.: Mariposa: A wide-area distributed database system. VLDB Journal 5, 48–63 (1996)

    Article  Google Scholar 

  5. Bichler, M., Kaukal, M., Segev, A.: Multi-attribute auctions for electronic procurement. In: Proc. of the 1st IBM IAC Workshop on Internet Based Negotiation Technologies, Yorktown Heights, NY, March 18-19 (1999)

    Google Scholar 

  6. Collins, J., Tsvetovat, M., Sundareswara, R., van Tonder, J., Gini, M.L., Mobasher, B.: Evaluating risk: Flexibility and feasibility in multi-agent contracting. In: Proc. of the 3rd Annual Conf. on Autonomous Agents, Seattle, WA, USA (1999)

    Google Scholar 

  7. Parunak, H.V.D.: Manufacturing experience with the contract net. In: Huhns, M.N. (ed.) Distributed Artificial Intelligence. Research Notes in Artificial Intelligence, ch. 10, pp. 285–310. Pitman (1987)

    Google Scholar 

  8. Sandholm, T.: Algorithm for optimal winner determination in combinatorial auctions. Artificial Intelligence 135, 1–54 (2002)

    Article  MATH  MathSciNet  Google Scholar 

  9. Su, S.Y., Huang, C., Hammer, J., Huang, Y., Li, H., Wang, L., Liu, Y., Pluempitiwiriyawej, C., Lee, M., Lam, H.: An internet-based negotiation server for e-commerce. VLDB Journal 10, 72–90 (2001)

    MATH  Google Scholar 

  10. Smith, R.G.: The contract net protocol: High-level communication and control in a distributed problem solver. IEEE Transactions on Computers 29, 1104–1113 (1980)

    Article  Google Scholar 

  11. Pentaris, F., Ioannidis, Y.: Distributed query optimization by query trading (2003) (unpublished manuscript), Available at http://www.di.uoa.gr/~frank/cqp-full.pdf

  12. Conitzer, V., Sandholm, T.: Complexity results about nash equilibria. Technical report CMU-CS-02-135 (2002), http://www-2.cs.cmu.edu/~sandholm/Nash_complexity.pdf

  13. Ogston, E., Vassiliadis, S.: A Peer-to-Peer Agent Auction. In: Falcone, R., Barber, S.K., Korba, L., Singh, M.P. (eds.) AAMAS 2002. LNCS (LNAI), vol. 2631, Springer, Heidelberg (2003)

    Google Scholar 

  14. Kagel, J.H.: Auctions: A Survey of Experimental Research. In: Kagel, J.E., Roth, A.E. (eds.) The Handbook of Experimental Economics, Princeton University Press, Princeton (1995)

    Google Scholar 

  15. Kraus, S.: Strategic Negotiation in Multiagent Environments (Intelligent Robotics and Autonomous Agents). The MIT Press, Cambridge (2001)

    Google Scholar 

  16. Rosenchein, J.S., Zlotkin, G.: Rules of Encounter: designing conventions for automated negotiation among computers. The MIT Press series in artificial intelligence (1994)

    Google Scholar 

  17. Selinger, P.G., Astrahan, M.M., Chamberlin, D.D., Lorie, R.A., Price, T.G.: Access path selection in a relational database management system. In: Proc. of 1979 ACM SIGMOD, pp. 22–34. ACM, New York (1979)

    Google Scholar 

  18. Halevy, A.Y.: Answering queries using views: A survey. VLDB Journal 10, 270–294 (2001)

    Article  MATH  Google Scholar 

  19. Zaharioudakis, M., Cochrane, R., Lapis, G., Pirahesh, H., Urata, M.: Answering complex sql queries using automatic summary tables. In: Proceedings of ACM SIGMOD 2000 Conference, pp. 105–116 (2000)

    Google Scholar 

  20. Pottinger, R., Levy, A.: A scalable alogirthm for answering queries using views. In: Proc. of the 26th VLDB Conference, Cairo, Egypt (2000)

    Google Scholar 

  21. Levy, A.Y., Rajaraman, A., Ordille, J.J.: Querying heterogeneous information sources using source descriptions. In: Proc. of 22th Int. Conf. on VLDB, pp. 251–262 (1996)

    Google Scholar 

  22. Qian, X.: Query folding. In: Proc. of ICDE, New Orleans, LA, pp. 48–55 (1996)

    Google Scholar 

  23. Vickrey, W.: Counterspeculation, auctions, and competitive sealed tenders. Journal of Finance 16, 8–37 (1961)

    Article  Google Scholar 

  24. Buyya, R., Abramson, D., Giddy, J., Stockinger, H.: Economic models for resource management and scheduling in grid computing. In: Proc. of Commercial Applications for High-Performance Computing Conference, SPIE International Symposium on The Convergence of Information Technologies and Communications (ITCom 2001), Denver, Colorado, August 20-24 (2001)

    Google Scholar 

  25. Papadimitriou, C.H., Yannakakis, M.: Multiobjective query optimization. In: Proc. of the 20th ACM SIGACT-SIGMOD-SIGART Symposium on PODS, Santa Barbara, CA, USA, May 21-23, ACM, New York (2001)

    Google Scholar 

  26. Stonebraker, M., Aoki, P.M., Devine, R., Litwin, W., Olson, M.A.: Mariposa: A new architecture for distributed data. In: ICDE, pp. 54–65 (1994)

    Google Scholar 

  27. Mariposa: Mariposa distributed database management systems, User’s Manual (2002), Available at http://s2k-ftp.cs.berkeley.edu:8000/mariposa/src/alpha-1/mariposa-manual.pdf

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Pentaris, F., Ioannidis, Y. (2004). Distributed Query Optimization by Query Trading. In: Bertino, E., et al. Advances in Database Technology - EDBT 2004. EDBT 2004. Lecture Notes in Computer Science, vol 2992. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24741-8_31

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-24741-8_31

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-21200-3

  • Online ISBN: 978-3-540-24741-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics