Skip to main content
View expanded cover

Transactions on Large-Scale Data- and Knowledge-Centered Systems III pp 138–166Cite as

Improving Source Selection in Large Scale Mediation Systems through Combinatorial Optimization Techniques

  • Chapter

Part of the Lecture Notes in Computer Science book series (TLDKS,volume 6790)

Abstract

This paper concerns querying in large scale virtual organizations. Such organizations are characterized by a challenging data context involving a large number of distributed data sources with strong heterogeneity and uncontrolled data overlapping. In that context, data source selection during query evaluation is particularly important and complex. To cope with this task, we propose OptiSource, an original strategy for source selection using combinatorial optimization techniques combined to organizational knowledge of the virtual organization. Experiment numerical results show that OptiSource is a robust strategy that improves the precision and the recall of the source selection process. This paper presents the data and knowledge models, the definition of OptiSource, the related mathematical model, the prototype and an extensive experimental study.

Keywords

  • Large Scale Data Mediation
  • Source Selection
  • Combinatorial Optimization

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-642-23074-5_6
  • Chapter length: 29 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   74.99
Price excludes VAT (USA)
  • ISBN: 978-3-642-23074-5
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   99.00
Price excludes VAT (USA)
Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Foster, I., Kesselman, C., Tuecke, S.: The anatomy of the grid: Enabling scalable virtual organizations. International Journal of High Performance Computing Applications 15, 200–222 (2001)

    CrossRef  Google Scholar 

  2. NEESGrid: Nees consortium (2008), http://neesgrid.ncsa.uiuc.edu/

  3. BIRN: Bioinformatics research network (2008), http://www.loni.ucla.edu/birn/

  4. Quiané-Ruiz, J.-A., Lamarre, P., Valduriez, P.: Sqlb: A query allocation framework for autonomous consumers and providers. In: VLDB, pp. 974–985 (2007)

    Google Scholar 

  5. Doan, A., Halevy, A.Y.: Efficiently ordering query plans for data integration. In: ICDE 2002, p. 393. IEEE Computer Society, Washington, DC, USA (2002)

    Google Scholar 

  6. Wolf, G., Khatri, H., Chokshi, B., Fan, J., Chen, Y., Kambhampati, S.: Query processing over incomplete autonomous databases. In: VLDB, pp. 651–662 (2007)

    Google Scholar 

  7. Huebsch, R., Hellerstein, J.M., Lanham, N., Loo, B.T., Shenker, S., Stoica, I.: Querying the internet with pier. In: VLDB, Berlin, Germany, pp. 321–332 (2003)

    Google Scholar 

  8. Pottinger, R., Halevy, A.Y.: Minicon: A scalable algorithm for answering queries using views. VLDB Journal. 10(2-3), 182–198 (2001)

    MATH  Google Scholar 

  9. Pomares, A., Roncancio, C., Cung, V.-D., Abásolo, J., Villamil, M.-d.-P.: Source selection in large scale data contexts: An optimization approach. In: Bringas, P.G., Hameurlain, A., Quirchmayr, G. (eds.) DEXA 2010. LNCS, vol. 6261, pp. 46–61. Springer, Heidelberg (2010)

    CrossRef  Google Scholar 

  10. Levy, A.Y., Rajaraman, A., Ordille, J.J.: Querying heterogeneous information sources using source descriptions. In: VLDB, pp. 251–262 (1996)

    Google Scholar 

  11. Garcia-Molina, H., Papakonstantinou, Y., Quass, D., Rajaraman, A., Sagiv, Y., Ullman, J.D., Vassalos, V., Widom, J.: The tsimmis approach to mediation: Data models and languages. Journal of Intelligent Information Systems 8, 117–132 (1997)

    CrossRef  Google Scholar 

  12. Tomasic, A., Raschid, L., Valduriez, P.: Scaling access to heterogeneous data sources with DISCO. Knowledge and Data Engineering 10, 808–823 (1998)

    CrossRef  Google Scholar 

  13. Yerneni, R.: Mediated Query Processing Over Autonomous Data Sources. PhD thesis, Stanford University, Stanford, CA (2001)

    Google Scholar 

  14. Bleiholder, J., Khuller, S., Naumann, F., Raschid, L., Wu, Y.: Query planning in the presence of overlapping sources. In: Ioannidis, Y., Scholl, M.H., Schmidt, J.W., Matthes, F., Hatzopoulos, M., Böhm, K., Kemper, A., Grust, T., Böhm, C. (eds.) EDBT 2006. LNCS, vol. 3896, pp. 811–828. Springer, Heidelberg (2006)

    CrossRef  Google Scholar 

  15. Naumann, F., Freytag, J.C., Leser, U.: Completeness of integrated information sources. Information Systems Journal, Special issue: Data Quality in Cooperative Information Systems 29, 583–615 (2004)

    Google Scholar 

  16. Tatarinov, I., Ives, Z., Madhavan, J., Halevy, A., Suciu, D., Dalvi, N., Dong, X(L.), Kadiyska, Y., Miklau, G., Mork, P.: The piazza peer data management project. SIGMOD Rec. 32(3), 47–52 (2003)

    CrossRef  Google Scholar 

  17. Nejdl, W., Wolf, B., Qu, C., Decker, S., Sintek, M., Naeve, A., Nilsson, M., Palmér, M., Risch, T.: Edutella: a p2p networking infrastructure based on rdf. In: WWW 2002, pp. 604–615. ACM, New York (2002)

    Google Scholar 

  18. Adjiman, P., Goasdoué, F., Rousset, M.-C.: Somerdfs in the semantic web. Journal on Data Semantics 8, 158–181 (2007)

    MATH  Google Scholar 

  19. Horrocks, I.: Owl: A description logic based ontology language. In: Principles and Practice of Constraint Programming, pp. 5–8 (2005)

    Google Scholar 

  20. Pomares, A., Roncancio, C., Abasolo, J., del Pilar Villamil, M.: Knowledge based query processing. In: ICEIS. Lecture Notes in Business Information Processing, vol. 24, pp. 208–219. Springer, Heidelberg (2009)

    Google Scholar 

  21. Hillier, F.S., Lieberman, G.J.: Introduction to Operations Research, 8th edn. McGraw-Hill, New York (2005)

    MATH  Google Scholar 

  22. Makhorin, A.: Gnu project, gnu linear programming kit (2009), http://www.gnu.org/software/glpk/

  23. Makhorin, A.: Gnu project, glpk for java (2009), http://glpk-java.sourceforge.net/

  24. Eric Prud, A.S.: Sparql query language for rdf (2007), http://www.w3.org/tr/rdf-sparql-query/

  25. Lin, C.-J., Wen, U.-P.: Sensitivity analysis of the optimal assignment. European Journal of Operational Research 149(1), 35–46 (2003)

    MathSciNet  CrossRef  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Pontificia Universidad Javeriana, Bogotá, Colombia

    Alexandra Pomares

  2. Grenoble INP, Grenoble, France

    Claudia Roncancio & Van-Dat Cung

  3. Universidad de los Andes, Bogotá, Colombia

    María-del-Pilar Villamil

Authors
  1. Alexandra Pomares
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Claudia Roncancio
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Van-Dat Cung
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. María-del-Pilar Villamil
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. IRIT Institut de Recherche en Informatique de Toulouse, Paul Sabatier University, 118, route de Narbonne, 31062, Toulouse Cedex, France

    Abdelkader Hameurlain

  2. FAW, University of Linz, Altenbergerstraße 69, 4040, Linz, Austria

    Josef Küng

  3. University of Linz, FAW, Altenbergerstraße 69, 4040, Linz, Austria

    Roland Wagner

Rights and permissions

Reprints and Permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Pomares, A., Roncancio, C., Cung, VD., Villamil, MdP. (2011). Improving Source Selection in Large Scale Mediation Systems through Combinatorial Optimization Techniques. In: Hameurlain, A., Küng, J., Wagner, R. (eds) Transactions on Large-Scale Data- and Knowledge-Centered Systems III. Lecture Notes in Computer Science, vol 6790. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23074-5_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-23074-5_6

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-23073-8

  • Online ISBN: 978-3-642-23074-5

  • eBook Packages: Computer ScienceComputer Science (R0)