Skip to main content
SpringerLink
Log in

Data warehouse access using multi-agent system

  • Published:
Distributed and Parallel Databases Aims and scope Submit manuscript

Abstract

The new approach that we will propose, in this paper deals with the dynamic data distribution of the data warehouse (DWH) on a set of servers. This distribution is different from the “classical” one which depends on how data is used. It consists in distributing data when the machine reaches its storage limit capacity. The proposed approach insures the scalability and exploits the storage and processing resources available in the organization using the DWH. It is worth noting that our approach is based on a multi-agent model mixed with the scalability distribution proposed by the Scalable Distributed Data Structures.

Our multi-agent model is made up of stationary agent classes: Client, Dispatcher, Domain and Server, and a mobile agent class: Messenger. These agents collaborate and achieve automatically the storage, splitting, redirection and access operations on the distributed DWH.

In this paper, we focus on the global dynamic for the data access operation and we present the inherent experimental results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Arcangeli, J., Hameurlain, A., Migeon, F., Morvan, F.: Apport des agents mobiles à l’évaluation et l’optimisation de requêtes bases de données réparties à grande échelle. Technical Report, laboratory IRIT, Université Paul Sabatier (2002)

  2. Bellatreche, L., Boukhalfa, K.: An evolutionary approach to schema partitioning selection in a data warehouse. In: DAWAK’2005, 2005

  3. Bellatreche, L., Schneider, M., Lorinquer, H., Mohania, M.: Bringing together partitioning, materialized views and indexes to optimize performance of relational data warehouses. In: Proceeding of the International Conference on Data Warehousing and Knowledge Discovery (DAWAK’2004), pp. 15–25, September 2004

  4. Bennour, F.: Les structures de données distribuées et scalables sous windows: tendance hachage linéaire. Doctoral Thesis U. Paris 9, 2000

  5. Bernardino, J., Madeira, H.: Data warehousing and OLAP: improving query performance using distributed computing. In: 12th Conference on Advanced Information Systems Engineering. Stockholm, Sweden 2000

  6. Bernardino, J., Furtado, P.S., Madeira, H.C.: Approximate query answering using data warehouse striping. J. Intell. Inf. Syst. 19(2), 145–167 (2002)

    Article  Google Scholar 

  7. Börger, E., Stärk, R.: Abstract State Machines. Springer, Berlin, Heidelberg, New York (2003)

    Book  Google Scholar 

  8. Almeida, R., Vieira, J., Vieira, M., Madeira, H., Bernardino, J.: Efficient data distribution for DWS. In: Proc. of the 10th International Conference on Data Warehousing and Knowledge Discovery (DaWaK ’08), Turin, Italy, September 2008. Lecture Notes in Computer Science, vol. 5182. Springer, Berlin (2008) ISBN 978-3-540-85835-5

    Chapter  Google Scholar 

  9. Derrar, H., Boussaïd, O., Ahmed-Nacer, M.: Une approche de répartition des données d’un entrepôt basée sur l’optimisation par essaim particulaire. In: 4èmes journées francophones sur les Entrepôts de Données et l’Analyse enligne (EDA 2008), Toulouse, Juin 2008; RNTI, vol. B-4, Cépaduès, Toulouse, pp. 141–149

  10. Diene, Litwin, W.: Performance measurements of RP*: a scalable distributed data structure for range partitioning. In: Int. Conf. on Information Society in the 21st Century: Emerging Techn. and New Challenges. Aizu City, Japan, 2000

  11. Informatica white paper. Enterprise-scalable data marts: a new strategy for building and deploying fast, scalable data warehousing systems. http://www.informatica.com (1997)

  12. Ferber, J.: Les Systemes Multi-Agents vers une Intelligence Collective. InterEditions, Paris (1995)

    MATH  Google Scholar 

  13. Ferber, J.: Multi-Agent System: An Introduction to Distributed Artificial Intelligence. Addison-Wesley, Longman, Harlow (1999)

    Google Scholar 

  14. Furtado, P.: Experimental evidence on partitioning in parallel data warehouses. In: DOLAP 04—WORKSHOP of the Int’l Conference on Information and Knowledge Management (CIKM), Washington, November 2004

  15. Gupta, H.: Selection and maintenance of views in a data warehouse. Ph.D. thesis, Standford University, September (1999)

  16. Hachicha, H., Loukil, A., Ghédira, K.: MA-UML: une extension de A-UML aux agents mobiles. In: JFIADSMA 2002, Lille, French

  17. Harrison, C.G., Chess, D.M., Kershenbaum, A.: Mobile agents: are they a good idea? Technical report, IBM Research Division (1995)

  18. Hewlett-Packard white paper. HP Intelligent Warehouse. http://www.hp.com (1997)

  19. Inmon, W.: Building the data warehouse. QED Technical Publishing Group (1992)

  20. Kolsi, N., Abdellatif, A., Ghedira, K.: Agent based dynamic data storage and distribution in data warehouses. In: KES-AMSTA, 2007

  21. Kolsi, N., Ghedira, K., Abdellatif, A.: Utilisation d’un système multi-agents pour la répartition et la scalabilité des données d’un data warehouse. In: Acts of the Fourth Scientific Days, Tome 1, pp. 118–129, Borj El Amri Aviation School, Tunis, Tunisia, 21–22 May 2003

  22. Kotidis, Y., Roussopoulos, N.: Dynamat: a dynamic view management system for data warehouses. In: Proceedings of the ACM SIGMOD International Conference on Management of Data, pp. 371–382, June 1999

  23. Litwin, W., Neimat, M.A., Schneider, D.: RP*: a family of order-preserving scalable distributed data structures. In: 20th Intl. Conf. On very Large Data Bases VLDB, 1994

  24. Litwin, W., Risch, T., Schwarz, Th.: An architecture for a scalable distributed DBS: application to SQL server 2000, Extended abstract. In: 2nd Intl. Workshop on Cooperative Internet Computing (CIC 2002), Hong Kong, August, 2002

  25. Narasayya, S.V.R., Yang, B.: Integrating vertical and horizontal partitioning into automated physical database design. In: Proceedings of the ACM SIGMOD International Conference on Management of Data, pp. 359–370, June 2004

  26. Ndiaye, Y., Diene, A., Litwin, W., Risch, W.: AMOS-SDDS: a scalable distributed data manager for windows multicomputers. In: ISCA 14th Intl. Conf. on Par. and Distr. Computing Systems, Texas, USA, August 8–10, 2001

  27. Sahri, S., Litwin, W., Schwartz, T.: An overview of a scalable distributed database system SD-SQL server. In: Bell, D., Hong, J. (eds.) Flexible and Efficient Information Handling: 23d British National Conference on Databases, BNCOD 2006, Belfast, Northern Ireland, UK, July 2006 Proceedings. Lecture Notes in Computer Science, vol. 4942, pp. 16–35. Springer, Berlin, Heidelberg, New York (2006)

    Google Scholar 

  28. Surajit, S.C., Narasayya, V.R.: Automated selection of materialized views and indexes in microsoft SQL server. In: Proceedings of the International Conference on Very Large Databases, pp. 496–505, September 2000

  29. Wu, M., Buchmann, A.: Research issues in data warehousing. In: BTW’97, March 1997

  30. Zhao, J., Ma, H.: Quality-assured design of on-line analytical processing systems using abstract state machines. In: Ehrich, H.-D., Schewe, K.-D. (eds.) Proceedings of the Fourth International Conference on Quality Software (QSIC 2004), Braun-Schweig, Germany, 2004. IEEE Computer Society Press, Los Alamitos (2004)

    Google Scholar 

  31. Zhao, J., Schewe, K.-D.: Using abstract state machines for distributed data warehouse design. In: Hartmann, S., Roddick, J. (eds.) Conceptual Modelling 2004—First Asia-Pacific Conference on Conceptual Modelling, Dunedin, New Zealand, 2004. CRPIT, vol. 31, pp. 49–58. Australian Computer Society, Sydney (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Higher Institute of Business Administration of Sfax, Sfax, Tunisia

    Nader Kolsi

  2. University of Sciences of Tunis, Tunis, Tunisia

    Abdelaziz Abdellatif

  3. National School of Informatics Sciences, Manouba Campus University, Tunis, Tunisia

    Khaled Ghedira

Authors
  1. Nader Kolsi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Abdelaziz Abdellatif
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Khaled Ghedira
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nader Kolsi.

Additional information

Communicated by Ladjel Bellatreche.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kolsi, N., Abdellatif, A. & Ghedira, K. Data warehouse access using multi-agent system. Distrib Parallel Databases 25, 29–45 (2009). https://doi.org/10.1007/s10619-009-7036-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10619-009-7036-9

Keywords

Search

Navigation