Advertisement

Mahasen: Distributed Storage Resource Broker

  • K. D. A. K. S. Perera
  • T. Kishanthan
  • H. A. S. Perera
  • D. T. H. V. Madola
  • Malaka Walpola
  • Srinath Perera
Conference paper
  • 1.6k Downloads
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8147)

Abstract

Modern day systems are facing an avalanche of data, and they are being forced to handle more and more data intensive use cases. These data comes in many forms and shapes: Sensors (RFID, Near Field Communication, Weather Sensors), transaction logs, Web, social networks etc. As an example, weather sensors across the world generate a large amount of data throughout the year. Handling these and similar data require scalable, efficient, reliable and very large storages with support for efficient metadata based searching. This paper present Mahasen, a highly scalable storage for high volume data intensive applications built on top of a peer-to-peer layer. In addition to scalable storage, Mahasen also supports efficient searching, built on top of the Distributed Hash table (DHT)

Keywords

File System Master Node Distribute Hash Table Property Tree Hadoop Distribute File System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. 1.
    Szalay, A.S., Kunszt, P., Thakar, A., Gray, J., Slutz, D., Brunner, R.J.: Designing and Mining Multi-Terabyte Astronomy Archives: The Sloan Digital Sky Survey. In: SIGMOD 2000 Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data (2000)Google Scholar
  2. 2.
    Baru, C., Moore, R., Rajasekar, A., Wan, M.: The SDSC Storage Resource Broker (1998)Google Scholar
  3. 3.
    Moore, R.W.: Managing Large Distributed Data Sets using the Storage Resource Broker (2010)Google Scholar
  4. 4.
    DeCandia, G., Hastorun, D., Jampani, M.: Dynamo.: Amazon’s Highly Available Key-value Store (2010)Google Scholar
  5. 5.
    Ghemawat, S., Leun, S.-T., Gobioff, H.: The Google File SystemGoogle Scholar
  6. 6.
    Nuno Santos, B.K.: Distributed Metadata with the AMGA Metadata CatalogGoogle Scholar
  7. 7.
    Nirvana Storage - Home of the Storage Resource Broker (SRB®) (2011), http://www.nirvanastorage.com/index.php?module=htmlpages&func=display&pid=1
  8. 8.
    XML Metadata Concept Catalog (XMC Cat), Data to Insight Center, Indiana University Pervasive Technology Institute, http://d2i.indiana.edu/xmccat
  9. 9.
  10. 10.
    ApacheTM OODT (2011), http://oodt.apache.org/
  11. 11.
    WSO2 Governance Registry - lean.enterprise.middleware - open source SOA | WSO2 (2011), http://wso2.com/products/governance-registry/
  12. 12.
  13. 13.
  14. 14.
    Pastry - A scalable, decentralized, self-organizing and fault-tolerant substrate for peer-to-peer applications, http://www.freepastry.org/
  15. 15.
    Druschel, P., Rowstron, A.: PAST: A large-scale, persistent peer-to-peer storage utility. In: HotOS VIII, Schoss Elmau, Germany (2001)Google Scholar
  16. 16.
  17. 17.
    HttpClient - HttpComponents HttpClient Overview (2011), http://hc.apache.org/httpcomponents-client-ga/
  18. 18.
    Beltrán, A.G., Sage, P., Milligan, P.: Skip Tree Graph: a Distributed and Balanced Search Tree for Peer-to-Peer NetworksGoogle Scholar

Copyright information

© IFIP International Federation for Information Processing 2013

Authors and Affiliations

  • K. D. A. K. S. Perera
    • 1
  • T. Kishanthan
    • 1
  • H. A. S. Perera
    • 1
  • D. T. H. V. Madola
    • 1
  • Malaka Walpola
    • 1
  • Srinath Perera
    • 2
  1. 1.Computer Science and Engineering DepartmentUniversity Of MoratuwaSri Lanka
  2. 2.WSO2 LankaSri Lanka

Personalised recommendations