Skip to main content

Mahasen: Distributed Storage Resource Broker

  • Conference paper
  • 1821 Accesses

Part of the Lecture Notes in Computer Science book series (LNTCS,volume 8147)

Abstract

Modern day systems are facing an avalanche of data, and they are being forced to handle more and more data intensive use cases. These data comes in many forms and shapes: Sensors (RFID, Near Field Communication, Weather Sensors), transaction logs, Web, social networks etc. As an example, weather sensors across the world generate a large amount of data throughout the year. Handling these and similar data require scalable, efficient, reliable and very large storages with support for efficient metadata based searching. This paper present Mahasen, a highly scalable storage for high volume data intensive applications built on top of a peer-to-peer layer. In addition to scalable storage, Mahasen also supports efficient searching, built on top of the Distributed Hash table (DHT)

Keywords

  • File System
  • Master Node
  • Distribute Hash Table
  • Property Tree
  • Hadoop Distribute File System

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. Szalay, A.S., Kunszt, P., Thakar, A., Gray, J., Slutz, D., Brunner, R.J.: Designing and Mining Multi-Terabyte Astronomy Archives: The Sloan Digital Sky Survey. In: SIGMOD 2000 Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data (2000)

    Google Scholar 

  2. Baru, C., Moore, R., Rajasekar, A., Wan, M.: The SDSC Storage Resource Broker (1998)

    Google Scholar 

  3. Moore, R.W.: Managing Large Distributed Data Sets using the Storage Resource Broker (2010)

    Google Scholar 

  4. DeCandia, G., Hastorun, D., Jampani, M.: Dynamo.: Amazon’s Highly Available Key-value Store (2010)

    Google Scholar 

  5. Ghemawat, S., Leun, S.-T., Gobioff, H.: The Google File System

    Google Scholar 

  6. Nuno Santos, B.K.: Distributed Metadata with the AMGA Metadata Catalog

    Google Scholar 

  7. Nirvana Storage - Home of the Storage Resource Broker (SRB®) (2011), http://www.nirvanastorage.com/index.php?module=htmlpages&func=display&pid=1

  8. XML Metadata Concept Catalog (XMC Cat), Data to Insight Center, Indiana University Pervasive Technology Institute, http://d2i.indiana.edu/xmccat

  9. Nirvana Performance, http://www.nirvanastorage.com/index.php?module=htmlpages&func=display&pid=54

  10. ApacheTM OODT (2011), http://oodt.apache.org/

  11. WSO2 Governance Registry - lean.enterprise.middleware - open source SOA | WSO2 (2011), http://wso2.com/products/governance-registry/

  12. Apache Lucene - Overview, http://lucene.apache.org/java/docs/index.html

  13. HDFS Architecture Guide (2011), http://hadoop.apache.org/docs/r1.0.4/hdfs_design.html

  14. Pastry - A scalable, decentralized, self-organizing and fault-tolerant substrate for peer-to-peer applications, http://www.freepastry.org/

  15. Druschel, P., Rowstron, A.: PAST: A large-scale, persistent peer-to-peer storage utility. In: HotOS VIII, Schoss Elmau, Germany (2001)

    Google Scholar 

  16. TreeMap (Java 2 Platform SE 5.0) (2011), http://download.oracle.com/javase/1.5.0/docs/api/java/util/TreeMap.html

  17. HttpClient - HttpComponents HttpClient Overview (2011), http://hc.apache.org/httpcomponents-client-ga/

  18. Beltrán, A.G., Sage, P., Milligan, P.: Skip Tree Graph: a Distributed and Balanced Search Tree for Peer-to-Peer Networks

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2013 IFIP International Federation for Information Processing

About this paper

Cite this paper

Perera, K.D.A.K.S., Kishanthan, T., Perera, H.A.S., Madola, D.T.H.V., Walpola, M., Perera, S. (2013). Mahasen: Distributed Storage Resource Broker. In: Hsu, CH., Li, X., Shi, X., Zheng, R. (eds) Network and Parallel Computing. NPC 2013. Lecture Notes in Computer Science, vol 8147. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40820-5_32

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-40820-5_32

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-40819-9

  • Online ISBN: 978-3-642-40820-5

  • eBook Packages: Computer ScienceComputer Science (R0)