Skip to main content

On the Fly File Dereplication Mechanism

  • Conference paper
  • 1744 Accesses

Part of the Advances in Intelligent Systems and Computing book series (AISC,volume 176)

Abstract

Resource replication in distributed environment produces issues of secondary storage. Dereplication of resources is required when replication mechanism is hindered due to lack of secondary storage. This paper introduces dereplication approaches that depend upon last modification time, number of replica available and resource size. Comparative study shows that dereplication can be used to overcome the space overhead issue and reduces the dereplication time. Result shows that in case the space required is same but number of files to be dereplicated varies, dereplication time also varies depending on number of files to be dereplicated. Dereplication time will be more for case having large number of files. Also if file size is increasing by 7 times, increase in dereplication time is by 1.5 times. This shows that dereplication time is decoupled from size of files that are dereplicated on the fly dynamically and does not increase proportionally with respect to file size.

Keywords

  • Dereplication
  • Distributed Systems
  • Replication

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-642-31513-8_72
  • Chapter length: 10 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   299.00
Price excludes VAT (USA)
  • ISBN: 978-3-642-31513-8
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   379.99
Price excludes VAT (USA)

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Kshemkalyani, A.D.: Distributed Computing Principles, Algorithms and Systems

    Google Scholar 

  2. Gupta, M., Ammar, M.H., Ahamad, M.: Trade-offs between reliability and overheads in peer-to-peer reputation tracking. Computer Networks 50(4), 501–522 (2006)

    MATH  CrossRef  Google Scholar 

  3. Venkatasubramanian, N.: CompOSE|Q - a QoS-enabled customizable middleware framework for distributed computing, Electronic Commerce and Web-based Applications/Middleware. In: 19th IEEE International Conference on Distributed Computing Systems, pp. 134–139 (1999)

    Google Scholar 

  4. Chou, C.-F., Golubchik, L., Lui, J.C.S.: Striping doesn’t scale: how to achieve scalability for continuous media servers with replication. In: 20th International Conference on Distributed Computing Systems, pp. 64–71 (2000)

    Google Scholar 

  5. Venkatasubramanian, N., Deshpande, M., Mohapatra, S., Gutierrez-Nolasco, S., Wickramasuriya, J.: Design and implementation of a composable reflective middleware framework. In: 21st International Conference on Distributed Computing Systems, pp. 644–653 (April 2001)

    Google Scholar 

  6. Santry, D.S., Feeley, M.J., Hutchinson, N.C., Veitch, A.C., Carton, R.W., Ofir, J.: Deciding when to forget in the Elephant file system 33(5), 110–123 (December 1999)

    Google Scholar 

  7. Hurley, R.T., Soon, A.Y.: File migration and file replication: a symbiotic relationship. IEEE Transactions on Parallel and Distributed Systems 7(6), 578–586 (1996)

    CrossRef  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Paras Gupta .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Gupta, P., Vardhan, M., Goel, A., Verma, A., Kushwaha, D.S. (2012). On the Fly File Dereplication Mechanism. In: Meghanathan, N., Nagamalai, D., Chaki, N. (eds) Advances in Computing and Information Technology. Advances in Intelligent Systems and Computing, vol 176. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31513-8_72

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-31513-8_72

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-31512-1

  • Online ISBN: 978-3-642-31513-8

  • eBook Packages: EngineeringEngineering (R0)