Repository Replication Using NNTP and SMTP

  • Joan A. Smith
  • Martin Klein
  • Michael L. Nelson
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4172)


We present the results of a feasibility study using shared, existing, network-accessible infrastructure for repository replication. We utilize the SMTP and NNTP protocols to replicate both the metadata and the content of a digital library, using OAI-PMH to facilitate management of the archival process. We investigate how dissemination of repository contents can be piggybacked on top of existing email and Usenet traffic. Long-term persistence of the replicated repository may be achieved thanks to current policies and procedures which ensure that email messages and news posts are retrievable for evidentiary and other legal purposes for many years after the creation date. While the preservation issues of migration and emulation are not addressed with this approach, it does provide a simple method of refreshing content with unknown partners for smaller digital repositories that do not have the administrative resources for more sophisticated solutions.


Digital Library Digital Preservation News Server Destination Host Repository Content 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Kantor, B., Lapsley, P.: Network news transfer protocol, Internet RFC-977 (February 1986)Google Scholar
  2. 2.
    Postel, J.B.: Simple mail transfer protocol, Internet RFC-821 (August 1982)Google Scholar
  3. 3.
  4. 4.
    Goldberg, A.V., Yianilos, P.N.: Towards an archival intermemory. In: Proceedings of IEEE Advances in Digital Libraries, ADL 1998, April 1998, pp. 147–156 (1998)Google Scholar
  5. 5.
    Clarke, I., Sandberg, O., Wiley, B., Hong, T.W.: Freenet: A distributed anonymous information storage and retrieval system. In: Federrath, H. (ed.) Designing Privacy Enhancing Technologies. LNCS, vol. 2009, p. 46. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  6. 6.
    Dingledine, R., Freedman, M.J., Molnar, D.: The free haven project: Distributed anonymous storage service. In: Federrath, H. (ed.) Designing Privacy Enhancing Technologies. LNCS, vol. 2009, pp. 67–95. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  7. 7.
    Maniatis, P., Roussopoulos, M., Giuli, T.J., Rosenthal, D.S.H., Baker, M.: The LOCKSS peer-to-peer digital preservation system. ACM Transactions on computer systems 23, 2–50 (2005)CrossRefGoogle Scholar
  8. 8.
    Tridgell, A., Mackerras, P.: The rsync algorithm. Technical report, The Australian National University (1996),
  9. 9.
    Cooper, B.F., Garcia-Molina, H.: Peer-to-peer data trading to preserve information. ACM Transactions on Information Systems 20(2), 133–170 (2002)CrossRefGoogle Scholar
  10. 10.
    Back, A.: The eternity service. Phrack Magazine 7(51) (1997)Google Scholar
  11. 11.
    Anderson, R.J.: The eternity service. In: 1st International Conference on the Theory and Applications of Cryptology (Pragocrypt 1996), pp. 242–252 (1996)Google Scholar
  12. 12.
    Nelson, M.L., Van de Sompel, H., Liu, X., Harrison, T.L.: mod oai: An apache module for metadata harvesting. Technical report, Old Dominion University (2005) arXiv cs.DL/0503069Google Scholar
  13. 13.
    Lagoze, C., Van de Sompel, H., Nelson, M.L., Warner, S.: The Open Archives Initiative Protocol for Metadata Harvesting,
  14. 14.
    Bekaert, J., Hochstenbach, P., Van de Sompel, H.: Using MPEG-21 DIDL to represent complex digital objects in the Los Alamos National Laboratory digital library. D-Lib Magazine 9(11) (November 2003), doi:10.1045/november2003-bekaertGoogle Scholar
  15. 15.
    Smith, J.A., Klein, M., Nelson, M.L.: Repository replication using NNTP and SMTP. Technical report, Old Dominion University (2006) arXiv cs.DL/0606008Google Scholar
  16. 16.
    Bekaert, J., Liu, X., Van de Sompel, H.: Representing digital assets for long-term preservation using MPEG-21 DID. In: Ensuring Long-term Preservation and Adding Value to Scientific and Technical data, PV 2005 (2005) arXiv cs.DL/0509084Google Scholar
  17. 17.
    Van de Sompel, H., Nelson, M.L., Lagoze, C., Warner, S.: Resource harvesting within the OAI-PMH framework. D-Lib Magazine 10(12) (December 2004), doi:10.1045/december2004-vandesompelGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Joan A. Smith
    • 1
  • Martin Klein
    • 1
  • Michael L. Nelson
    • 1
  1. 1.Department of Computer ScienceOld Dominion UniversityNorfolkUSA

Personalised recommendations