Advertisement

A New Plug-in System Supporting Very Large Digital Library

  • Jin Wang
  • Yong Zhang
  • Yang Gao
  • Chunxiao Xing
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8279)

Abstract

In the era of Big Data, actual demands of collecting large volumes of complex digital information have brought new challenges to digital library software. This scenario calls for the construction of Very Large Digital Library (VLDL). New approaches and technologies are needed to deal with the various issues in designing and developing VLDL. In this paper, we design a plug-in system—PuntStore as a general solution to very large digital library. PuntStore supports different kinds of storage engines and index engines to deal with the problem of storing and retrieving data efficiently. We also design a new index engine pLSM in PuntStore to meet the specific needs in digital libraries. The successful adoption of PuntStore in the project of the Digital Library on History of Science and Technology in China (DLHSTC) shows that PuntStore can function effectively in supporting VLDL systems.

Keywords

VLDL plug-in system PuntStore storage engine index 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Bentley, J.L.: Decomposable searching problems. Inf. Process. Lett. 8(5) (1979)Google Scholar
  2. 2.
    Candela, L., Athanasopoulos, G., Castelli, D., Raheb, K.E., Innocenti, P., Ioannidis, Y., Katifori, A., Nika, A., Vullo, G., Ross, S.: The Digital Library Reference Model. Deliverable D3.2b, DL.org (April 2011)Google Scholar
  3. 3.
    Farber, F., Cha, S.K., Primsch, J., Bornhovd, C., Sigg, S., Lehner, W.: SAP HANA Database - Data Management for Modern Business Applications. SIGMOD Record (2011)Google Scholar
  4. 4.
    Manghi, P., Pagano, P., Ioannidis, Y.: Second Workshop on Very Large Digital Libraries:in conjunction with the European Conference on Digital Libraries. SIGMOD Rec. 38, 46–48 (2010)CrossRefGoogle Scholar
  5. 5.
    O’Neil, P., Cheng, E., Gawlick, D., O’Neil, E.: The log-structured merge-tree (LSM-tree). Acta Informatica 33(4), 351–385 (1996)CrossRefGoogle Scholar
  6. 6.
    Phiri, L., Williams, K., Robinson, M., Hammar, S., Suleman, H.: Bonolo: A General Digital Library System for File-Based Collections. In: Chen, H.-H., Chowdhury, G. (eds.) ICADL 2012. LNCS, vol. 7634, pp. 49–58. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  7. 7.
    Thompson, J., Bainbridge, D., Suleman, H.: Towards Very Large Scale Digital LibraryBuilding in Greenstone Using Parallel Processing. In: ICADL 2011, pp. 332–341 (2011)Google Scholar
  8. 8.
    Wang, J., Zhang, Y., Gao, Y., Xing, C.: pLSM: A Highly Efficient LSM-Tree Index Supporting Real-Time Big Data Analysis. In: COMPSAC 2013, pp. 240–245 (2013)Google Scholar
  9. 9.
    Union E. Europeana (EB/OL) (2012), http://www.europeana.eu/portal/
  10. 10.
    Wikipedia. Database index (EB/OL) (2013), http://en.wikipedia.org/wiki/Database_index

Copyright information

© Springer International Publishing Switzerland 2013

Authors and Affiliations

  • Jin Wang
    • 1
  • Yong Zhang
    • 1
  • Yang Gao
    • 1
  • Chunxiao Xing
    • 1
  1. 1.Research Institute of Information Technology Tsinghua National Laboratory for Information Science and Technology Department of Computer Science and TechnologyTsinghua UniversityBeijingChina

Personalised recommendations