Towards Next Generation CiteSeer: A Flexible Architecture for Digital Library Deployment

  • I. G. Councill
  • C. L. Giles
  • E. Di Iorio
  • M. Gori
  • M. Maggini
  • A. Pucci
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4172)


CiteSeer began as the first search engine for scientific literature to incorporate Autonomous Citation Indexing, and has since grown to be a well-used, open archive for computer and information science publications, currently indexing over 730,000 academic documents. However, CiteSeer currently faces significant challenges that must be overcome in order to improve the quality of the service and guarantee that CiteSeer will continue to be a valuable, up-to-date resource well into the foreseeable future. This paper describes a new architectural framework for CiteSeer system deployment, named CiteSeer Plus. The new framework supports distributed indexing and storage for load balancing and fault-tolerance as well as modular service deployment to increase system flexibility and reduce maintenance costs. In order to facilitate novel approaches to information extraction, a blackboard framework is built into the architecture.


Digital Library Information Extraction Conditional Random Field Master Node Slave Node 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Buteau, B.L.: A generic framework for distributed, cooperating blackboard systems. In: Proceedings of the 1990 ACM annual conference on Cooperation, February 20-22, pp. 358–365 (1990)Google Scholar
  2. 2.
    Chen, H., Dhar, V.: A knowledge-based approach to the design of document-based retrieval systems. ACM SIGOIS Bulletin 11(2-3), 281–290 (1990)CrossRefGoogle Scholar
  3. 3.
    Garfield, E.: Science Citation Index - A new dimension in indexing. Science 144, 649–654 (1964)CrossRefGoogle Scholar
  4. 4.
    Giles, C.L., Bollacker, K., Lawrence, S.: CiteSeer: An Automatic Citation Indexing System. In: Digital Libraries 1998: Third ACM Conf. on Digital Libraries, pp. 89–98. ACM Press, New York (1998)CrossRefGoogle Scholar
  5. 5.
    Giles, C.L., Councill, I.G.: Who gets acknowledged: measuring scientific contributions through automatic acknowledgement indexing. PNAS 101(51), 17599–17604 (2004)CrossRefGoogle Scholar
  6. 6.
    Han, H., Lee Giles, C., Manavoglu, E., Zha, H., Zhang, Z., Fox, E.A.: Automatic Document Metadata Extraction using Support Vector Machines. In: Proceedings of the 2003 Joint Conference on Digital Libraries, JCDL 2003 (2003)Google Scholar
  7. 7.
    Lafferty, J., McCallum, A., Pereira, F.: Conditional Random Fields: Probabilistic models for segmenting and labeling sequence data. In: International Conference on Machine Learning (2001)Google Scholar
  8. 8.
    Lawrence, S., Lee Giles, C.: Searching the World Wide Web. Science 280(5360), 98–100 (1998)CrossRefGoogle Scholar
  9. 9.
    Leek, T.R.: Information extraction using hidden Markov models. Masters thesis, UC San Diego (1997)Google Scholar
  10. 10.
    Penny Nii, H.: Blackboard systems: The blackboard model of problem solving and the evolution of blackboard architectures. The AI Magazine VII(2), 38–53 (summer 1986)Google Scholar
  11. 11.
    O’Reilly, T.: What Is Web 2.0 Design Patterns and Business Models for the Next Generation of Software,
  12. 12.
    Peng, F., McCallum, A.: Accurate information extraction from research papers using conditional random fields. In: Proceedings of Human Language Technology Conference and North American Chapter of the Association for Computational Linguistics (HLT-NAACL), pp. 329–336 (2004)Google Scholar
  13. 13.
    Petinot, Y., Lee Giles, C., Bhatnagar, V., Teregowda, P.B., Han, H., Councill, I.: A Service-Oriented Architecture for Digital Libraries. In: ICSOC 2004, November 15-19 (2004)Google Scholar
  14. 14.
    Seymore, K., McCallum, A., Rosenfeld, R.: Learning hidden Markov model structure for information extraction. In: Papers from the AAAI 1999 Workshop on Machine Learning for Information Extration, July 1999, pp. 37–42 (1999)Google Scholar
  15. 15.
    Stribling, J., Councill, I.G., Kaashoek, M.F., Morris, R., Shenker, S.: Overcite: A cooperative digital research library. In: Castro, M., van Renesse, R. (eds.) IPTPS 2005. LNCS, vol. 3640, pp. 69–79. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  16. 16.
    Van de Sompel, H., Hochstenbach, P.: Reference linking in a hybrid library environment. Part 1: Frameworks for linking. D-Lib Magazine 5(4) (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • I. G. Councill
    • 1
  • C. L. Giles
    • 1
  • E. Di Iorio
    • 2
  • M. Gori
    • 2
  • M. Maggini
    • 2
  • A. Pucci
    • 2
  1. 1.School of Information Sciences and TechnologyThe Pennsylvania State UniversityUniversity ParkUSA
  2. 2.Dipartimento di Ingegneria dell’InformazioneUniversity of SienaSienaItaly

Personalised recommendations