Unsupervised Segmentation of Bibliographic Elements with Latent Permutations
This paper introduces a novel approach for large-scale unsupervised segmentation of bibliographic elements. Our problem is to segment a word token sequence representing a citation into subsequences each corresponding to a different bibliographic element, e.g. authors, paper title, journal name, publication year, etc. Obviously, each bibliographic element should be represented by contiguous word tokens. We call this constraint contiguity constraint. Therefore, we should infer a sequence of assignments of word tokens to bibliographic elements so that this constraint is satisfied. Many HMM-based methods solve this problem by prescribing fixed transition patterns among bibliographic elements. In this paper, we use generalized Mallows models (GMM) in a Bayesian multi-topic model, effectively applied to document structure learning by Chen et al. , and infer a permutation of latent topics each of which can be interpreted as one among the bibliographic elements. According to the inferred permutation, we arrange the order of the draws from a multinomial distribution defined over topics. In this manner, we can obtain an ordered sequence of topic assignments satisfying contiguity constraint. We do not need to prescribe any transition patterns among bibliographic elements. We only need to specify the number of bibliographic elements. However, the method proposed by Chen et al. works for our problem only after introducing modification. The main contribution of this paper is to propose strategies to make their method work also for our problem.
Unable to display preview. Download preview PDF.
- 1.Andrzejewski, D., Zhu, X., Craven, M.: Incorporating Domain Knowedge into Topic Modeling via Dirichlet Forest Priors. In: Proc. of ICML (2009)Google Scholar
- 3.Connan, J., Omlin, C.W.: Bibliography Extraction with Hidden Markov Models. Tech. Rep. US-CS-TR-00-6, Univ. of Stellenbosch (2000)Google Scholar
- 4.Chen, H., Branavan, S.R.K., Barzilay, R., Karger, D.R.: Global Models of Document Structure Using Latent Permutations. In: Proc. of ACL, pp. 371–379 (2009)Google Scholar
- 5.Eisenstein, J., Barzilay, R.: Bayesian Unsupervised Topic Segmentation. In: Proc. of EMNLP, pp. 334–343 (2008)Google Scholar
- 8.Hetzner, E.: A Simple Method for Citation Metadata Extraction Using Hidden Markov Models. In: Proc. of JCDL, pp. 280–284 (2008)Google Scholar
- 9.Minka, T.: Estimating a Dirichlet Distribution (2000), http://research.microsoft.com/%7Eminka/papers/dirichlet/
- 10.Takasu, A.: Bibliographic Attribute Extraction from Erroneous References Based on a Statistical Model. In: Proc. of JCDL, pp. 49–60 (2003)Google Scholar