Citation recommendation is an important task to assist scholars in finding candidate literature to cite. Traditional studies focus on static models of recommending citations, which do not explicitly distinguish differences between papers that are caused by temporal variations. Although, some researchers have investigated chronological citation recommendation by adding time related function or modeling textual topics dynamically. These solutions can hardly cope with function generalization or cold-start problems when there is no information for user profiling or there are isolated papers never being cited. With the rise and fall of science paradigms, scientific topics tend to change and evolve over time. People would have the time preference when citing papers, since most of the theoretical basis exist in classical readings that published in old time, while new techniques are proposed in more recent papers. To explore chronological citation recommendation, this paper wants to predict the time preference based on user queries, which is a probability distribution of citing papers published in different time slices. Then, we use this time preference to re-rank the initial citation list obtained by content-based filtering. Experimental results demonstrate that task performance can be further enhanced by time preference and it’s flexible to be added in other citation recommendation frameworks.
This is a preview of subscription content, access via your institution.
Buy single article
Instant access to the full article PDF.
Price excludes VAT (USA)
Tax calculation will be finalised during checkout.
Available at: https://www.ncbi.nlm.nih.gov/pmc/.
Available at: https://www.aminer.cn/citation.
Available at: https://github.com/usnistgov/trec_eval.
Available at: https://radimrehurek.com/gensim/models/doc2vec.html.
Available at: https://github.com/thunlp/OpenNE.
Available at: https://scikit-learn.org/stable/modules/preprocessing.html.
Available at: https://radimrehurek.com/gensim/models/ldaseqmodel.html.
Available at: https://github.com/elifesciences/citerank.
Available at: https://www.ncbi.nlm.nih.gov/pubmed/?term=22775499%5Buid%5D.
Available at: https://www.ncbi.nlm.nih.gov/pubmed/?term=21048124%5Buid%5D.
Available at: https://www.ncbi.nlm.nih.gov/pubmed/?term=12722974%5Buid%5D.
Available at: https://www.ncbi.nlm.nih.gov/pubmed/?term=20808844%5Buid%5D.
Available at: https://www.ncbi.nlm.nih.gov/pubmed/?term=18757819%5Buid%5D.
Available at: https://www.ncbi.nlm.nih.gov/pubmed/?term=15335669%5Buid%5D.
Available at: https://www.ncbi.nlm.nih.gov/pubmed/?term=9157250%5Buid%5D.
Available at: https://www.ncbi.nlm.nih.gov/pubmed/?term=19251655%5Buid%5D.
Available at: https://www.ncbi.nlm.nih.gov/pubmed/?term=17276342%5Buid%5D.
Arif, M. A. (2016). Content aware citation recommendation system. Paper presented at the 2016 International Conference on Emerging Technological Trends (ICETT).
Blei, D. M., & Lafferty, J. D. (2006). Dynamic topic models. Paper presented at the Proceedings of the 23rd international conference on Machine learning.
Bornmann, L., & Mutz, R. (2015). Growth rates of modern science: A bibliometric analysis based on the number of publications and cited references. Journal of the Association for Information Science and Technology, 66(11), 2215–2222. https://doi.org/10.1002/asi.23329.
Cai, X., Han, J., Li, W., Zhang, R., Pan, S., & Yang, L. (2018a). A three-layered mutually reinforced model for personalized citation recommendation. IEEE Transactions on Neural Networks and Learning Systems, 99, 1–12.
Cai, X., Han, J., & Yang, L. (2018). Generative adversarial network based heterogeneous bibliographic network representation for personalized citation recommendation. Paper presented at the Thirty-second AAAI conference on artificial intelligence.
Chaudhuri, B., & Bhattacharya, U. (2000). Efficient training and improved performance of multilayer perceptron in pattern classification. Neurocomputing, 34(1–4), 11–27.
Chen, J., Liu, Y., Zhao, S., & Zhang, Y. (2019). Citation recommendation based on weighted heterogeneous information network containing semantic linking. Paper presented at the 2019 IEEE International Conference on Multimedia and Expo (ICME).
Craswell, N. (2009). Mean reciprocal rank. Encyclopedia of Database Systems, 1703–1703.
Dai, T., Zhu, L., Wang, Y., & Carley, K. M. (2019). Attentive stacked denoising autoencoder with Bi-LSTM for personalized context-aware citation recommendation. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 28, 553–568.
El-Arini, K., & Guestrin, C. (2011). Beyond keyword search: discovering relevant scientific literature. Paper presented at the Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining.
Färber, M., Thiemann, A., & Jatowt, A. (2018). CITEWERTs: A system combining cite-worthiness with citation recommendation. Paper presented at the European Conference on Information Retrieval.
Grover, A., & Leskovec, J. (2016). node2vec: Scalable feature learning for networks. Paper presented at the Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining.
Guo, L., Cai, X., Hao, F., Mu, D., Fang, C., & Yang, L. (2017). Exploiting fine-grained co-authorship for personalized citation recommendation. IEEE Access, 5, 12714–12725.
He, Q., Kifer, D., Pei, J., Mitra, P., & Giles, C. L. (2011). Citation recommendation without author supervision. Paper presented at the Proceedings of the fourth ACM international conference on Web search and data mining, Hong Kong, China.
He, Q., Pei, J., Kifer, D., Mitra, P., & Giles, L. (2010). Context-aware citation recommendation. Paper presented at the Proceedings of the 19th international conference on World wide web, Raleigh, North Carolina, USA.
Hernando, A., Bobadilla, J., & Ortega, F. (2016). A non negative matrix factorization for collaborative filtering recommender systems based on a Bayesian probabilistic model. Knowledge-Based Systems, 97, 188–202.
Hong, K., Jeon, H., & Jeon, C. (2013). Personalized research paper recommendation system using keyword extraction based on userprofile. Journal of Convergence Information Technology, 8(16), 106.
Huang, W., Kataria, S., Caragea, C., Mitra, P., Giles, C. L., & Rokach, L. (2012). Recommending citations: Translating papers into references. Paper presented at the CIKM.
Huang, W., Wu, Z., Liang, C., Mitra, P., & Giles, C. L. (2015). A neural probabilistic model for context based citation recommendation. Paper presented at the Twenty-Ninth AAAI Conference on Artificial Intelligence.
Jiang, Z., Liu, X., & Gao, L. (2014). Dynamic topic/citation influence modeling for chronological citation recommendation. Paper presented at the Proceedings of the 5th International Workshop on Web-scale Knowledge Representation Retrieval & Reasoning.
Jiang, Z., Liu, X., & Gao, L. (2015). Chronological citation recommendation with information-need shifting. Paper presented at the Proceedings of the 24th ACM international on conference on information and knowledge management.
Kazemi, B., & Abhari, A. (2017). A comparative study on content-based paper-to-paper recommendation approaches in scientific literature. Paper presented at the proceedings of the 20th communications & networking symposium.
Khusro, S., Ali, Z., & Ullah, I. (2016). Recommender systems: issues, challenges, and research opportunities. In Information Science and Applications (ICISA) 2016 (pp. 1179–1189): Springer.
Kingma, D. P., & Ba, J. (2014). Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980.
Le, Q., & Mikolov, T. (2014). Distributed representations of sentences and documents. Paper presented at the International conference on machine learning.
Liu, H., Kong, X., Bai, X., Wang, W., Bekele, T. M., & Xia, F. (2015). Context-based collaborative filtering for citation recommendation. IEEE Access, 3, 1695–1703.
Liu, X., Yu, Y., Guo, C., & Sun, Y. (2014). Meta-path-based ranking with pseudo relevance feedback on heterogeneous graph for citation recommendation. Paper presented at the Proceedings of the 23rd acm international conference on conference on information and knowledge management.
Ma, S., Liu, X., & Zhang, C. (2020). A review of citation recommendation: From textual content to enriched context. Scientometrics. https://doi.org/10.1007/s11192-019-03336-0.
Magara, M. B., Ojo, S. O., & Zuva, T. (2018). A comparative analysis of text similarity measures and algorithms in research paper recommender systems. Paper presented at the 2018 Conference on Information Communications Technology and Society (ICTAS).
Mahdabi, P., & Crestani, F. (2014). Query-driven mining of citation networks for patent citation retrieval and recommendation. Paper presented at the Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management.
Meng, F., Gao, D., Li, W., Sun, X., & Hou, Y. (2013). A unified graph model for personalized query-oriented reference paper recommendation. Paper presented at the Proceedings of the 22nd ACM international conference on Information & Knowledge Management.
Mihalcea, R., Corley, C., & Strapparava, C. (2006). Corpus-based and knowledge-based measures of text semantic similarity. Paper presented at the Aaai.
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013). Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781.
Mukherjee, S., Romero, D. M., Jones, B., & Uzzi, B. (2017). The nearly universal link between the age of past knowledge and tomorrow’s breakthroughs in science and technology: The hotspot. Science Advances, 3(4), e1601315.
Sun, J., Jiang, Y., Cheng, X., Du, W., Liu, Y., & Ma, J. (2018). A hybrid approach for article recommendation in research social networks. Journal of Information Science, 44(5), 696–711.
Sun, J., Ma, J., Liu, X., Liu, Z., Wang, G., Jiang, H., & Silva, T. (2013). A novel approach for personalized article recommendation in online scientific communities. Paper presented at the 2013 46th Hawaii International Conference on System Sciences.
Tang, J., & Zhang, J. (2009). A discriminative approach to topic-based citation recommendation. In T. Theeramunkong, B. Kijsirikul, N. Cercone, & T.-B. Ho (Eds.), Advances in knowledge discovery and data mining: 13th Pacific-Asia Conference, PAKDD 2009 Bangkok, Thailand, April 27–30, 2009 Proceedings (pp. 572–579). Berlin: Springer.
Voorhees, E. M. (2000). Variations in relevance judgments and the measurement of retrieval effectiveness. Information Processing & Management, 36(5), 697–716.
Walker, D., Xie, H., Yan, K.-K., & Maslov, S. (2007). Ranking scientific publications using a model of network traffic. Journal of Statistical Mechanics: Theory and Experiment, 2007(06), P06010.
Wu, H., Hua, Y., Li, B., & Pei, Y. (2012). Enhancing citation recommendation with various evidences. Paper presented at the 2012 9th international conference on fuzzy systems and knowledge discovery.
Yilmaz, E., Kanoulas, E., & Aslam, J. A. (2008). A simple and efficient sampling method for estimating AP and NDCG. Paper presented at the Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval.
This work is supported by the National Natural Science Foundation of China (No. 72074113), Science Fund for Creative Research Group of the National Natural Science Foundation of China (No. 71921002) and Major Projects of National Social Science Fund (No. 16ZDA224).
About this article
Cite this article
Ma, S., Zhang, H., Zhang, C. et al. Chronological citation recommendation with time preference. Scientometrics 126, 2991–3010 (2021). https://doi.org/10.1007/s11192-021-03878-2