Skip to main content
SpringerLink
Log in

A Fast Multi-level Plagiarism Detection Method Based on Document Embedding Representation

  • Conference paper
  • First Online:
Text Processing (FIRE 2016)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10478))

Included in the following conference series:

Abstract

Nowadays, global networks facilitate access to vast amount of textual information and enhance the feasibility of plagiarism as a consequence. Given the amount of text material produced everyday, the need for an automated fast plagiarism detection system is more crucial than ever. Plagiarism detection is defined as identification of reused text materials. In this regard, different algorithms have been proposed to perform the task of plagiarism detection in text documents. Due to limitation in semantic representation and computational inefficiency of traditional algorithms for plagiarism detection, in this paper, we proposed an embedding based document representation to detect plagiarism in documents using a two-level decision making approach. The method is language-independent and works properly on various languages as well. In the proposed method, words are represented as multi-dimensional vectors, and simple aggregation methods are used to combine the word vectors in order to represent sentences. By comparing representations of source and suspicious sentences, sentence pairs with the highest similarity score are considered as the candidates of the plagiarism cases. The final decision whether or not the pairs are plagiarized is taken using another level of similarity calculation using Jaccard metric by comparing the word sets of two sentences. Our method has been used in PAN2016 Persian plagiarism detection contest and results in 85.8% recall, 95.9% precision and 90.6% plagdet which is a combination of the these two measures with the measure of how concretely we retrieve plagiarism cases, on the provided data sets in a short amount of time. This method achieved the second place regarding plagdet and the first rank based on runtime.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Manning, C.D., Schütze, H.: Foundations of Statistical Natural Language Processing, vol. 999. MIT Press, Cambridge (1999)

    MATH  Google Scholar 

  2. Clough, P.: Old and new challenges in automatic plagiarism detection. National Plagiarism Advisory Service, p. 14, February 2003

    Google Scholar 

  3. Chong, M.Y.M.: A study on plagiarism detection and plagiarism direction identification using natural language processing techniques (2013)

    Google Scholar 

  4. Lathrop, A., Foss, K.: Student Cheating and Plagiarism in the Internet Era. A Wake-Up Call. Libraries Unlimited Inc., Englewood (2000)

    Google Scholar 

  5. Maurer, H., Zaka, B.: Plagiarism-a problem and how to fight it. In: Proceedings of Ed-Media, pp. 4451–4458 (2007)

    Google Scholar 

  6. Hoad, T.C., Zobel, J.: Methods for identifying versioned and plagiarized documents. J. Am. Soc. Inf. Sci. Technol. 54(3), 203–215 (2003)

    Article  Google Scholar 

  7. Bengio, Y., Ducharme, R., Vincent, P., Jauvin, C.: A neural probabilistic language model. J. Mach. Learn. Res. 3(Feb), 1137–1155 (2003)

    MATH  Google Scholar 

  8. Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., Kuksa, P.: Natural language processing (almost) from scratch. J. Mach. Learn. Res. 12, 2493–2537 (2011)

    MATH  Google Scholar 

  9. Hinton, G.E., Osindero, S., Teh, Y.-W.: A fast learning algorithm for deep belief nets. Neural Comput. 18(7), 1527–1554 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  10. Roy, D., Ganguly, D., Mitra, M., Jones, G.J.: Representing documents and queries as sets of word embedded vectors for information retrieval arXiv preprint arXiv:1606.07869 (2016)

  11. Roy, D., Ganguly, D., Mitra, M., Jones, G.J.: Word vector compositionality based relevance feedback using kernel density estimation. In: Proceedings of the 25th ACM International on Conference on Information and Knowledge Management, pp. 1281–1290. ACM (2016)

    Google Scholar 

  12. Guo, J., Fan, Y., Ai, Q., Croft, W.B.: A deep relevance matching model for ad-hoc retrieval. In: Proceedings of the 25th ACM International on Conference on Information and Knowledge Management, pp. 55–64. ACM (2016)

    Google Scholar 

  13. Ganguly, D., Roy, D., Mitra, M., Jones, G.J.: Word embedding based generalized language model for information retrieval. In: Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 795–798. ACM (2015)

    Google Scholar 

  14. Mitchell, J., Lapata, M.: Composition in distributional models of semantics. Cogn. Sci. 34(8), 1388–1429 (2010)

    Article  Google Scholar 

  15. Socher, R.: Recursive deep learning for natural language processing and computer vision. Ph.D. thesis, Citeseer (2014)

    Google Scholar 

  16. Ai, Q., Yang, L., Guo, J., Croft, W.B.: Analysis of the paragraph vector model for information retrieval. In: Proceedings of the 2016 ACM on International Conference on the Theory of Information Retrieval, pp. 133–142. ACM (2016)

    Google Scholar 

  17. Chen, C.-Y., Yeh, J.-Y., Ke, H.-R.: Plagiarism detection using ROUGE and WordNet. J. Comput. 2(3), 34–44 (2010)

    Google Scholar 

  18. Elhadi, M., Al-Tobi, A.: Use of text syntactical structures in detection of document duplicates. In: 3rd International Conference on Digital Information Management, ICDIM 2008, pp. 520–525 (2008)

    Google Scholar 

  19. Elhadi, M., Al-Tobi, A.: Duplicate detection in documents and WebPages using improved longest common subsequence and documents syntactical structures. In: Fourth International Conference on Computer Sciences and Convergence Information Technology, ICCIT 2009, pp. 679–684. IEEE (2009)

    Google Scholar 

  20. Glinos, D.S.: A hybrid architecture for plagiarism detection. In: CLEF (Working Notes), pp. 958–965 (2014)

    Google Scholar 

  21. Nahnsen, T., Uzuner, O., Katz, B.: Lexical chains and sliding locality windows in content-based text similarity detection (2005)

    Google Scholar 

  22. Suchomel, S., Kasprzak, J., Brandejs, M., et al.: Three way search engine queries with multi-feature document comparison for plagiarism detection. In: CLEF (Online Working Notes/Labs/Workshop), pp. 1–8. Citeseer (2012)

    Google Scholar 

  23. Zini, M., Fabbri, M., Moneglia, M., Panunzi, A.: Plagiarism detection through multilevel text comparison. In: 2006 Second International Conference on Automated Production of Cross Media Content for Multi-Channel Distribution (AXMEDIS 2006), pp. 181–185. IEEE (2006)

    Google Scholar 

  24. Mahdavi, P., Siadati, Z., Yaghmaee, F.: Automatic external Persian plagiarism detection using vector space model. In: 2014 4th International eConference on Computer and Knowledge Engineering (ICCKE), pp. 697–702. IEEE (2014)

    Google Scholar 

  25. Mahmoodi, M., Varnamkhasti, M.M.: Design a Persian automated plagiarism detector (AMZPPD). arXiv preprint arXiv:1403.1618 (2014)

  26. Torres, S., Gelbukh, A.: Comparing similarity measures for original wsd lesk algorithm. Res. Comput. Sci. 43, 155–166 (2009)

    Google Scholar 

  27. Franco-Salvador, M., Bensalem, I., Flores, E., Gupta, P., Rosso, P.: Pan 2015 shared task on plagiarism detection: evaluation of corpora for text alignment. In: Volume 1391 of CEUR workshop proceedings, CLEF and CEUR-WS.org (2015)

    Google Scholar 

  28. Asghari, H., Mohtaj, S., Fatemi, O., Faili, H., Rosso, P., Potthast, M.: Algorithms and corpora for Persian plagiarism detection: overview of pan at fire 2016. In: Working notes of FIRE 2016-Forum for Information Retrieval Evaluation, pp. 7–10 (2016)

    Google Scholar 

  29. Shamsfard, M., Hesabi, A., Fadaei, H., Mansoory, N., Famian, A., Bagherbeigi, S., Fekri, E., Monshizadeh, M., Assi, S.M.: Semi automatic development of FarsNet; the Persian Wordnet. In: Proceedings of 5th Global WordNet Conference, Mumbai, India, vol. 29 (2010)

    Google Scholar 

  30. Socher, R., Huang, E.H., Pennin, J., Manning, C.D., Ng, A.Y.: Dynamic pooling and unfolding recursive autoencoders for paraphrase detection. In: Advances in Neural Information Processing Systems, pp. 801–809 (2011)

    Google Scholar 

  31. Bengio, Y.: Learning deep architectures for AI. Foundations and trends® Mach. Learn. 2(1), 1–127 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  32. Bengio, Y., Courville, A., Vincent, P.: Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35(8), 1798–1828 (2013)

    Article  Google Scholar 

  33. Dahl, G., Ranzato, M., Mohamed, A.-R., Hinton, G.: Phone recognition with the mean-covariance restricted Boltzmann machine. In: Advances in Neural Information, pp. 469–477 (2010)

    Google Scholar 

  34. Collobert, R., Weston, J.: A unified architecture for natural language processing: deep neural networks with multitask learning. In: International Conference on Machine Learning, vol. 20, p. 160–167 (2008)

    Google Scholar 

  35. Firth, J.R.: A synopsis of linguistic theory 1930–55. Studies in Linguistic Analysis (special volume of the Philological Society), vol. 1952-1959, pp. 1–32 (1957)

    Google Scholar 

  36. Hinton, G.E.: Learning distributed representations of concepts. In: Proceedings of the Eighth Annual Conference of the Cognitive Science Society, Amherst, MA, vol. 1, p. 12 (1986)

    Google Scholar 

  37. Bengio, Y., Schwenk, H., Sencal, J.S., Morin, F., Gauvain, J.L.: Neural probabilistic language models. Stud. Fuzziness Soft Comput. 194, 137–186 (2006)

    Article  Google Scholar 

  38. Mikolov, T., Yih, W.-T., Zweig, G.: Linguistic regularities in continuous space word representations. HLT-NAACL 13, 746–751 (2013)

    Google Scholar 

  39. Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013)

  40. Pennington, J., Socher, R., Manning, C.D.: Glove: global vectors for word representation. EMNLP 14, 1532–43 (2014)

    Google Scholar 

  41. Le, Q.V., Mikolov, T.: Distributed representations of sentences and documents. ICML 14, 1188–1196 (2014)

    Google Scholar 

  42. Potthast, M., Stein, B., Barrón-Cedeño, A., Rosso, P.: An evaluation framework for plagiarism detection. In: Proceedings of the 23rd International Conference on Computational Linguistics: Posters, pp. 997–1005. Association for Computational Linguistics (2010)

    Google Scholar 

  43. Gollub, T., Stein, B., Burrows, S.: Ousting ivory tower research: towards a web framework for providing experiments as a service. In: Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1125–1126. ACM (2012)

    Google Scholar 

  44. Potthast, M., Gollub, T., Rangel, F., Rosso, P., Stamatatos, E., Stein, B.: Improving the reproducibility of PAN’s shared tasks: In: Kanoulas, E., Lupu, M., Clough, P., Sanderson, M., Hall, M., Hanbury, A., Toms, E. (eds.) CLEF 2014. LNCS, vol. 8685, pp. 268–299. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-11382-1_22

    Google Scholar 

Download references

Acknowledgments

The authors would like to thank the reviewers for providing helpful comments and recommendations which improve the paper significantly.

Author information

Authors and Affiliations

  1. Faculty of New Sciences and Technologies, University of Tehran, Tehran, Iran

    Erfaneh Gharavi, Hadi Veisi, Kayvan Bijari & Kiarash Zahirnia

Authors
  1. Erfaneh Gharavi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hadi Veisi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kayvan Bijari
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kiarash Zahirnia
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hadi Veisi .

Editor information

Editors and Affiliations

  1. DAIICT, Gujarat, India

    Prasenjit Majumder

  2. Indian Statistical Institute, Kolkata, India

    Mandar Mitra

  3. DAIICT, Gujarat, India

    Parth Mehta

  4. DAIICT, Gujarat, India

    Jainisha Sankhavara

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Gharavi, E., Veisi, H., Bijari, K., Zahirnia, K. (2018). A Fast Multi-level Plagiarism Detection Method Based on Document Embedding Representation. In: Majumder, P., Mitra, M., Mehta, P., Sankhavara, J. (eds) Text Processing. FIRE 2016. Lecture Notes in Computer Science(), vol 10478. Springer, Cham. https://doi.org/10.1007/978-3-319-73606-8_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-73606-8_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-73605-1

  • Online ISBN: 978-3-319-73606-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation