A Framework for Weblog Data Analysis Using HIVE in Hadoop Framework

  • Pushpendra KumarEmail author
  • Ramjeevan Singh Thakur
Conference paper
Part of the Lecture Notes in Networks and Systems book series (LNNS, volume 34)


Web usage mining is the application of web mining, which performs analysis of user click-stream data. As growth of Internet users is increasing rapidly hence to gather information, analyze user behavior from click stream can be helpful to recommendation system and intelligent e-commerce applications. This paper presents the analysis of weblog data using Apache Hive which is Hadoop ecosystem.


Web mining Web log analysis Hadoop MapReduce Hive 


  1. 1.
    Lavanya, K.S., Srinivasa, R.: Customer behavior analysis of web server logs using Hive in Hadoop framework. Int. J. Adv. Netw. Appl. (IJANA), 409–412Google Scholar
  2. 2.
    Rosli, O., Abu, O. M.T., Zainatul, S.A.: Web usage mining: a review of recent works. In: Information and Communication Technology for The Muslim World (ICT4M). IEEE, Malaysia, pp. 1–5 (2014)Google Scholar
  3. 3.
    Vinod, K., Ramjeevan, S.T.: Exploring behavior of visitors activity at granular level from web log data using deep log analyzer. Int. J. Syst. Softw. Eng. 4, 16–26 (2016)Google Scholar
  4. 4.
    Shaily, G.L., Mehul, P.B., Darshak, B.M.: Web usage mining using association rule mining on clustered data for pattern discovery. Int. J. Data Mining Tech. Appl 02, 141–150 (2013)Google Scholar
  5. 5.
    Pooja, D.S., Debnath, B., Tai-hoon, K.: Hadoop based weblog analysis: a review. Int. J. Softw. Eng. Appl. 10, 13–30 (2016)Google Scholar
  6. 6.
    Bina, K., Ankit K., Bhaskar, P., RH G.: Big data: mining of log file through Hadoop. In: International Conference on Human Computer Interactions (ICHCI). IEEE, Chennai, pp. 1–7 (2013)Google Scholar
  7. 7.
    Neha, G., Jha, C.K.: Analyzing users behavior from web access logs using automated log analyzer tool. Int. J. Comput. Appl. 62, 29–33 (2013)Google Scholar
  8. 8.
    Brijesh, B., Ghanshyam, S.T.: user behavior analysis from web log using log analyzer tool. IJCSNS 1, 41–52 (2013)Google Scholar
  9. 9.
    Pushkar, G., Bhavika, G., Smruti, I., Seema, Y.: web server log processing using Hadoop. Int. J. Res. Eng. Appl. Manag. (IJREAM) 1 (2016)Google Scholar
  10. 10.
    Milind, B., Vikas, N.: Generic log analyzer using Hadoop MapReduce framework. Int. J. Emerg. Technol. Adv. Eng. 3, 603–609 (2013)Google Scholar
  11. 11.
    Vinod, K., Ramjeevan, S.T.: A Brief investigation on web usage mining tools. Saudi J. Eng. Technol., pp. 1–11 (2017)Google Scholar
  12. 12.
    Jaya, V.K., Alagarsamy, K.: Analyzing server log file using web log expert in web, data mining. Int. J. Sci. Environ. Technol. 2, 1008–1016 (2013)Google Scholar
  13. 13.
    Dhruba, B.: The Hadoop distributed file system: architecture and design. Hadoop Project Website (2007)Google Scholar
  14. 14.
  15. 15.
    Madhvaraj, M.S., Manjaiah, D.H.: Data security in Hadoop distributed file system. In: International Conference on Emerging Technological Trends (ICETT), Kollam, pp. 1–5 (2016)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  1. 1.Department of Computer ApplicationsMaulana Azad National Institute of TechnologyBhopalIndia

Personalised recommendations