Skip to main content

A Hybrid Framework Using Natural Language Processing and Collaborative Filtering for Performance Efficient Feedback Mining and Recommendation

  • Conference paper
  • First Online:
Big Data, Machine Learning, and Applications (BigDML 2021)

Abstract

Product development insights may be found through user reviews on App stores, product forums, and social media. This feedback is often regarded as the “voice of the users”. This feedback has been subject to a lot of recent research, intending to create systems that can automatically extract, filter, analyze, and report the concerned feedback data in near real time. As per our survey results, often this user feedbacks do not reach the concerned organization promptly due to the volume, veracity, and velocity of feedback from multiple channels. In this rese arch work, we propose using sentiment analysis and social media mining an automatic engine which can be used for better product recommendation and automatic routing of relevant feedback to the product development teams. Our proposed solution is scheduled to run at regular intervals pulling dynamic reviews in an optimized manner with a lesser time complexity and higher efficiency. The reviews are collated from distributed platforms followed by building a domain classification engine on the principles of TF-IDF and Supervised Classifier. This system is used to classify the reviews of the respective enterprises. A sentiment analysis system is built using combined Rule-Based Mining and Supervised Learning Models which makes use of polarity to classify if the feedback is positive or negative. If the polarity is negative, the feedback gets routed to the concerned enterprise for immediate action and if the polarity is positive, it is passed to a user-based collaborative filtering engine which acts as a recommendation system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Guzman E, Alkadhi R, Seyff N (Sep 2016) A needle in a haystack: What do twitter users say about software?. In: 2016 IEEE 24th international requirements engineering conference (RE), pp 96–105

    Google Scholar 

  2. Pagano D, Maalej W (Jul 2013) User feedback in the appstore: an empirical study. In: 2013 21st IEEE international requirements engineering conference (RE), pp 125–134

    Google Scholar 

  3. Tizard J, Wang H, Yohannes L, Blincoe K (2019) Can a conversation paint a picture? Mining requirements in software forums. In: IEEE 27th International Requirements Engineering Conference (RE). IEEE, pp 17–27

    Google Scholar 

  4. Guzman E, Alkadhi R, Seyff N (Jul 2017) An exploratory study of twitter messages about software applications. Requirements engineering

    Google Scholar 

  5. Wang X, Wei F, Liu X, Zhou M, Zhang M (2011) Topic sentiment analysis in twitter: a graph-based hashtag sentiment classification approach. In: Proceedings of the 20th international conference on information & knowledge management. ACM, pp 1031–1040

    Google Scholar 

  6. Feldman R (2013) Techniques and applications for sentiment analysis. Commun ACM (CACM) 56(4):82–89

    Article  Google Scholar 

  7. Wilson T, Wiebe J, Hoffmann P (2005) Recognizing contextual polarity in phrase-level sentiment analysis. In: Proceedings of the conference on human language technology and empirical methods in natural language processing (HLT/EMNLP). Association for computational linguistics, pp 347–354

    Google Scholar 

  8. Choi Y, Deng L, Wiebe J (2014) Lexical acquisition for opinion inference: a sense-level lexicon of benefactive and malefactive events. In: Proceedings of the 5th workshop on computational approaches to subjectivity, sentiment and social media analysis (WASSA), pp 107–112

    Google Scholar 

  9. Qaiser S, Ali R (2018) Text mining: use of TF-IDF to examine the relevance of words to documents. Int J Comput Appl (0975-8887)

    Google Scholar 

  10. Ren Q, Cheng H, Han H (2017) Research on machine learning framework based on random forest algorithm

    Google Scholar 

  11. Brusilovsky P, Kobsa A, Nejdl W (eds) (2007) The adaptive web. LNCS, vol 4321, pp 291–324. \(\copyright \) Springer, Berlin, Heidelberg. Schafer JB, Frankowski D, Herlocker J, Sen S (2007) Collaborative filtering recommender systems

    Google Scholar 

  12. Bajic D, Lyons K (May 2011) Leveraging social media to gather user feedback for software development. In: Proceedings of the 2nd international workshop on web 2.0 software engineering, pp 1–6

    Google Scholar 

  13. Hasson SG, Piorkowski J, McCulloh I (2019) Social media as a main source of customer feedback: alternative to customer satisfaction surveys. In: ASONAM 2019, pp 829–832

    Google Scholar 

  14. Deng Q, Franke M, Hribernik K, Thoben KD (2017) Exploring the integration of social media feedback for user-oritented product development. In: Proceedings of the 21st ICED 2017, pp 453–462

    Google Scholar 

  15. Manning CD, Raghavan P, Schütze H (2008) Introduction to information retrieval. Cambridge University Press

    Google Scholar 

  16. Senbagaraman M, Senthilkumar R, Subasankar S, Indira R (2017) A movie recommendation system using collaborative approach and cuttlefish optimization. In: International conference on emerging trends in engineering, science and sustainable technology (ICETSST)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kathakali Mitra .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mitra, K., Parthasarathy, P.D. (2024). A Hybrid Framework Using Natural Language Processing and Collaborative Filtering for Performance Efficient Feedback Mining and Recommendation. In: Borah, M.D., Laiphrakpam, D.S., Auluck, N., Balas, V.E. (eds) Big Data, Machine Learning, and Applications. BigDML 2021. Lecture Notes in Electrical Engineering, vol 1053. Springer, Singapore. https://doi.org/10.1007/978-981-99-3481-2_40

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-3481-2_40

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-3480-5

  • Online ISBN: 978-981-99-3481-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics