Customer Feedback and Data Collection Techniques in Software R&D: A Literature Review

  • Aleksander FabijanEmail author
  • Helena Holmström Olsson
  • Jan Bosch
Part of the Lecture Notes in Business Information Processing book series (LNBIP, volume 210)


In many companies, product management struggles in getting accurate customer feedback. Often, validation and confirmation of functionality with customers takes place only after the product has been deployed, and there are no mechanisms that help product managers to continuously learn from customers. Although there are techniques available for collecting customer feedback, these are typically not applied as part of a continuous feedback loop. As a result, the selection and prioritization of features becomes far from optimal, and product deviates from what the customers need. In this paper, we present a literature review of currently recognized techniques for collecting customer feedback. We develop a model in which we categorize the techniques according to their characteristics. The purpose of this literature review is to provide an overview of current software engineering research in this area and to better understand the different techniques that are used for collecting customer feedback.


Customer feedback Data collection The ‘open loop’ problem Qualitative feedback Quantitative data 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Olsson, H.H., Alahyari, H., Bosch, J.: Climbing the “Stairway to Heaven”. In: 2012 38th EUROMICRO Conference on Software Engineering and Advanced Applications Software Engineering and Advanced Applications (SEAA), Izmir, Turkey (2012)Google Scholar
  2. 2.
    Olsson, H.H., Bosch, J.: From Opinions to Data-Driven Software R&D. In: Proceedings of the 40th Euromicro Conference on Software Engineering and Advance Applications, Verona, Italy (2014)Google Scholar
  3. 3.
    Sommerville, I., Kotonya, G.: Requirements engineering: processes and techniques. John Wiley & Sons, Inca. (1998)Google Scholar
  4. 4.
    Bosch-Sijtsema, P., Bosch, J.: User involvement throughout the innovation process in high-tech industries. Journal of Product Innovation Management (October 2014)Google Scholar
  5. 5.
    Kitchenham, B.: Procedures for Performing Systematic Reviews (2004)Google Scholar
  6. 6.
    Kabbedijk, J., Brinkkemper, S., Jansen, S., van der Veldt, B.: Customer Involvement in Requirements Management: Lessons from Mass Market Software Development. In: Requirements Engineering Conference (2009)Google Scholar
  7. 7.
    Yiyi, Y., Rongqiu, C.: Customer Participation: Co-Creating Knowledge with Customers. In: Wireless Communications, Networking and Mobile Computing (2008)Google Scholar
  8. 8.
    Nielsen Holdings Winning with Innovation. An Introduction to BASES,
  9. 9.
    Sampson, S.E.: Ramifications of Monitoring Service Quality Through Passively Solicited Customer Feedback. Decision Sciences 27(4), 601–622 (1996)MathSciNetCrossRefGoogle Scholar
  10. 10.
    Axelos Global Best Practice – ITIL,
  11. 11.
    Christian, B.: The A/B Test: Inside the Technology That’s Changing the Rules of Business,
  12. 12.
    Burns, H.S., Halliburton, R.A.: Tackling productivity and quality through customer involvement and software technology. In: Global Telecommunications Conference and Exhibition ‘Communications Technology for the 1990s and Beyond’ (1989)Google Scholar
  13. 13.
    Cohan, S.: Successful Customer Collaboration Resulting in the Right Product for the End User. In: Conference, AGILE 2008, August 4-8, pp. 284–288 (2008)Google Scholar
  14. 14.
    Martin, A., Biddle, R., Noble, J.: XP Customer Practices: A Grounded Theory, Agile Conference. In: Conference, AGILE 2009, August 24-28, pp. 33–40 (2009)Google Scholar
  15. 15.
    Jin, D., Chai, K.H., Tan, K.C.: New service development success factors: A managerial perspective. In: 2010 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM), pp. 2009–2013 (2010)Google Scholar
  16. 16.
    Chen, X.Y., Chen, C.H., Leong, K.F.: A novel virtual design platform for product innovation through customer involvement. In: 2011 IEEE International Conference on Industrial Engineering and Engineering Management Industrial Engineering and Engineering Management (IEEM), December 6-9, pp. 342–346 (2011)Google Scholar
  17. 17.
    Bosch, J.: Building Products as Innovations Experiment Systems. In: Proceedings of 3rd International Conference on Software Business, Cambridge, Massachusetts, June 18-20 (2012)Google Scholar
  18. 18.
    Chen, H., Chiang, R., Storey, C.: Business intelligence and analytics: from big data to big impact. MIS Q. 36(4), 1165–1188 (2012)Google Scholar
  19. 19.
    Westerlund, M., Leminen, S., Rajahonka, M.: Designing Business Models for the Internetof Things. Technology Innovation and Management Review, 5–14 (July 2014)Google Scholar
  20. 20.
    Markey, R., Reichheld, F.: Dullweber. A.: Closing the Customer Feedback Loop. Harvard Business Review (2009)Google Scholar
  21. 21.
    Mack, N., Woodsong, C., Macqueen, K.M., Guest, G., Namey, E.: Qualitative Research Methods: A Data Collector’s Field Guide. Family Health International (2005)Google Scholar
  22. 22.
    Balnaves, M., Caputi, P.: Introduction to Quantitative Research Methods. SAGE Publications Ltd. (2001)Google Scholar
  23. 23.
    Corbin, J., Strauss, A.: Basics of qualitative research, 3rd edn. Sage, Thousand Oaks (2008)Google Scholar
  24. 24.
    Bhatia, S., Li, J., Peng, W., Sun, T.: Monitoring and analyzing customer feedback through social media platforms for identifying and remedying customer problems. In: 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM), August 25-28, pp. 1147–1154 (2013)Google Scholar
  25. 25.
    Olsson, H.H., Bosch, J.: Towards Data-Driven Product Development: A Multiple Case Study on Post-deployment Data Usage in Software-Intensive Embedded Systems. Springer, Heidelberg (2013)Google Scholar
  26. 26.
    Kohavi, R., Longbotham, R., Sommerfield, D., Henne, R.M.: Controlled experiments on the web: survey and practice guide. Data Mining and Knowledge Discovery 18(1), 140–181 (2009)MathSciNetCrossRefGoogle Scholar
  27. 27.
    Manikas, K., Hansen, K.M.: Software ecosystems - A systematic literature review. Journal of Systems and Software 86(5), 1294–1306 (2012)CrossRefGoogle Scholar
  28. 28.
    Zarour, M., Abran, A., Desharnais, J., Alarifi, A.: An investigation into the best practices for the successful design and implementation of lightweight software process assessment methods: A systematic literature review. Journal of Systems and Software 101(0), 180–192 (2015)CrossRefGoogle Scholar
  29. 29.
    Pang, B., Lee, L.: Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval 2(1-2) (2008)Google Scholar
  30. 30.
  31. 31.
    Iivari, J., Venable J.R.: Action research and design science research – Seemingly similar but decisively dissimilar. In: ECIS 2009 Proceedings, paper 73 (2009)Google Scholar
  32. 32.
    Henfridsson, O., Lindgren, R.: User involvement in developing mobile and temporarily interconnected systems. Information Systems Journal 20(2), 119–135 (2010)CrossRefGoogle Scholar
  33. 33.
    Zhao, J., Dong, L., Wu, J., Xu, K.: MoodLens: an emoticon-based sentiment analysis system for chinese tweets. In: Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2012), pp. 1528–1531. ACM, New York (2012)CrossRefGoogle Scholar
  34. 34.
    Hess, J., Randall, D., Pipek, V., Wulf, V.: Involving users in the wild—Participatory product development in and with online communities. International Journal of Human-Computer Studies 71(5), 570–589 (2013)CrossRefGoogle Scholar
  35. 35.
    Molnar, K.K., Kletke, M.G.: The impacts on user performance and satisfaction of a voice-based front-end interface for a standard software tool. International Journal of Human-Computer Studies 45(3), 287–303 (1996)CrossRefGoogle Scholar
  36. 36.
    Hilbert, D.M., Redmiles, D.F.: Large-scale collection of usage data to inform design. In: Human-Computer Interaction—INTERACT 2001: Proceedings of the Eighth IFIP Conference on Human-Computer Interaction, Tokyo, Japan, pp. 569–576 (2001)Google Scholar
  37. 37.
    Antunes, F., Costa, J.P.: Integrating decision support and social networks. Adv. Adv. in Hum.-Comp. Int. 2012, Article 9 (2012)Google Scholar
  38. 38.
    Lagrosen, S.: Customer involvement in new product development: a relationship marketing perspective. European Journal of Innovation Management 8(4), 424–436 (2005)CrossRefGoogle Scholar
  39. 39.

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Aleksander Fabijan
    • 1
    Email author
  • Helena Holmström Olsson
    • 1
  • Jan Bosch
    • 2
  1. 1.Faculty of Technology and SocietyMalmö UniversityMalmöSweden
  2. 2.Department of Computer Science & EngineeringChalmers University of TechnologyGöteborgSweden

Personalised recommendations