Identifying Innovative Idea Proposals with Topic Models—A Case Study from SPA Tourism



This chapter builds on a dataset where online users of a spa platform participated in an online idea contest providing free-text descriptions of their proposals for spa services. A panel of domain experts annotated these idea descriptions with a score for their innovativeness that serves as ground truth for machine learning experiments. Thus, the contribution lies in the application of topic modeling techniques to free-text idea descriptions in order to automatically identify innovative proposals based on advanced text processing and machine learning. Results of this case study indicate that topic modeling can outperform the ZeroR baseline as well as traditional survey scales for lead user identification and therefore constitute a first step towards exploring this technique for innovation research.


Spa tourism Topic modeling Online idea contest 


  1. Agarwal D, Chen B-C (2010) Flda: matrix factorization through Latent Dirichlet Allocation. In Proceedings of the third ACM international conference on web search and data mining. ACM, pp 91–100Google Scholar
  2. Alam I (2002) An exploratory investigation of user involvement in new service development. J Acad Mark Sci 30(3):250Google Scholar
  3. Alam I (2006) Removing the fuzziness from the fuzzy front-end of service innovations through customer interactions. Ind Mark Manage 35(4):468–480Google Scholar
  4. Amabile TM (1982) Social psychology of creativity: a consensual assessment technique. J Pers Soc Psychol 43(5):997Google Scholar
  5. Amabile TM, Barsade SG, Mueller JS, Staw BM (2005) Affect and creativity at work. Adm Sci Q 50(3):367–403Google Scholar
  6. Blei DM (2012) Probabilistic topic models. Commun ACM 55(4):77–84Google Scholar
  7. Bolton Ruth N, Drew James H (1991) A multistage model of customers’ assessments of service quality and value. J Consum Res 17(4):375–384Google Scholar
  8. Breiman L (2001) Random forests. Mach Learn 45(1):5–32Google Scholar
  9. Bullinger AC, Neyer A-K, Rass M, Moeslein KM (2010) Community-based innovation contests: where competition meets cooperation. Creativity and Innov Manag 19(3):290–303Google Scholar
  10. Campos AC, Mendes J, do Valle PO, Scott N (2018) Co-creation of tourist experiences: a literature review. Curr Issues Tourism 21(4):369–400Google Scholar
  11. Dahan E, Hauser JR (2002) The virtual customer. J Prod Innov Manag 19(5):332–353Google Scholar
  12. Dahan E, Srinivasan V (2000) The predictive power of internet-based product concept testing using visual depiction and animation. J Prod Innov Manag 17(2):99–109Google Scholar
  13. Dippelreiter B, Grün C, Pöttler M, Seidel I, Berger H, Dittenbach M, Pesenhofer A (2008) Online tourism communities on the path to web 2.0: an evaluation. Inf Technol Tourism 10(4):329–353Google Scholar
  14. Ebner W, Leimeister JM, Krcmar H (2009) Community engineering for innovations: the ideas competition as a method to nurture a virtual community for innovations. R&D Manag 39(4):342–356Google Scholar
  15. Edvardsson B, Kristensson P, Magnusson P, Sundström E (2012) Customer integration within service development: a review of methods and an analysis of insitu and exsitu contributions. Technovation 32(7–8):419–429Google Scholar
  16. Egger R, Gula I, Walcher D (2016) Towards a holistic framework of open tourism. In: Open tourism. Springer, pp 3–16Google Scholar
  17. Enkel E, Perez-Freije J, Gassmann O (2005) Minimizing market risks through customer integration in new product development: learning from bad practice. Creativity Innov Manag 14(4):425–437Google Scholar
  18. Faullant R, Schwarz EJ, Kraiger I, Breitenecker RJ (2009) Towards a comprehensive understanding of lead userness: the role of personality and creativity. In: 16th international product development management conferenceGoogle Scholar
  19. Faullant R, Krajger I, Zanker M (2012) Identification of innovative users for new service development in tourism. In: 19th conference on information and communication technologies in tourism (ENTER). Springer, Helsingborg, SwedenGoogle Scholar
  20. Franke N, Piller F (2004) Value creation by toolkits for user innovation and design: The case of the watch market. J Prod Innov Manag 21(6):401–415Google Scholar
  21. Franke N, Shah S (2003) How communities support innovative activities: an exploration of assistance and sharing among end-users. Res Policy 32(1):157–178Google Scholar
  22. Franke N, Von Hippel E (2003) Satisfying heterogeneous user needs via innovation toolkits: the case of apache security software. Res Policy 32(7):1199–1215Google Scholar
  23. Franke N, Von Hippel E, Schreier M (2006) Finding commercially attractive user innovations:a test of lead-user theory. J Prod Innov Manag 23(4):301–315Google Scholar
  24. Füller J, Hienerth C (2004) Engaging the creative consumer. Eur Bus Forum 19:54–57Google Scholar
  25. Füller J, Bartl M, Ernst H, Mühlbacher H (2006) Community based innovation: how to integrate members of virtual communities into new product development. Electron Commer Res 6(1):57–73Google Scholar
  26. Füller J, Jawecki G, Mühlbacher H (2007) Innovation creation by online basketball communities. J Bus Res 60(1):60–71Google Scholar
  27. Grissemann US, Stokburger-Sauer NE (2012) Customer co-creation of travel services: the role of company support and customer satisfaction with the co-creation performance. Tour Manag 33(6):1483–1492Google Scholar
  28. Grönroos C (1993) Toward a third phase in service quality research: challenges and future directions. Adv Serv Mark Manag 2(1):49–64Google Scholar
  29. Gruner Kjell E, Homburg Christian (2000) Does customer interaction enhance new product success? J Bus Res 49(1):1–14Google Scholar
  30. Herstatt C, Von Hippel E (1992) From experience: developing new product concepts via the lead user method: a case study in a low-tech field. J Prod Innov Manag 9(3):213–221Google Scholar
  31. Jeppesen LB (2005) User toolkits for innovation: consumers support each other. J Prod Innov Manag 22(4):347–362Google Scholar
  32. Lilien GL, Morrison PD, Searls K, Sonnack M, von Hippel E (2002) Performance assessment of the lead user idea-generation process for new product development. Manage Sci 48(8):1042–1059Google Scholar
  33. Lin C, He Y (2009) Joint sentiment/topic model for sentiment analysis. In: Proceedings of the 18th ACM conference on information and knowledge management. ACM, pp. 375–384Google Scholar
  34. Lüthje C (2000) Kundenorientierung im Innovationsprozess. Eine Untersuchung der Kunden-Hersteller-Interaktion in Konsumgütermärkten, WiesbadenGoogle Scholar
  35. Lüthje C (2003) Customers as co-inventors: an empirical analysis of the antecedents of customer-driven innovations in the field of medical equipment. In: Proceedings of the 32th EMAC conference, GlasgowGoogle Scholar
  36. Lüthje C (2004) Characteristics of innovating users in a consumer goods field: an empirical study of sport-related product consumers. Technovation 24(9):683–695Google Scholar
  37. Lüthje C, Herstatt C, Von Hippel E (2005) User-innovators and local information: the case of mountain biking. Res Policy 34(6):951–965Google Scholar
  38. Mahr D, Lievens A (2012) Virtual lead user communities: drivers of knowledge creation for innovation. Res Policy 41(1):167–177Google Scholar
  39. McAuley J, Leskovec J (2013) Hidden factors and hidden topics: understanding rating dimensions with review text. In: Proceedings of the 7th ACM conference on recommender systems. ACM, pp 165–172Google Scholar
  40. Morrison PD, Roberts JH, Von Hippel E (2000) Determinants of user innovation and innovation sharing in a local market. Manage Sci 46(12):1513–1527Google Scholar
  41. Neuhofer B, Buhalis D, Ladkin A (2014) A typology of technology-enhanced tourism experiences. Int J Tourism Res 16(4):340–350Google Scholar
  42. Newman, D., Lau, J. H., Grieser, K., & Baldwin, T. (2010). Automatic evaluation of topic coherence. In: Human language technologies: the 2010 annual conference of the North American chapter of the association for computational linguistics, HLT ’10, pp 100–108. Stroudsburg, PA, USAGoogle Scholar
  43. Oliveira P, von Hippel E (2011) Users as service innovators: the case of banking services. Res Policy 40(6):806–818Google Scholar
  44. Olson EL, Bakke G (2001) Implementing the lead user method in a high technology firm: a longitudinal study of intentions versus actions. J Prod Innov Manag 18(6):388–395Google Scholar
  45. Parasuraman A, Zeithaml VA, Berry LL (1988) Servqual—a multiple-item scale for measuring consumer perceptions of service quality. J Retail 64(1):12–40Google Scholar
  46. Rihova I, Buhalis D, Moital M, Gouthro M-B (2015) Conceptualising customer-to-customer value co-creation in tourism. Int J Tourism Res 17(4):356–363Google Scholar
  47. Rokach Lior, Maimon Oded Z (2014) Data mining with decision trees: theory and applications, 2nd edn. World Scientific Publishing Co., Inc., River Edge, NJ, USAGoogle Scholar
  48. Rossetti M, Stella F, Zanker M (2016) Analyzing user reviews in tourism with topic models. Inf Technol Tourism 16(1):5–21Google Scholar
  49. Sawhney M, Verona G, Prandelli E (2005) Collaborating to create: the internet as a platform for customer engagement in product innovation. J Interact Mark 19(4):4–17Google Scholar
  50. Schwarz E, Faullant R, Krajger I, Breitenecker R (2009) Are leading edge users creative. In: Annual meeting of the 38th EMAC conferenceGoogle Scholar
  51. Sigala M (2010) Managing customer involvement and roles in new service development (nsd): lessons learnt from In: 28th Eurochrie conference, Amsterdam, The Netherlands
  52. Skiba F, Herstatt C (2009) Users as sources for radical service innovations: opportunities from collaboration with service lead users. Int J Serv Technol Manage 12(3):317–337Google Scholar
  53. Sternberg RJ, Lubart TI (1999) The concept of creativity: prospects and paradigms. Handb. Creativity 1:3–15Google Scholar
  54. Urban GL, Von Hippel E (1988) Lead user analyses for the development of new industrial products. Manage Sci 34(5):569–582Google Scholar
  55. Verona G, Prandelli E, Sawhney M (2006) Innovation and virtual environments: towards virtual knowledge brokers. Organ Stud 27(6):765–788Google Scholar
  56. Von Hippel, E. (1978). Successful industrial products from customer ideas. J Mark, 39–49Google Scholar
  57. Von Hippel E (1986) Lead users: a source of novel product concepts. Manage Sci 32(7):791–805Google Scholar
  58. Von Hippel E (2005) Democratizing innovation: the evolving phenomenon of user innovation. Journal für Betriebswirtschaft 55(1):63–78Google Scholar
  59. Waldhör K, Rind A (2008) Etbloganalysis: mining virtual communities using statistical and linguistic methods for quality control in tourism. Inf Commun Technol Tourism 2008:453–462Google Scholar
  60. Wallach HM, Murray I, Salakhutdinov R, Mimno D (2009) Evaluation methods for topic models. In: Proceedings of the 26th annual international conference on Machine learning. ACM, pp 1105–1112Google Scholar
  61. Wang Y, Yu Q, Fesenmaier DR (2002) Defining the virtual tourist community: implications for tourism marketing. Tour Manag 23(4):407–417Google Scholar
  62. Wang H, Lu Y, Zhai C (2010) Latent aspect rating analysis on review text data: a rating regression approach. In: Proceedings of the 16th ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 783–792Google Scholar
  63. Wellner K (2015) User innovators in the silver market: an empirical study among camping tourists. SpringerGoogle Scholar
  64. Yoo KH, Gretzel U (2008) What motivates consumers to write online travel reviews? Inf Technol Tourism 10(4):283–295Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  1. 1.Free University of Bozen-BolzanoBolzanoItaly
  2. 2.University of Milan-BicoccaMilanItaly
  3. 3.Alpen-Adria-Universität KlagenfurtKlagenfurtAustria
  4. 4.Syddansk UniversitetOdenseDenmark

Personalised recommendations