The Evaluation Aspect of Digital Business Model Innovation

A Literature Review on Tools and Methodologies
  • Jan F. TeschEmail author
  • Anne-Sophie Brillinger
Part of the Progress in IS book series (PROIS)


Despite the increasing importance of business model innovation (BMI), a lack of understanding on the evaluation aspect still exists within research. Thereby, the development of tools and methodologies for BMI lacks sufficient consideration in both theory and practice. This paper contributes by systematically reviewing present literature with an explicit focus on the applicability in digital BMI projects. The authors elaborate a categorization of tools and methodologies concerning two major logics of evaluation: analytical/effectual and quantitative/qualitative. This sheds light upon the dominant mode of evaluation within different stages of digital BMI processes.


Business model innovation Digitalization Evaluation Tooling 


  1. Abdelkafi, N., Makhotin, S., & Posselt, T. (2013). Business model innovations for electric mobility—What can be learned from existing business model patterns? International Journal of Innovation Management, 17(1), 1–41.Google Scholar
  2. Al-Debei, M., Al-Lozi, E., & Al-Hujran, O. (2015). Critical design and evaluation factors of mobile business models. Journal of Enterprise Information Management, 28(5), 698–717.Google Scholar
  3. Ali, A. (2015). An Mcdm approach towards m-payment business models evaluation. International Journal of the Analytic Hierarchy Process, 7(2), 273–294.Google Scholar
  4. Amshoff, B., Dülme, C., Echterfeld, J., & Gausemeier, J. (2015). Business model patterns for disruptive technologies. International Journal of Innovation Management, 19, 1–22.Google Scholar
  5. Bereznoi, A. (2015). Business model innovation in corporate competitive strategy. Problems of Economic Transition, 57(8), 14–33.Google Scholar
  6. Bettis, R. A., Gambardella, A., Helfat, C., & Mitchell, W. (2015). Qualitative empirical research in strategic management. Strategic Management Journal, 36(5), 637–639.Google Scholar
  7. Bouwman, H., Reuver, M. de, Solaimani, S., Daas, D., Haaker, T., Janssen, W., Iske, P., & Walenkamp, B. (2012). Business models tooling and a research agenda. In Bled eConference, Vol. 25.Google Scholar
  8. Brea-Solís, H., Casadesus-Masanell, R., & Grifell-Tatjé, E. (2015). Business model evaluation: Quantifying Walmart’s sources of advantage. Strategic Entrepreneurship Journal, 9(1), 12–33.Google Scholar
  9. Bredmar, K. (2015). Transforming environmental uncertainty to risk—Managing risk and management control. Global Business and Management Research, 7(3), 44–54.Google Scholar
  10. Breuer, H. (2013). Lean venturing: Learning to create new business through exploration, elaboration, evaluation, experimentation, and evolution. International Journal of Innovation Management, 17(03), 1–22.Google Scholar
  11. Broadbent, J., Gill, J., & Laughlin, R. (2008). Identifying and controlling risk. The problem of uncertainty in the private Finance initiative in the UK’s national health service. Critical Perspectives on Accounting, 19(1), 40–78.Google Scholar
  12. Bucherer, E., & Uckelmann, D. (2011). Business models for the internet of things. In Architecting the internet of things (pp. 253–277). Berlin: Springer.Google Scholar
  13. Burkhart, T., Krumeich, J., Werth, D., & Loos, P. (2011). Analyzing the business model concept—A comprehensive classification of literature. ICIS 2011 Proceedings, Shanghai, CHN, 12, 1–19.Google Scholar
  14. Cannon, S., & Summers, L. H. (2014). How Uber and the sharing economy can win over regulators. Harvard Business Review, 10(13), 24–28.Google Scholar
  15. Casadesus-Masanell, R., & Ricart, J. E. (2007). Competing through business models. IESE Business School, D/713, 1–28.Google Scholar
  16. Casadesus-Masanell, R., & Ricart, J. E. (2010). From strategy to business models and onto tactics. Long Range Planning, 43(2–3), 195–215.Google Scholar
  17. Cavalcante, S. A. (2014). Designing business model change. International Journal of Innovation Management, 18(02), 1–22.Google Scholar
  18. Chandler, G. N., DeTienne, D. R., McKelvie, A., & Mumford, T. V. (2011). Causation and effectuation processes. A validation study. Journal of Business Venturing, 26(3), 375–390.Google Scholar
  19. Chesbrough, H. (2007). Business model innovation: It’s not just about technology anymore. Strategy and Leadership, 35(6), 12–17.Google Scholar
  20. Chesbrough, H. (2010). Business model innovation: Opportunities and barriers. Long Range Planning, 43(2–3), 354–363.Google Scholar
  21. Cooper, R. G. (1990). Stage-gate systems: A new tool for managing new products. Business Horizons, 5(6), 44–54.Google Scholar
  22. Daas, D., Hurkmans, T., Overbeek, S., & Bouwman, H. (2013). Developing a decision support system for business model design. Electronic Markets, 23(3), 251–265.Google Scholar
  23. De Reuver, M., Bouwman, H., & Haaker, T. (2013). Business model roadmapping: A practical approach to come from an existing to a desired business model. International Journal of Innovation Management, 17(01), 1–18.Google Scholar
  24. de Reuver, M., Bouwman, H., & Maclnnes, I. (2009). Business model dynamics: A case survey. Journal of Theoretical and Applied Electronic Commerce Research, 4(1), 1–11.Google Scholar
  25. Demil, B., & Lecocq, X. (2010). Business model evolution: In search of dynamic consistency. Long Range Planning, 43(2–3), 227–246.Google Scholar
  26. Dew, N., Read, S., Sarasvathy, S. D., & Wiltbank, R. (2009). Effectual versus predictive logics in entrepreneurial decision-making. Differences between experts and novices. Journal of Business Venturing, 24(4), 287–309.Google Scholar
  27. Doz, Y. L., & Kosonen, M. (2010). Embedding strategic agility: A leadership agenda for accelerating business model renewal. Long Range Planning, 43(2–3), 370–382.Google Scholar
  28. D’Souza, A., Wortmann, H., Huitema, G. B., & Velthuijsen, H. (2015). A business model design framework for viability; A business ecosystem approach. Journal of Business Models, 3(2), 1–29.Google Scholar
  29. Eiselt, H. A., & Marianov, V. (2014). Multicriteria decision making under uncertainty. A visual approach. International Transactions in Operational Research, 21(4), 525–540.Google Scholar
  30. Eisenhardt, K. M. (1989). Building Theories from case study research. Academy of Management Review, 14(4), 532–550.Google Scholar
  31. El Sawy, O. A., & Pereira, F. (2013). Business modelling in the dynamic digital space: An ecosystem approach, Springer Briefs in digital spaces. Berlin, New York: Springer.Google Scholar
  32. Fichman, R. G., Dos Santos, B. L., & Zheng, Z. (2014). Digital innovation as a fundamental and powerful concept in the information systems curriculum. MIS Quarterly, 38(2), 329–A15.Google Scholar
  33. Frankenberger, K., Weiblen, T., Csik, M., & Gassmann, O. (2013). The 4I-framework of business model innovation: A structured view on process phases and challenges. International Journal of Product Development, 18(3/4), 1–18.Google Scholar
  34. Gambardella, A., & McGahan, A. M. (2010). Business-model innovation: General Purpose technologies and their implications for industry structure. Long Range Planning, 43(2–3), 262–271.Google Scholar
  35. Gassmann, O., Frankenberger, K., & Csik, M. (2014). The business model navigator: 55 models that will revolutionise your business. Harlow, UK: Pearson.Google Scholar
  36. Giessmann, A., & Stanoevska, K. (2012). Platform as a service–A conjoint study on consumers’ preferences. In Proceedings if the Thirty Third International Conference on Information Systems (ICIS).Google Scholar
  37. Gordijn, J., & Akkermans, H. (2001). Designing and evaluating e-business models. IEEE Intelligent Systems, 16(4), 11–17.Google Scholar
  38. Hanelt, A., Hildebrandt, B., & Polier, J. (2015). Uncovering the role of IS in business model innovation. A Taxonomy-Driven Approach to Structure the Field. Proceedings of Wirtschaftsinformatik 2015.Google Scholar
  39. Hart, S., Jan Hultink, E., Tzokas, N., & Commandeur, H. R. (2003). Industrial companies’ evaluation criteria in new product development gates. Journal of Product Innovation Management, 20(1), 22–36.Google Scholar
  40. Heikkilä, M., Bouwman, H., Heikkilä, J., Haaker, T., Nicolas, C. L., & Riedl, A. (2016). Business model innovation paths and tools. 29th Bled eConference, 29, 1–17.Google Scholar
  41. Heikkilä, M., Bouwman, H., Heikkilä, J., Solaimani, S., & Janssen, W. (2015). Business model metrics: An open repository. Information Systems and e-Business Management, 14, 1–30.Google Scholar
  42. Johnson, M. W. (2010). Seizing the white space: Business model innovation for growth and renewal. Boston, USA: Harvard Business Press.Google Scholar
  43. Johnson, M. W., Christensen, C. M., & Kagermann, H. (2008). Reinventing your business model. Harvard Business Review, 86(12), 57–68.Google Scholar
  44. Kauffman, R. J., & Wang, B. (2008). Tuning into the digital channel. Evaluating business model characteristics for Internet firm survival. Information Technology and Management, 9(3), 215–232.Google Scholar
  45. Killus, H. (2016). Evaluating business models in the era of the internet of things. A literature review to evolve a research agenda. Bachelor’s thesis, Institut für Wirtschaftsinformatik, Georg-August-Universität Göttingen, Göttingen, 2016.Google Scholar
  46. Kley, F. (2011). Ladeinfrastrukturen für Elektrofahrzeuge: Entwicklung einer Ausbaustrategie auf Basis des Fahrverhaltens. Fraunhofer-Verl, Stuttgart: ISI-Schriftenreihe Innovationspotenziale.Google Scholar
  47. Koen, P. A., Bertels, H. M. J., & Elsum, I. R. (2011). The three faces of business model innovation. Challenges for established firm. Research Technology Management, 54(3), 52–59.Google Scholar
  48. Lee, I., & Lee, K. (2015). The Internet of Things (IoT). Applications, investments, and challenges for enterprises. Business Horizons, 58(4), 431–440.Google Scholar
  49. Levy, Y., & Ellis, T. J. (2006). A systems approach to conduct an effective literature review in support of information systems research. Informing Science Journal, 9, 181–212.Google Scholar
  50. Magruk, A. (2015). The most important aspects of uncertainty in the internet of things field—Context of smart buildings. Procedia Engineering, 122, 220–227.Google Scholar
  51. Martikainen, A., Niemi, P., & Pekkanen, P. (2014). Developing a service offering for a logistical service provider—Case of local food supply chain. International Journal of Production Economics, 157(C), 318–326.Google Scholar
  52. McGrath, R. G. (2010). Business models: A discovery driven approach. Long Range Planning, 43(2–3), 247–261.Google Scholar
  53. Morris, M., Schindehutte, M., & Allen, J. (2005). The entrepreneur’s business model. Toward a unified perspective. Journal of Business Research, 58(6), 726–735.Google Scholar
  54. N. N. (2015). VERBAND DER HOCHSCHULLEHRER FÜR BETRIEBSWIRTSCHAFT E.V.: GESAMTLISTE. Alphabetische Gesamtliste der Fachzeitschriften in VHB-JOURQUAL3. Available at: Accessed 7 March 2016.
  55. Osterwalder, A., Pigneur, Y., & Clark, T. (2010). Business model generation: A handbook for visionaries, game changers, and challengers (1st ed.). Hoboken, NJ: Wiley.Google Scholar
  56. Pateli, A. G., & Giaglis, G. M. (2004). A research framework for analysing eBusiness models. European Journal of Information Systems, 13(4), 302–314.Google Scholar
  57. Pousttchi, K., & Hufenbach, Y. (2011). Value creation in the mobile market. Business and Information Systems Engineering, 3(5), 299–311.Google Scholar
  58. Remane, G., Hanelt, A., Tesch, J., & Kolbe, L. M. (2017). The business model pattern database. A tool for systematic business model innovation. International Journal of Innovation Management, 21, 1750004-1–1750004-61.Google Scholar
  59. Ries, E. (2011). The lean startup: How constant innovation creates radically successful businesses. London: Portfolio Penguin.Google Scholar
  60. Sarasvathy, S. D. (2001). Causation and effectuation: Toward a theoretical shift from economic inevitability to entrepreneurial contingency. Academy of Management Review, 26(2), 243–263.Google Scholar
  61. Schneider, S., & Spieth, P. (2013). Business model innovation. Towards an integrated future research agenda. International Journal of Innovation Management, 17(01), 1–35.Google Scholar
  62. Schoemaker, P. J., Day, G. S., & Snyder, S. A. (2013). Integrating organizational networks, weak signals, strategic radars and scenario planning. Technological Forecasting and Social Change, 80(4), 815–824.Google Scholar
  63. Sharma, S., & Gutiérrez, J. A. (2010). An evaluation framework for viable business models for m-commerce in the information technology sector. Electronic Markets, 20(1), 33–52.Google Scholar
  64. Shi, Y., & Manning, T. (2009). Understanding business models and business model risks. The Journal of Private Equity, 12(2), 49–59.Google Scholar
  65. Sosna, M., Trevinyo-Rodríguez, R. N., & Velamuri, S. Ramakrishna. (2010). Business model innovation through trial-and-error learning: The Naturhouse case. Long Range Planning, 43(2–3), 383–407.Google Scholar
  66. Taran, Y., Boer, H., & Lindgren, P. (2015). A business model innovation typology. Decision Sciences, 46, 301–331.Google Scholar
  67. Teece, D. J. (2010). Business models, business strategy and innovation. Long Range Planning, 43(2–3), 172–194.Google Scholar
  68. Tesch, J. F. (2016). Discovering the role of scenario planning as an evaluation methodology for business models in the era of the internet of things (IoT). In Proceedings of the Twenty-Fourth European Conference on Information Systems (ECIS), Vol. 24, pp. 1–25.Google Scholar
  69. Tesch, J. F., Brillinger, A.-S., & Bilgeri, D. (2017). Internet of things business model innovation and the stage gate process: An exploratory analysis. International Journal of Innovation Management, 21(5), 1740002.Google Scholar
  70. Thompson, J. D., & MacMillan, I. C. (2010). Business models: Creating new markets and societal wealth. Long Range Planning, 43(2–3), 291–307.Google Scholar
  71. Turber, S., & Smiela, C. (2014). A business model type for the Internet of Things. In ECIS 2014 Proceedings, Tel Aviv, ISR, No. 4, pp. 1–10.Google Scholar
  72. Vecchiato, R. (2012). Strategic foresight: Matching environmental uncertainty. Technology Analysis and Strategic Management, 24(8), 783–796.Google Scholar
  73. Veit, D., Clemons, E., Benlian, A., Buxmann, P., Hess, T., Kundisch, D., et al. (2014). Business models. Business & Information Systems Engineering, 6(1), 45–53.Google Scholar
  74. Webster, J., & Watson, R. T. (2002). Analyzing the past to prepare for the future: Writing a literature review. Management Information Systems Quarterly, 26(2), 13–23.Google Scholar
  75. Westerlund, M., Leminen, S., & Rajahonka, M. (2014). Designing business models for the internet of things. Technology Innovation Management Review, 4(7), 5–14.Google Scholar
  76. Wirtz, B. W., Pistoia, A., Ullrich, S., & Göttel, V. (2016). Business models: Origin, development and future research perspectives. Long Range Planning, 49(1), 36–54.Google Scholar
  77. Wirtz, B. W., Schilke, O., & Ullrich, S. (2010). Strategic development of business models: Implications of the Web 2.0 for creating value on the internet. Long Range Planning, 43(2), 272–290.Google Scholar
  78. Yüksel, I. (2012). Developing a multi-criteria decision making model for PESTEL analysis. International Journal of Business and Management, 7(24), 52–66.Google Scholar
  79. Yunus, M., Moingeon, B., & Lehmann-Ortega, L. (2010). Building social business models: Lessons from the grameen experience. Long Range Planning 43(2–3), S.308–325.Google Scholar
  80. Zibuschka, J., Nofer, M. & Hinz, O. (2016). Zahlungsbereitschaft für Datenschutzfunktionen intelligenter Assistenten (pp. 1391–1402). Multikonferenz Wirtschaftsinformatik (MKWI), Ilmenau.Google Scholar
  81. Zott, C., & Amit, R. (2010). Business model design: An activity system perspective. Long Range Planning, 43(2–3), 216–226.Google Scholar
  82. Zott, C., Amit, R., & Massa, L. (2011). The business model. Recent developments and future research. Journal of Management, 37(4), 1019–1042.Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.University of GöttingenGöttingenGermany
  2. 2.Catholic University of Eichstätt-IngolstadtEichstättGermany

Personalised recommendations