Weighted Evaluation Framework for Cross-Platform App Development Approaches

Conference paper
Part of the Lecture Notes in Business Information Processing book series (LNBIP, volume 264)


Cross-platform app development is very challenging, although only two platforms with significant market share (iOS and Android) remain. While device fragmentation – multiple, only partly compatible versions of a platform – has been complicating matters already, the need to target different device classes is a new emergence. Smartphones and tablets are relatively similar but app-enabled devices such as TVs and even cars typically have differing capabilities. To facilitate usage of cross-platform app development approaches, we present work on an evaluation framework. Our framework provides a set of up-to-date evaluation criteria. Unlike prior work on this topic, it offers weighted assessment to cater for varieties in targeted device classes. Besides motivating and explaining the evaluation criteria, we present an exemplary application for one development approach and, as benchmarks, for native apps and Webapps. Our findings suggest that the proliferation of app-enabled devices amplifies the need for improved development support.


App Mobile computing Mobile application Cross-platform Multi-platform Evaluation 


  1. 1.
    Amatya, S., Kurti, A.: Cross-platform mobile development: challenges and opportunities. In: Trajkovik, V., Anastas, M. (eds.) ICT Innovations 2013. AISC, vol. 231, pp. 219–229. Springer, Heidelberg (2014). doi: 10.1007/978-3-319-01466-1_21 CrossRefGoogle Scholar
  2. 2.
  3. 3.
    Android Wear 2.0 developer preview. https://developer.android.com/wear/preview/index.html
  4. 4.
    Apache Cordova documentation (2016). https://cordova.apache.org/docs/en/
  5. 5.
    Beal, G.M., Bohlen, J.M.: The Diffusion Process. Agricultural Experiment Station. Iowa State College, Ames (1957)Google Scholar
  6. 6.
    Bouhnick, G.: A list of all operating systems running on smartwatches [wearables] (2015). http://www.mobilespoon.net/2015/03/a-list-of-all-operating-systems-running.html
  7. 7.
    Rahul Raj, C.P., Tolety, S.B.: A study on approaches to build cross-platform mobile applications and criteria to select appropriate approach. In: 2012 Annual IEEE India Conference (INDICON), pp. 625–629 (2012)Google Scholar
  8. 8.
    Carter, J.: Which is the best internet of things platform? (2015). http://www.techradar.com/news/-1302416
  9. 9.
    Chmielewski, J.: Towards an architecture for future internet applications. In: Galis, A., Gavras, A. (eds.) FIA 2013. LNCS, vol. 7858, pp. 214–219. Springer, Heidelberg (2013). doi: 10.1007/978-3-642-38082-2_18 CrossRefGoogle Scholar
  10. 10.
    Ciman, M., Gaggi, O.: Measuring energy consumption of cross-platform frameworks for mobile applications. In: Monfort, V., Krempels, K.-H. (eds.) WEBIST 2014. LNBIP, vol. 226, pp. 331–346. Springer, Heidelberg (2015). doi: 10.1007/978-3-319-27030-2_21 CrossRefGoogle Scholar
  11. 11.
    Ciman, M., Gaggi, O., Gonzo, N.: Cross-platform mobile development: a study on apps with animations. In: Proceedings of the ACM Symposium on Applied Computing (2014)Google Scholar
  12. 12.
  13. 13.
    Dalmasso, I., Datta, S.K., Bonnet, C., Nikaein, N.: Survey, comparison and evaluation of cross platform mobile application development tools. In: Proceedings of the 9th IWCMC (2013)Google Scholar
  14. 14.
    Davis, L.: Phonegap: people’s choice winner at web 2.0 expo launch pad (2009). http://readwrite.com/2009/04/02/phone_gap
  15. 15.
    Deindl, M., Roscher, M., Birkmeier, M.: An architecture vision for an open service cloud for the smart car. In: Filho, W.L., Kotter, R. (eds.) Mobility in Europe, Green Energy and Technology, vol. 203, pp. 281–295. Springer, Heidelberg (2015)Google Scholar
  16. 16.
    Dhillon, S., Mahmoud, Q.H.: An evaluation framework for cross-platform mobile application development tools. Softw. Prac. Exp. 45(10), 1331–1357 (2015)CrossRefGoogle Scholar
  17. 17.
    Dobie, A.: Why you’ll never have the latest version of android (2012). http://www.androidcentral.com/why-you-ll-never-have-latest-version-android
  18. 18.
    Dorr, T.: Tesla Model S JSON API (2016). http://docs.timdorr.apiary.io
  19. 19.
    Doud, A.: How important is cross-platform wearable support? (2015). http://pocketnow.com/2015/05/10/cross-platform-wearable-support
  20. 20.
    Durach, S., Higgen, U., Huebler, M.: Smart automotive apps: an approach to context-driven applications. In: SAE-China, FISITA (ed.) Proceedings of the FISITA 2012 World Automotive Congress. LNEE 2012, vol. 200, pp. 187–195. Springer, Heidelberg (2013). doi: 10.1007/978-3-642-33838-0_17
  21. 21.
    El-Kassas, W.S., Abdullah, B.A., Yousef, A.H., Wahba, A.: ICPMD: integrated cross-platform mobile development solution. In: Proceedings of the 9th ICCES (2014)Google Scholar
  22. 22.
    Ernsting, J., Rieger, C., Wrede, F., Majchrzak, T.A.: Refining a reference architecture for model-driven business apps. In: Proceedings of the 12th WEBIST, pp. 307–316. SciTePress (2016)Google Scholar
  23. 23.
    Function point languages table: Version 5.0 (2009). http://www.qsm.com/resources/function-point-languages-table
  24. 24.
  25. 25.
    Google Inc.: Android wear 2.0 developer preview. https://developer.android.com/wear/preview/index.html
  26. 26.
    HbbTV overview (2016). https://www.hbbtv.org/overview/
  27. 27.
    Heitkötter, H., Hanschke, S., Majchrzak, T.A.: Comparing cross-platform development approaches for mobile applications. In: Proceedings 8th WEBIST, pp. 299–311. SciTePress (2012)Google Scholar
  28. 28.
    Heitkötter, H., Hanschke, S., Majchrzak, T.A.: Evaluating cross-platform development approaches for mobile applications. In: Cordeiro, J., Krempels, K.-H. (eds.) Web Information Systems and Technologies. LNBIP, vol. 140, pp. 120–138. Springer, Heidelberg (2013). doi: 10.1007/978-3-642-36608-6_8 CrossRefGoogle Scholar
  29. 29.
    Heitkötter, H., Majchrzak, T.A., Kuchen, H.: Cross-platform model-driven development of mobile applications with MD\(^{2}\). In: Proceedings of the SAC 2013, pp. 526–533. ACM (2013)Google Scholar
  30. 30.
    Heitkötter, H., Majchrzak, T.A., Ruland, B., Weber, T.: Comparison of mobile web frameworks. In: Krempels, K.-H., Stocker, A. (eds.) Web Information Systems and Technologies. LNBIP, vol. 189, pp. 119–137. Springer, Heidelberg (2014)Google Scholar
  31. 31.
    Heitkötter, H., Kuchen, H., Majchrzak, T.A.: Extending a model-driven cross-platform development approach for business apps. Sci. Comput. Program. 97(Part 1), 31–36 (2015)CrossRefGoogle Scholar
  32. 32.
    Hudli, A., Hudli, S., Hudli, R.: An evaluation framework for selection of mobile app development platform. In: Proceedings of the 3rd MobileDeLi (2015)Google Scholar
  33. 33.
    Jie, G., Bo, C., Shuai, Z., Junliang, C.: Cross-platform android/ios-based smart switch control middleware in a digital home. Mobile Inform. Sys. (2015). http://www.hindawi.com/journals/misy/2015/627859/
  34. 34.
    Kim, H., Ahn, M., Hong, S., Lee, S.: Wearable device control platform technology for network application development. Mobile Inform. Syst. (2016). http://www.hindawi.com/journals/misy/2016/3038515/
  35. 35.
    Krawczyk, K.: Hacker installs windows 95 and doom on a samsung gear live smartwatch. http://www.digitaltrends.com/computing/hacker-installs-windows-95-and-doom-on-a-samsung-gear-live-smartwatch/
  36. 36.
    Lambert, F.: Tesla is moving away from an SDK. http://9to5mac.com/2016/01/28/tesla-sdk-iphone-apps-mirror/
  37. 37.
    Lella, A., Lipsman, A., Martin, B.: The 2015 U.S. mobile app report. https://www.comscore.com/ger/Insights/Presentations-and-Whitepapers/2015/The-2015-US-Mobile-App-Report
  38. 38.
    LG Electronics: WebOS for LG smart TVs (2016). http://www.lg.com/uk/smarttv/webos
  39. 39.
    Liu, X., Vega, K., Maes, P., Paradiso, J.A.: Wearability factors for skin interfaces. In: Proceedings of the 7th Augmented Human International Conference, pp. 21:1–21:8. ACM (2016)Google Scholar
  40. 40.
    Luca, A.D., Lindqvist, J.: Is secure and usable smartphone authentication asking too much? Computer 48(5), 64–68 (2015)CrossRefGoogle Scholar
  41. 41.
    Majchrzak, T.A., Ernsting, J.: Reengineering an approach to model-driven development of business apps. In: Wrycza, S. (ed.) SIGSAND/PLAIS 2015. LNBIP, vol. 232, pp. 15–31. Springer, Heidelberg (2015). doi: 10.1007/978-3-319-24366-5_2 CrossRefGoogle Scholar
  42. 42.
    Majchrzak, T.A., Schulte, M.: Context-dependent testing of applications for mobile devices. Open J. Web Technol. (OJWT) 2(1), 27–39 (2015)Google Scholar
  43. 43.
    Majchrzak, T.A., Wolf, S., Abbassi, P.: Comparing the capabilities of mobile platforms for business app development. In: Wrycza, S. (ed.) SIGSAND/PLAIS 2015. LNBIP, vol. 232, pp. 70–88. Springer, Heidelberg (2015). doi: 10.1007/978-3-319-24366-5_6 CrossRefGoogle Scholar
  44. 44.
    MobileHTML5: Mobile html5 compatibility (2015). http://mobilehtml5.org/
  45. 45.
    Noreikis, M., Butkus, P., Nurminen, J.K.: In-vehicle application for multimodal route planning and analysis. In: Proceedings of the IEEE 3rd CloudNet (2014)Google Scholar
  46. 46.
    Ohrt, J., Turau, V.: Cross-platform development tools for smartphone applications. Computer 45(9), 72–79 (2012)CrossRefGoogle Scholar
  47. 47.
    Palmieri, M., Singh, I., Cicchetti, A.: Comparison of cross-platform mobile development tools. In: Proceedings of the 16th ICIN, pp. 179–186. IEEE (2012)Google Scholar
  48. 48.
    Perakakis, E., Ghinea, G.: HTML5 technologies for effective cross-platform interactive/smart TV advertising. IEEE Trans. HMS 45(4), 534–539 (2015)Google Scholar
  49. 49.
    Perakakis, E., Ghinea, G.: A proposed model for cross-platform web 3D applications on smart TV systems. In: Proceedings of the 20th Web3D (2015)Google Scholar
  50. 50.
    Phonegap documentation (2015). http://docs.phonegap.com
  51. 51.
    Quaresma, M., Gonçalves, R.: Usability analysis of smartphone applications for drivers. In: Marcus, A. (ed.) DUXU 2014. LNCS, vol. 8517, pp. 352–362. Springer, Heidelberg (2014). doi: 10.1007/978-3-319-07668-3_34 CrossRefGoogle Scholar
  52. 52.
    Research2guidance: cross-platform tool benchmarking (2014). http://research2guidance.com/product/cross-platform-tool-benchmarking-2014/
  53. 53.
    Revest, F.: Asteroidos (2016). http://asteroidos.org/
  54. 54.
    Rodriguez Garzon, S., Poguntke, M.: The personal adaptive in-car HMI: integration of external applications for personalized use. In: Ardissono, L., Kuflik, T. (eds.) UMAP 2011. LNCS, vol. 7138, pp. 35–46. Springer, Heidelberg (2012). doi: 10.1007/978-3-642-28509-7_5 CrossRefGoogle Scholar
  55. 55.
    Ryu, D., Krompiec, P.K., Lee, E., Park, K.: A serious game design for english education on smart TV platform. In: Proceedings of the ISCE (2014)Google Scholar
  56. 56.
    Samsung Electronics Co. Ltd.: Let’s toast - samsung smart TV apps developer forum. https://www.samsungdforum.com/Features/TOAST
  57. 57.
    Sansour, R.N., Kafri, N., Sabha, M.N.: A survey on mobile multimedia application development frameworks. In: Proceedings of the ICMCS (2014)Google Scholar
  58. 58.
    Schilit, B., Adams, N., Want, R.: Context-aware computing applications. In: Proceedings of the 1994 1st WMCSA, pp. 85–90. IEEE CS (1994)Google Scholar
  59. 59.
    Schuermans, S., Vakulenko, M.: Apps for connected cars? Your mileage may vary (2014). http://www.visionmobile.com/product/apps-for-cars-mileage-may-vary/
  60. 60.
    Sohn, H.J., Lee, M.G., Seong, B.M., Kim, J.B.: Quality evaluation criteria based on open source mobile HTML5 UI framework for development of cross-platform. IJSEIA 9(6), 1–12 (2015)CrossRefGoogle Scholar
  61. 61.
    Sommer, A., Krusche, S.: Evaluation of cross-platform frameworks for mobile applications. LNI P-215 (2013)Google Scholar
  62. 62.
  63. 63.
    Tizen (2016). https://www.tizen.org/
  64. 64.
    Wasserman, A.I.: Software engineering issues for mobile application development. In: Roman, G.C., Sullivan, K. (eds.) Proceedings of the FoSER 2010, p. 397 (2010)Google Scholar
  65. 65.
    Willocx, M., Vossaert, J., Naessens, V.: A quantitative assessment of performance in mobile app development tools. In: Proceedings of the 3rd International Conference on Mobile Services (2015)Google Scholar
  66. 66.
    Wolf, F.: Will vehicles go the mobile way? Merits and challenges arising by car-apps. In: Proceedings of the 10th ICINCO, vol. 2 (2013)Google Scholar
  67. 67.
    Woods, V., van der Meulen, R.: Gartner says worldwide smartphone sales grew 9.7 percent in fourth quarter of 2015 (2016). http://www.gartner.com/newsroom/id/3215217
  68. 68.
    Xanthopoulos, S., Xinogalos, S.: A comparative analysis of cross-platform development approaches for mobile applications. In: Proceedings of the 6th BCI, pp. 213–220. ACM (2013)Google Scholar
  69. 69.
    XBMC Foundation: Third-party forks and derivatives. http://kodi.wiki/view/Third-party_forks_and_derivatives
  70. 70.
    Zhang, J., Chen, C., Ma, J., He, N., Ren, Y.: Usink: smartphone-based moible sink for wireless sensor networks. In: Proceedings of the CCNC 2011 (2011)Google Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  1. 1.ERCIS, University of MünsterMünsterGermany
  2. 2.ERCIS, University of AgderKristiansandNorway

Personalised recommendations