Communicating Product User Reviews and Ratings in Interfaces for e-Commerce: A Multimodal Approach

  • Dimitrios RigasEmail author
  • Rajab Ghandour
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9751)


This paper describes a comparative empirical evaluation study that uses multimodal presentations to communicate review messages in an e-commerce platform. Previous studies demonstrate the effective use of multimodality in different problem domains (e.g. e-learning). In this paper, multimodality and expressive avatars are used to communicate information related to product reviews messages. The data of the reviews was opportunistically collected from Facebook and Twitter. Two independent groups of users were used to evaluate two different presentations of reviews and ratings using as a basis an experimental e-commerce platform. The control group used a text-based with emojis presentation and the experimental group used a multimodal approach based on expressive avatars. Three parameters of usability were measured. These were efficiency, effectiveness, user satisfaction, and user preference. The result showed that the two approaches performed similarly. These findings provide a basis for further experiments in which text, emojis and expressive avatars can be combine to communicate a larger volume of reviews and ratings.


Multimodality Expressive avatars e-Commerce Usability Social media Reviews Effectiveness Efficiency User satisfaction 


  1. 1.
    Nielson, M.J., Taher: Building Web Sites with Depth. Web Techniques (2001)Google Scholar
  2. 2.
    Meera, M.B., Ephraim, P.G.: Multimodal integration. IEEE Multimedia 3, 14–24 (1996)CrossRefGoogle Scholar
  3. 3.
    Turban, E., King, D., Lee, J., Viehland, D.: Electronic Commerce 2004: A Managerial Perspective. Prentice Hall, Upper Saddle River (2004)Google Scholar
  4. 4.
    Skipper, J.B., Craighead, C.W., Byrd, T.A., Rainer, R.K.: Towards a theoretical foundation of supply network interdependence and technology-enabled coordination strategies. Int. J. Phys. Distrib. Logistics Manag. 38(1), 39–56 (2008)CrossRefGoogle Scholar
  5. 5.
    Clemons, E.K., Row, M.C., Reddi, S.P.: The impact of information technology on the organization of economic activity: the move to the middle hypothesis. J. Manag. Inf. Syst. 2, 9–36 (1993)CrossRefGoogle Scholar
  6. 6.
    Chaffey, D.: E-Business and E-Commerce Management: Strategies. Pearson Education Limited, Harlow (2004)Google Scholar
  7. 7.
    Zwass, V.: Electronic commerce: structures and issues. Manag. Inf. Syst. 1, 3–23 (1996)CrossRefGoogle Scholar
  8. 8.
    Jakob, N., Marie, T.: Homepage Usability: 50 Websites Deconstructed, 1st edn. New Riders, Thousand Oaks (2001)Google Scholar
  9. 9.
    Deborah, E., Rosen, E.P.: Website design: viewing the web as a cognitive landscape. J. Bus. Res. 57, 787–794 (2004)CrossRefGoogle Scholar
  10. 10.
    Scott, S.V., Orlikowski, W.J.: Reconfiguring relations of accountability: materialization of the social media in the travel sector. J. Acc. Organ. Soc. 37, 26–40 (2012)CrossRefGoogle Scholar
  11. 11.
    Oxford, D.: Oxford English Dictionary - Multimedia (2014).
  12. 12.
    Forbes, L.P.: Does social media influence consumer buying behaviour? An investigation of recommendations and purchases. J. Bus. Econ. Res. (JBER) 11, 107–112 (2013)CrossRefGoogle Scholar
  13. 13.
    Gary, B.L.: Social media: influence or control. Acc. Today 23, 38 (2009)Google Scholar
  14. 14.
    Brewster, S.A., Crease, M.G.: Making menus musical. In: Howard, S., Hammond, J., Lindgaard, G. (eds.) Human-Computer Interaction: INTERACT 1997. JFJP, pp. 389–396. Springer, Heidelberg (1997)Google Scholar
  15. 15.
    Brewster, S., Grégory, L., Murray, C.: Using non-speech sounds in mobile computing devices. In: Proceedings of the First Workshop on Human Computer Interaction with Mobile Devices, pp. 26–29 (1998)Google Scholar
  16. 16.
    Zeljko, O., Dusan, S.: Modelling multimodal human-computer interaction. IEEE Comput. Mag. 37, 65–72 (2004)Google Scholar
  17. 17.
    Alseid, M., Rigas, D.: Utilising multimodal interaction metaphors in e-learning applications: an experimental study. In: IEEE International Conference on Advanced Information Networking Applications, AINA 2009, pp. 945–950 (2009)Google Scholar
  18. 18.
    Annetta, A.L., Holmes, S.: Creating presence and community in a synchronous virtual learning environment using avatars. Int. J. Instr. Technol. Distance Learn. 3, 27–43 (2006)Google Scholar
  19. 19.
    Rigas, D., Memery, D.: Multimedia e-mail data browsing: the synergistic use of various forms of auditory stimuli. In: Proceedings of the International Conference on Information Technology: Coding and Computing [Computers and Communications], ITCC 2003, pp. 582–586 (2003)Google Scholar
  20. 20.
    Rigas, D., Hopwood, D.: The Role of multimedia in interfaces for on-line learning. In: 9th Panhellenic Conference Informatics, PCI 2003 (2003)Google Scholar
  21. 21.
    Rigas D., Memery, D.: Utilising audio-visual stimuli in interactive information systems: a two domain investigation on auditory metaphors. In: Proceedings of the International Conference on Information Technology: Coding and Computing, pp. 190–195. IEEE (2002)Google Scholar
  22. 22.
    Sarter, N.B.: Multimodal information presentation: design guidance and research challenges. Int. J. Ind. Ergon. 36(5), 439–445 (2006)CrossRefGoogle Scholar
  23. 23.
    Bartneck, C., Takahashi, T., Katagiri, Y.: Cross cultural study of expressive avatars. In: International Workshop on Social Intelligence Design (2004)Google Scholar
  24. 24.
    Salem, B., Earle, N.: Designing a non-verbal language for expressive avatars. In: Proceedings of the Third International Conference on Collaborative Virtual Environments, San Francisco, California, United States, pp. 93–101. ACM (2000)Google Scholar
  25. 25.
    Fabri, M., Moore, J.D., Hobbs, J.D.: Expressive agents: non-verbal communication in collaborative virtual environments. In: Proceedings of Autonomous Agents and Multi-agent Systems (2002)Google Scholar
  26. 26.
    Rashid, S., Rigas, D.: A two-group evaluation to e-note. Int. J. Educ. Inf. Technol. NAUN 2, 7–11 (2008)Google Scholar
  27. 27.
    Alotaibi, M., Rigas, D.: A usability evaluation of multimodal metaphors for customer knowledge management. Int. J. Comput. Commun. 2, 59–68 (2008). University Press, UKGoogle Scholar
  28. 28.
    Nielsen, J.: Usability Engineering. Academic Press Inc., Cambridge (1993)zbMATHGoogle Scholar
  29. 29.
    Aborokbah, M.: Multimodal ecommerce: usability and social presence. Ph.D. thesis, De Montfort University Faculty of Technology (2014)Google Scholar
  30. 30.
    Kranzler, J.H.: Frequency distributions. In: Statistics for the Terrified, 3rd edn. pp. 36–37. Prentice Hall (2003)Google Scholar
  31. 31.
    Field, A.P.: Exploring data. In: Discovering Statistics Using SPSS, 4th edn., pp. 65–109. SAGE Publications (2003)Google Scholar
  32. 32.
    Beskow, J.: Animation of talking agents. In: Proceedings of the ESCA Workshop on Audio-Visual Speech Processing, AVSP 1997, Rhodes, Greece (1997)Google Scholar
  33. 33.
    Duan, W., Gu, B., Whinston, A.B.: Do online reviews matter?—an empirical investigation of panel data. Decis. Support Syst. 45(4), 1007–1016 (2008)CrossRefGoogle Scholar
  34. 34.
    Cox, C., Burgess, S., Sellitto, C., Buultjens, J.: The role of user-generated-content in tourists’ travel planning behaviour. J. Hospitality Mark. Manag. 18, 743–764 (2009)CrossRefGoogle Scholar
  35. 35.
    Ghandour, R., Bakalova, R.: Social media influence on the holiday decision-making process in the UK. J. Organ. Stud. Innov. 1, 41–54 (2014)Google Scholar
  36. 36.
    Junyong, K., Pranjal, G.: Emotional expressions in online user reviews: how they influence consumers’ product evaluations. J. Bus. Res. 65, 985–992 (2012)CrossRefGoogle Scholar
  37. 37.
    Vermeulen, I., Seegers, D.: Tried and tested: the impact of online hotel reviews on consumer consideration. J. Tourism Manag. 30, 123–127 (2009)CrossRefGoogle Scholar
  38. 38.
    Ye, Q., Law, R., Gu, B., Chen, W.: The influence of user-generated content on traveller behaviour: an empirical investigation of the effects of e-word of-mouth to hotel online bookings. Comput. Hum. Behav. J. 2, 634–639 (2011)CrossRefGoogle Scholar

Copyright information

© Her Majesty the Queen in Right of the United Kingdom 2016

Authors and Affiliations

  1. 1.University of West LondonLondonUK

Personalised recommendations