Skip to main content

User Experience and Trustworthiness Measurement: Challenges in the Context of e-Commerce Applications

  • Conference paper
  • First Online:
Proceedings of the Future Technologies Conference (FTC) 2021, Volume 1 (FTC 2021)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 358))

Included in the following conference series:

  • 1215 Accesses

Abstract

Trust in computational systems and online applications depends on technical, social and personal aspects. The technical (e.g., computational infrastructure, network bandwidth, storage space) and social ones (e.g., runtime security, data privacy) have been largely studied. However, there are few studies about personal aspects that impact the sense of trust regarding user experience when interacting with those systems. In order to have a starting point for a survey, this paper provides an overview of tools, techniques and methodologies for measure trustworthiness through user experience in the context of e-commerce. Also, it addresses the major challenges about measuring trustworthiness in those systems: how users can know if the e-commerce they are using are trustworthy? Identifying the level of trust from the user perspective is particularly difficult because it depends on several factors that varies from person to person, such as the level of the experience of the user, the system structure, usability, among others.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 229.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 299.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://developers.google.com/speed/pagespeed/insights/?hl=pt-BR.

  2. 2.

    https://tools.pingdom.com/.

  3. 3.

    https://gtmetrix.com/.

  4. 4.

    https://search.google.com/test/mobile-friendly.

  5. 5.

    http://asesweb.governoeletronico.gov.br/ases/.

  6. 6.

    https://nibbler.silktide.com/.

  7. 7.

    http://accessmonitor.acessibilidade.gov.pt/amp/.

  8. 8.

    https://www.deadlinkchecker.com/.

  9. 9.

    https://xenus-link-sleuth.softonic.com.br/.

  10. 10.

    https://www.screamingfrog.co.uk/.

References

  1. Abascal, J., Arrue, M., Fajardo, I., Garay, N., Tomás, J.: The use of guidelines to automatically verify web accessibility. Univers. Access Inf.. Soc. 3(1), 71–79 (2004)

    Article  Google Scholar 

  2. Aljazzaf, Z.M., Perry, M., Capretz, M.A.M.: Online trust: definition and principles. In: 2010 Fifth International Multi-conference on Computing in the Global Information Technology, pp. 163–168. IEEE (2010)

    Google Scholar 

  3. Ang, L., Lee, B.-C.: Influencing perceptions of trustworthiness in internet commerce: a rational choice framework. In: Fifth CollECTer Conference on Electronic Commerce, CollECTeR, pp. 1–12 (2000)

    Google Scholar 

  4. Avizienis, A., Laprie, J.C., Randell, B., Landwehr, C.: Basic concepts and taxonomy of dependable and secure computing. IEEE Trans. Dependable Secure Comput. 1(1), 11–33 (2004)

    Article  Google Scholar 

  5. Barbosa, S., Silva, B.: Interação humano-computador. Elsevier, Brasil (2010)

    Google Scholar 

  6. Basso, A., Goldberg, D., Greenspan, S., Weimer, D.: First impressions: emotional and cognitive factors underlying judgments of trust e-commerce. In: Proceedings of the 3rd ACM Conference on Electronic Commerce, pp. 137–143 (2001)

    Google Scholar 

  7. Basso, T., Silva, H., Moraes, R.: On the use of quality models to characterize trustworthiness properties. In International Workshop on Software Engineering for Resilient Systems, pp. 147–155. Springer (2019)

    Google Scholar 

  8. Bauer, P.C.: Conceptualizing trust and trustworthiness. Political Concepts Working Paper Series 1(61), 1–16 (2019)

    Google Scholar 

  9. Bernardi, S., Merseguer, J., Petriu, D.C.: A dependability profile within MARTE. Softw. Syst. Model. 10(3), 313–336 (2011)

    Article  Google Scholar 

  10. Biggs, G., Sakamoto, T., Kotoku, T.: A profile and tool for modelling safety information with design information in SysML. Softw. Syst. Model. 15(1), 147–178 (2016)

    Article  Google Scholar 

  11. Bilgihan, A.: Gen y customer loyalty in online shopping: an integrated model of trust, user experience and branding. Comput. Hum. Behav. 61, 103–113 (2016)

    Article  Google Scholar 

  12. Braga, A., Ivaki, N., Moraes, R.: Trustworthiness measurement and analysis services implementation (2019). https://www.atmosphere-eubrazil.eu/d36-trustworthiness-measurement-and-analysis-services-implementation

  13. Brooke, J.: SUS: a “quick and dirty’’ usability. Usability Eval. Ind. 189, 4–7 (1996)

    Google Scholar 

  14. Caldwell, B., Cooper, M., Reid, L.G., Vanderheiden, G., Chisholm, W., Slatin, J., White, J.: Web content accessibility guidelines (WCAG) 2.0. WWW Consortium (W3C), 290 (2008)

    Google Scholar 

  15. Cases, A.-S.: Perceived risk and risk-reduction strategies in internet shopping. Int. Rev. Retail Distrib. Consum. Res. 12(4), 375–394 (2002)

    Google Scholar 

  16. Cho, J.-H., Swami, A., Chen, R.: A survey on trust management for mobile ad hoc networks. IEEE Commun. Surv. Tutor. 13(4), 562–583 (2010)

    Article  Google Scholar 

  17. Cho, J.-H., Xu, S., Hurley, P.M., Mackay, M., Benjamin, T., Beaumont, M.: STRAM: measuring the trustworthiness of computer-based systems. ACM Comput. Surv. (CSUR) 51(6), 1–47 (2019)

    Article  Google Scholar 

  18. Corbitt, B.J., Thanasankit, T., Yi, H.: Trust and e-commerce: a study of consumer perceptions. Electron. Commer. Res. Appl. 2(3), 203–215 (2003)

    Article  Google Scholar 

  19. Del Bianco, V., Lavazza, L., Morasca, S., Taibi, D.: Quality of open source software: the QualiPSo trustworthiness model. In: IFIP International Conference on Open Source Systems, pp. 199–212. Springer (2009)

    Google Scholar 

  20. Dujmovic, J.J.: Continuous preference logic for system evaluation. IEEE Trans. Fuzzy Syst. 15(6), 1082–1099 (2007)

    Article  Google Scholar 

  21. Dutton, P.: Trust issues in e-commerce. In: Proceedings of the 6th Australasian Women in Computing Workshop, vol. 26 (2000)

    Google Scholar 

  22. Fang, X., Holsapple, C.W.: An empirical study of web site navigation structures’ impacts on web site usability. Decis. Support Syst. 43(2), 476–491 (2007)

    Article  Google Scholar 

  23. de Lima Feitosa, D., Garcia, L.S.: Sistemas de reputação: um estudo sobre confiança e reputação no comércio eletrônico brasileiro. Revista de administração contemporânea 20(1), 84–105 (2016)

    Google Scholar 

  24. Finstad, K.: The usability metric for user experience. Interact. Comput. 22(5), 323–327 (2010)

    Article  Google Scholar 

  25. Freire, A.P., Fortes, R.P.M., Turine, M.A.S., Paiva, D.M.B.: An evaluation of web accessibility metrics based on their attributes. In Proceedings of the 26th annual ACM International Conference on Design of Communication, pp. 73–80 (2008)

    Google Scholar 

  26. Gefen, D.: Reflections on the dimensions of trust and trustworthiness among online consumers. ACM SIGMIS Database DATABASE Adv. Inf. Syst. 33(3), 38–53 (2002)

    Article  Google Scholar 

  27. Golden, B.L., Wasil, E.A., Harker, P.T.: The analytic hierarchy process. Applications and Studies, Heidelberg (1989)

    Google Scholar 

  28. Hussain, F.K., Chang, E.: An overview of the interpretations of trust and reputation. In: The Third Advanced International Conference on Telecommunications (AICT 2007), p. 30. IEEE (2007)

    Google Scholar 

  29. Hussin, A.B.R.C., Macaulay, L., Keeling, K.:: The importance ranking of trust attributes in e-commerce website. In: PACIS 2007 Proceedings, p. 99 (2007)

    Google Scholar 

  30. International Organization for Standardization. Systems and software engineering - systems and software quality requirements and evaluation (square) - system and software quality models (ISO/IEC) (2011)

    Google Scholar 

  31. International Organization for Standardization. International organization for standardization. when the world agrees (ISO/IEC) (2014)

    Google Scholar 

  32. International Organization for Standardization. Systems and software engineering - systems and software quality requirements and evaluation (square) - measurement of quality in use (ISO/IEC) (2016)

    Google Scholar 

  33. International Organization for Standardization. Systems and software engineering - systems and software quality requirements and evaluation (square) - measurement of system and software product quality (ISO/IEC) (2016)

    Google Scholar 

  34. Kim, J., Lee, J.: Critical design factors for successful e-commerce systems. Behav. .Inf. Technol. 21(3), 185–199 (2002)

    Article  Google Scholar 

  35. Maciel, P., Trivedi, K., Matias Jr, R., Kim, D.S.: Dependability Modeling, pp. 53–97. IGI Global (2012)

    Google Scholar 

  36. Mariappan, M.: A novel trust-scoring system using trustability co-efficient of variation for identification of secure agent platforms. PloS one 13(8), e0201600 (2018)

    Article  Google Scholar 

  37. Mohammadi, N., Paulus, S., Bishr, M., Metzger, A., Konnecke, H., Hartenstein, S., Weyer, T., Klaus, P.: Trustworthiness attributes and metrics for engineering trusted internet-based software systems. Commun. Comput. Inf. Sci. 453, 1–35 (2014)

    Google Scholar 

  38. Mohammadi, N.G., Bishr, S.P.M., Metzger, A., Koennecke, H., Hartenstein, S., Pohl, K.:. An analysis of software quality attributes and their contribution to trustworthiness. In: CLOSER, pp. 542–552 (2013)

    Google Scholar 

  39. Mohammadi, N.G., Paulus, S., Bishr, M., Metzger, A., Könnecke, H., Hartenstein, S., Weyer, T., Pohl, K.: Trustworthiness attributes and metrics for engineering trusted internet-based software systems. In International Conference on Cloud Computing and Services Science, pp. 19–35. Springer (2013)

    Google Scholar 

  40. Mouratidis, H., Cofta, P.: Practitioner’s challenges in designing trust into online systems. J. Theor. Appl. Electron. Commer. Res. 5(3), 65–77 (2010)

    Article  Google Scholar 

  41. Nielsen, J.: What is Usability, pp. 23–48. Morgan Kaufmann, San Francisco (1993)

    Google Scholar 

  42. Nielsen, J.: 10 heuristics for user interface design (1995)

    Google Scholar 

  43. Nietzio, A., Strobbe, C., Velleman, E.: The unified web evaluation methodology (UWEM) 1.2 for WCAG 1.0. In International Conference on Computers for Handicapped Persons, pp. 394–401. Springer (2008)

    Google Scholar 

  44. OECD. OECD Guidelines on Measuring Trust. OECD Publishing, 201y

    Google Scholar 

  45. Patil, V., Donyaee, M., Shyamansundar, R.K.: Trust management for e-transactions. Sadhana 30(2–3), 141–158 (2005)

    Article  MathSciNet  Google Scholar 

  46. Patterson, P.G., Cowley, E., Prasongsukarn, K.: Service failure recovery: the moderating impact of individual-level cultural value orientation on perceptions of justice. Int. J. Res. Mark. 23(3), 263–277 (2006)

    Article  Google Scholar 

  47. Riegelsberger, J., Sasse, MA.: Trustbuilders and trustbusters: the role of trust cues in interfaces to e-commerce applications’. In: Proceedings of the 1st IFIP conference on e-commerce, e-business. E-Government (2001)

    Google Scholar 

  48. Seffah, A., Donyaee, M., Kline, R.B., Padda, H.K.: Usability measurement and metrics: a consolidated model. Softw. Qual. J. 14(2), 159–178 (2006)

    Article  Google Scholar 

  49. Sharma, G., Lijuan, W.: The effects of online service quality of e-commerce websites on user satisfaction. Electr. Librar. 33(3), 468–485 (2015)

    Article  Google Scholar 

  50. Söllner, M., Hoffmann, A., Leimeister, J.M.: Why different trust relationships matter for information systems users. Eur. J. Inf. Syst. 25(3), 274–287 (2016)

    Article  Google Scholar 

  51. Tao, H., Chen, Y.: A new metric model for trustworthiness of softwares. Telecommun. Syst. 51(2), 95–105 (2012)

    Article  Google Scholar 

  52. Tao, H., Chen, Y., Hengyang, W.: A reallocation approach for software trustworthiness based on trustworthy attributes. Mathematics 8(1), 14 (2020)

    Article  MathSciNet  Google Scholar 

  53. Tao, H., Zhao, J.: Source codes oriented software trustworthiness measure based on validation. Mathematical Problems in Engineering, 2018 (2018)

    Google Scholar 

  54. Tsuda, N., Washizaki, H., Honda, K., Nakai, H., Fukazawa, Y., Azuma, M., Komiyama, T., Nakano, T., Suzuki, H., Morita, S., et al.: WSQF: Comprehensive software quality evaluation framework and benchmark based on square. In: 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP), pp. 312–321. IEEE (2019)

    Google Scholar 

  55. Utz, S., Kerkhof, P., Van Den Bos, J.: Consumers rule: how consumer reviews influence perceived trustworthiness of online stores. Electron. Commer. Res. Appl. 11(1), 49–58 (2012)

    Article  Google Scholar 

  56. Vigo, M., Arrue, M., Brajnik, G., Lomuscio, R., Abascal, J.: Quantitative metrics for measuring web accessibility. In: Proceedings of the 2007 International Cross-Disciplinary Conference on Web Accessibility (W4A), pp. 99–107 (2007)

    Google Scholar 

  57. Wang, Y., Vassileva, J.: Trust and reputation model in peer-to-peer networks. In: Proceedings Third International Conference on Peer-to-Peer Computing (P2P2003), pp. 150–157. IEEE (2003)

    Google Scholar 

  58. Wang, Y.D., Emurian, H.H.: An overview of online trust: concepts, elements, and implications. Comput. Hum. Behav. 21(1), 105–125 (2005)

    Article  Google Scholar 

  59. Wang, Y.D., Emurian, H.H.: Trust in e-commerce: consideration of interface design factors. J. Electron. Commer. Organ. (JECO) 3(4), 42–60 (2005)

    Article  Google Scholar 

  60. World Wide Web Consortium - W3C. Web content accessibility guidelines (WCAG) 2.1 (2018)

    Google Scholar 

  61. World Wide Web Consortium - W3C. Web content accessibility guidelines (WCAG) 3.0 (2021)

    Google Scholar 

  62. Yamamoto, Y.: A morality based on trust: some reflections on Japanese morality. Philos. East West 40(4), 451–469 (1990)

    Article  Google Scholar 

  63. Zarrabi, F., Pavlidis, M., Mouratidis, H., Islam, S., Preston, D.: A meta-model for legal compliance and trustworthiness of information systems. In: International Conference on Advanced Information Systems Engineering, pp. 46–60. Springer (2012)

    Google Scholar 

Download references

Acknowledgment

This work has been partially supported by the project ATMOSPHERE- Adaptive, Trustworthy, Manageable, Orchestrated, Secure, Privacy-assuring Hybrid, Ecosystem for Resilient Cloud Computing (https://www.atmosphere-eubrazil.eu/ - Horizon 2020 grant agreement No 777154 - MCTIC/RNP) and ADVANCE - Addressing Verification & Validation Challenges in Future Cyber-Physical Systems (https://www.advance-rise.eu/ - call H2020-MSCA-RISE-2018, number 823788).

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Casare, A., Basso, T., Moraes, R. (2022). User Experience and Trustworthiness Measurement: Challenges in the Context of e-Commerce Applications. In: Arai, K. (eds) Proceedings of the Future Technologies Conference (FTC) 2021, Volume 1. FTC 2021. Lecture Notes in Networks and Systems, vol 358. Springer, Cham. https://doi.org/10.1007/978-3-030-89906-6_13

Download citation

Publish with us

Policies and ethics