Skip to main content

Issues in Adapting Usability Testing for Global Usability

  • Chapter
  • First Online:
Global Usability

Part of the book series: Human-Computer Interaction Series ((HCIS))

Abstract

The localisation of usability tools and techniques, and the recognition and promotion of these within national institutions responsible for professional practice, is critical to the development of usable products within a global development community. This chapter focuses on the localisation of usability testing methods and specifically on the extent to which cultural differences between users and developers impinge on the effectiveness of such methods. In order to explore the relationship between culture and user based evaluation it presents a review of different methods for user based testing/evaluation. It also provides a summary of key aspects within relevant literature on the ways in which cultural issues may influence evaluation effectiveness. It also reports on studies to date that document the effects of culture and usability evaluation. The chapter concludes by presenting potential guidance on the selection and implementation of usability evaluation methods within local and global contexts.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Beyer, H., Holtzblatt, K.: Contextual Design: Defining Customer-Centred Systems. Morgan Kaufmann, Los Altos (1998)

    Google Scholar 

  • Camara, S., Oyugi, C., Abdelnour-Nocera, J., Smith, A.: Augmenting Usability: Cultural elicitation in HCI, in Katre, D., Orngreen, R., Yammiyavar, P., Clemmensen, T. (eds.) Human Work Interaction Design: Usability in Social, Cultural and Organizational Contexts, Second IFIP WG 13.6 Conference HWID 2009, Springer pp. 46–56 (2010)

    Google Scholar 

  • Carroll, J.M., Mack, R.L.: Learning to use a word processor: by doing, by thinking, and by knowing. In: Tomas, J.C., Schneider, M.L. (eds.) Human Factors in Computer Systems, pp. 13–51. Ablex, Norwood (1984)

    Google Scholar 

  • Carroll, J.M., Rosson, M.B.: Designing by scenario. Hum. Comput. Interact. 6(3,4), 281–318 (1991)

    Article  Google Scholar 

  • Chavan, A.L.: Another culture, another method. In: Proceedings of the 11th International Conference on Human-Computer Interaction. Lawrence Erlbaum, Hillsdale (2005)

    Google Scholar 

  • Chetty, M.: Developing locally relevant applications for rural South Africa; a telemedicine example. University of Cape Town. Unpublished thesis (2005)

    Google Scholar 

  • Clemmensen, T., Plocher, T.: The cultural usability (CULTUSAB) project: studies of cultural models in psychological usability evaluation methods. In: Aykin, N. (ed.) Usability and Internationalization – Second International Conference on Usability and Internationalization, HCI International 2007, Beijing, China, Proceedings, Part I, pp. 274–280. Springer, Heidelberg (2007)

    Google Scholar 

  • Dray, S.: Usable for the world: a practical guide to international user studies, In: Day D., Dunckley L. (eds.) Designing for Global Markets 3, Proceedings of IWIPS 2001, pp. 154–155. IWIPS (2001)

    Google Scholar 

  • Evers, V.: Cultural aspects of user interface understanding: an empirical evaluation of an e-learning website by international user groups. PhD thesis, Open University (2001)

    Google Scholar 

  • Goguen, J.A.: Formality and Informality in Requirements Engineering, Proceedings of the Second International Conference on Requirements Engineering (ICRE’96), pp. 102–108. IEEE Computer Society Press, Silver Spring (1996)

    Google Scholar 

  • Gray, W.D., Saltzman, M.C.: Damaged merchandise? A review of experiments that compare usability evaluation methods. Hum. Comput. Interact. 13, 203–261 (1998)

    Article  Google Scholar 

  • Hall, E.T.: Beyond Culture. Doubleday, Garden City (1976)

    Google Scholar 

  • Hall, E.T., Hall, M.: Hidden Differences: Doing Business with the Japanese. Anchor Press/Doubleday, Garden City (1987)

    Google Scholar 

  • Herman, L.: Towards effective usability evaluation in Asia: cross-cultural differences. In: Proceedings of the 6th Australian Conference on Computer-Human Interaction (OZCHI ‘96), p. 135 (1996)

    Google Scholar 

  • Hofstede, G.: Cultures and Organizations. McGraw-Hill Book Company Europe, Berkshire (1991)

    Google Scholar 

  • Katre, D.S.: One-handed thumb use on smart phones by semi-literate and illiterate users in India: a usability report with design improvements for precision and ease. In: Proceedings of Workshop on Cultural Usability and Human Work Interaction Design, NordiCHI Conference, Lund, Sweden (2008)

    Google Scholar 

  • Landauer, T.K.: The Trouble with Computers. MIT Press, Cambridge (1995)

    Google Scholar 

  • Lim, K., Usma, M.: Usability evaluation in the field: lessons from a case-study involving public information kiosks. APCHI (Asia Pacific Conference on Computer Human Interaction) Journal, Los Alamitos, 70. IEEE Computer Society (1998)

    Google Scholar 

  • Lin, H.X., Choong, Y., Salvendy, G.: A proposed index of usability: a method for comparing the relative usability of different software systems. Behav. Inform. Technol. 16(4, 5), 267–278 (1997)

    Google Scholar 

  • Maiden, N., Rugg, G.: ACRE: selecting methods for requirements acquisition. Software. Eng. J. 11(3), 183–192 (1996)

    Article  Google Scholar 

  • Marcus, A., Gould, E. W.: Cultural dimensions and global web user-interface design: What? So What? Now What? In: Proceedings of the 6th Conference on Human Factors and the Web. Austin, Texas. http://www.amanda.com/resources/hfweb2000/AMA_CultDim.pdf (2000). Retrieved 25 Apr 2010

  • Nakakoji, K.: Crossing the cultural boundary. Byte 19(6), 107–109 (1994)

    Google Scholar 

  • Norman, D.: Cognitive engineering. In: Norman, D.A., Draper, S.W. (eds.) User Centered Systems Design: New Perspectives on Human–Computer Interaction. Lawrence Erlbaum, Hillsdale (1986)

    Google Scholar 

  • Oyugi, C., Dunckley, L., Smith, A.: Evaluation methods and cultural differences: studies across three continents. In: ACM International Conference Proceeding Series, vol. 358, Proceedings of the 5th Nordic conference on Human-Computer Interaction: Building Bridges, Lund, Sweden, pp. 318–325 (2008)

    Google Scholar 

  • Sacher, H.: Interactions in Chinese: designing interfaces for Asian languages, Interactions, 5(5), pp. 28–38ACM

    Google Scholar 

  • Smith, A., Chang, Y., French, T.: Quantifying cultural characteristics of Chinese users. J. Asian Inform. Sci. Life 2(2) (2003)

    Google Scholar 

  • Smith, A., Dunckley, L.: Prototype evaluation and redesign: structuring the design space through contextual techniques, Interacting with Computers, 14(6), pp 821–843 (2002)

    Google Scholar 

  • Smith, A., Dunckley, L., French, T., Minocha, S., Chang, Y.: A process model for developing usable cross-cultural websites. Interact. Comput. 16(1), 63–91 (2004)

    Article  Google Scholar 

  • Smith, A., Joshi, A., Liu, Z., Bannon, L., Gulliksen, J., Li, C.: Institutionalizing HCI in Asia, Interact 2007. In: Proceedings of the 11th IFIP TC13 International Conference on Human Computer Interaction, pp. 85–99 (2007)

    Google Scholar 

  • Spolsky, B.: Conditions for Second Language Learning. Oxford University Press, Oxford (1989)

    Google Scholar 

  • Suchman, L.: Plans and Situated Action. Cambridge University Press, Cambridge (1987)

    Google Scholar 

  • Suinn, R.M., Ahuna, C., Khoo, G.: The Suinn-Lew Asian self-identity acculturation scale: ­concurrent and factorial validation. Educ. Psychol. Meas. 52(4), 1041–1046 (1992)

    Article  Google Scholar 

  • Trompenaars, F., Hampden-Turner, C.: Riding the Waves of Culture: Understanding Cultural Diversity in Business. Nicholas Brealey, London (1997)

    Google Scholar 

  • Vatrapu, R., Pérez-Quiñones, M.A.: Culture and usability evaluation: the effects of culture in structured interviews. J. Usability Stud. 1(4), 156–170 (2006)

    Google Scholar 

  • Wharton, C., Rieman, J., Lewis, C., Polson, P.: The cognitive walkthrough method: a practitioner’s guide. In: Nielsen, J., Mack, R.L. (eds.) Usability Inspection Methods, John Wiley & Sons, New York, pp. 105–140 (1994)

    Google Scholar 

  • Winschiers, H.: Dialogical system design across cultural boundaries. Doctoral dissertation. University of Hamburg. http://deposit.ddb.de/cgibin/dokserv?idn=963272756&dok_var=d1&dok_ext=pdf&filename=963272756.pdf(2001). Retrieved 15 Nov 2009

  • Winschiers, H., Fendler, J.: Assumptions considered harmful – the need to redefine usability. In: Aykin, N. (ed.) Usability and Internationalization, Part I, HCII 2007, LNCS 4559, pp. 452–461. Springer, Berlin (2007)

    Chapter  Google Scholar 

  • Wright, P.C., Monk, A.F.: A cost-effective evaluation method for use by designers. Int. J. Man Mach. Stud. 35, 891–912 (1991)

    Article  Google Scholar 

  • Yammiyavar, P., Kate, P.: Developing mobile phone based GUIs: a methodology case study on conceptualising a GUI for users in the construction industry. In: Proceedings of IFIP HWID2009 Working Conference on Usability in Social, Cultural and Organisational Contexts Pune, India, 7–8 Oct 2009

    Google Scholar 

  • Yeo, A.: Global software development lifecycle: an exploratory study. In: Jacko, J., Sears, A., Beaudouin-Lafon, M., Jacob, R. (eds.) CHI 2001: Conference on Human Factors in Computing Systems, pp. 104–111. ACM Press, New York (2001)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Andy Smith .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag London Limited

About this chapter

Cite this chapter

Smith, A. (2011). Issues in Adapting Usability Testing for Global Usability. In: Douglas, I., Liu, Z. (eds) Global Usability. Human-Computer Interaction Series. Springer, London. https://doi.org/10.1007/978-0-85729-304-6_3

Download citation

  • DOI: https://doi.org/10.1007/978-0-85729-304-6_3

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-0-85729-303-9

  • Online ISBN: 978-0-85729-304-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics