Skip to main content

System Evaluation and User Interfaces

  • Chapter
  • 887 Accesses

Abstract

It is essential for developing a useful system to evaluate its user interface. The interface should be evaluated by potential users instead of experts, if unbiased results are to be obtained. It is more recommendable to observe users’ reactions to an actual working prototype of the interface than to simply ask them about what kind of interface is preferable. The observation in a laboratory room can produce more general and scientific results than that in a real-world situation does. Thus, this chapter describes how to conduct a laboratory study. It collects users’ reactions to the prototype of a user interface in a controlled situation. There are many items to consider in order to conduct a laboratory study: goals, hypotheses, factors, conditions, experimental design, tasks, subjects, data collection, and analysis. Each of these items is explained in detail. An example of system evaluation that is conducted in the past study on telepresence robots is discussed.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   139.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Ishiguro, H., Trivedi, M.: Integrating a perceptual information infrastructure with robotic avatars: a framework for tele-existence. In: Proceedings of the International Conference on Intelligent Robots and Systems (IROS 99), pp. 1032–1038 (1999)

    Google Scholar 

  • Jouppi, N.P.: First steps towards mutually-immersive mobile telepresence. In: Proceedings of the International Conference on Computer Supported Cooperative Work (CSCW 2002), pp. 354–363 (2002)

    Google Scholar 

  • Nakanishi, H., Murakami, Y., Kato, K.: Movable cameras enhance social telepresence in media spaces. In: Proceedings of the International Conference on Human Factors in Computing Systems (CHI 2009), pp. 433–442 (2009)

    Google Scholar 

  • Nakanishi, H., Kato, K., Ishiguro, H.: Zoom cameras and movable displays enhance social telepresence. In: Proceedings of the International Conference on Human Factors in Computing Systems (CHI 2011), pp. 63–72 (2011)

    Google Scholar 

  • Nakanishi, H., Tanaka, K., Wada, Y.: Remote handshaking: touch enhances video-mediated social telepresence. In: Proceedings of the International Conference on Human Factors in Computing Systems (CHI 2014), pp. 2143–2152 (2014)

    Google Scholar 

  • Nakanishi, H., et al.: Minimum movement matters: impact of robot-mounted cameras on social telepresence. In: Proceedings of the International Conference on Computer Supported Cooperative Work (CSCW 2008), pp. 303–312 (2008)

    Google Scholar 

  • Paulos, E., Canny, J.: Social tele-embodiment: understanding presence. Auton Robot 11(1), 87–95 (2001)

    Article  MATH  Google Scholar 

  • Prussog, A., Muhlbach, L., Bocker, M.: Telepresence in videocommunications. Annual Meeting of Human Factors and Ergonomics Society, pp. 180–184 (1994)

    Google Scholar 

  • Vogeley, K., Fink, G.R.: Neural correlates of the first-person-perspective. Trends Cogn. Sci. 7(1), 38–42 (2003)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hideyuki Nakanishi .

Editor information

Editors and Affiliations

Exercises

Exercises

  1. 1.

    This chapter has introduced and described an example of telepresence robot in a certain way. In the same way, summarize the goal, hypotheses, factors, conditions, experimental design, task, subjects, data collection, and analysis of some other study on robotic telepresence technology (see Nakanishi et al. 2009, 2011, 2014).

  2. 2.

    Plan your own study that evaluates the user interface of some interactive system, and describe its goal, hypotheses, factors, conditions, experimental design, task, subjects, data collection, and analysis.

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer Japan

About this chapter

Cite this chapter

Nakanishi, H. (2016). System Evaluation and User Interfaces. In: Kasaki, M., Ishiguro, H., Asada, M., Osaka, M., Fujikado, T. (eds) Cognitive Neuroscience Robotics A. Springer, Tokyo. https://doi.org/10.1007/978-4-431-54595-8_7

Download citation

  • DOI: https://doi.org/10.1007/978-4-431-54595-8_7

  • Publisher Name: Springer, Tokyo

  • Print ISBN: 978-4-431-54594-1

  • Online ISBN: 978-4-431-54595-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics