Abstract
It is essential for developing a useful system to evaluate its user interface. The interface should be evaluated by potential users instead of experts, if unbiased results are to be obtained. It is more recommendable to observe users’ reactions to an actual working prototype of the interface than to simply ask them about what kind of interface is preferable. The observation in a laboratory room can produce more general and scientific results than that in a real-world situation does. Thus, this chapter describes how to conduct a laboratory study. It collects users’ reactions to the prototype of a user interface in a controlled situation. There are many items to consider in order to conduct a laboratory study: goals, hypotheses, factors, conditions, experimental design, tasks, subjects, data collection, and analysis. Each of these items is explained in detail. An example of system evaluation that is conducted in the past study on telepresence robots is discussed.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Ishiguro, H., Trivedi, M.: Integrating a perceptual information infrastructure with robotic avatars: a framework for tele-existence. In: Proceedings of the International Conference on Intelligent Robots and Systems (IROS 99), pp. 1032–1038 (1999)
Jouppi, N.P.: First steps towards mutually-immersive mobile telepresence. In: Proceedings of the International Conference on Computer Supported Cooperative Work (CSCW 2002), pp. 354–363 (2002)
Nakanishi, H., Murakami, Y., Kato, K.: Movable cameras enhance social telepresence in media spaces. In: Proceedings of the International Conference on Human Factors in Computing Systems (CHI 2009), pp. 433–442 (2009)
Nakanishi, H., Kato, K., Ishiguro, H.: Zoom cameras and movable displays enhance social telepresence. In: Proceedings of the International Conference on Human Factors in Computing Systems (CHI 2011), pp. 63–72 (2011)
Nakanishi, H., Tanaka, K., Wada, Y.: Remote handshaking: touch enhances video-mediated social telepresence. In: Proceedings of the International Conference on Human Factors in Computing Systems (CHI 2014), pp. 2143–2152 (2014)
Nakanishi, H., et al.: Minimum movement matters: impact of robot-mounted cameras on social telepresence. In: Proceedings of the International Conference on Computer Supported Cooperative Work (CSCW 2008), pp. 303–312 (2008)
Paulos, E., Canny, J.: Social tele-embodiment: understanding presence. Auton Robot 11(1), 87–95 (2001)
Prussog, A., Muhlbach, L., Bocker, M.: Telepresence in videocommunications. Annual Meeting of Human Factors and Ergonomics Society, pp. 180–184 (1994)
Vogeley, K., Fink, G.R.: Neural correlates of the first-person-perspective. Trends Cogn. Sci. 7(1), 38–42 (2003)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Exercises
Exercises
-
1.
This chapter has introduced and described an example of telepresence robot in a certain way. In the same way, summarize the goal, hypotheses, factors, conditions, experimental design, task, subjects, data collection, and analysis of some other study on robotic telepresence technology (see Nakanishi et al. 2009, 2011, 2014).
-
2.
Plan your own study that evaluates the user interface of some interactive system, and describe its goal, hypotheses, factors, conditions, experimental design, task, subjects, data collection, and analysis.
Rights and permissions
Copyright information
© 2016 Springer Japan
About this chapter
Cite this chapter
Nakanishi, H. (2016). System Evaluation and User Interfaces. In: Kasaki, M., Ishiguro, H., Asada, M., Osaka, M., Fujikado, T. (eds) Cognitive Neuroscience Robotics A. Springer, Tokyo. https://doi.org/10.1007/978-4-431-54595-8_7
Download citation
DOI: https://doi.org/10.1007/978-4-431-54595-8_7
Publisher Name: Springer, Tokyo
Print ISBN: 978-4-431-54594-1
Online ISBN: 978-4-431-54595-8
eBook Packages: EngineeringEngineering (R0)