Abstract
Despite the increasing availability of groupware, most systems are awkward and not widely used. While there are many reasons for this, a significant problem is that groupware is difficult to evaluate. In particular, there are no discount usability evaluation methodologies that can discover problems specific to teamwork. In this paper, we describe how we adapted Nielsen's heuristic evaluation methodology, designed originally for single user applications, to help inspectors rapidly, cheaply effectively identify usability problems within groupware systems. Specifically, we take the ‘mechanics of collaboration’ framework and restate it as heuristics for the purposes of discovering problems in shared visual work surfaces for distance-separated groups.
Chapter PDF
Similar content being viewed by others
Keywords
- Usability Problem
- Computer Support Cooperative Work
- Heuristic Evaluation
- Gestural Communication
- Shared Workspace
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Clark, H. (1996). Using Language. Cambridge University Press, Cambridge.
Clark, H. and Brennan, S. (1991). Grounding in Communication, in Readings in Groupware and Computer Supported Cooperative Work, R. M. Baecker ed., Morgan-Kaufman Publishers, 222–233.
Cockburn, A. and Greenberg, S. (1993). Making contact: Getting the group communicating with groupware. Proc ACM COCS’93 Conference on Organizational Computing Systems, 31–41.
Cugini, J., Damianos, L., Hirschman, L., Kozierok, R., Kurtz, J., Laskowski, S. and Scholtz, J. (1997). Methodology for Evaluation of Collaboration Systems. The evaluation working group of the DARPA intelligent collaboration and visualization program, Rev. 3.0. http://zing.ncsl.nist.gov/nist-icv/documents/method.html.
Dix, A., Finlay, J., Abowd, G., and Beale, R. (1993). Human-Computer Interaction, Prentice Hall.
Dourish, P., and Bellotti, V. (1992). Awareness and Coordination in Shared Workspaces. Proc. ACM CSCW’92, 107–114.
Egido, C. (1990). Teleconferencing as a Technology to Support Cooperative Work: Its Possibilities and Limitations, in Intellectual Teamwork: Social and Technological Foundations of Cooperative Work, J. Galegher, R. Kraut, and C. Egido ed., Lawrence Erlbaum, 351–372.
Ereback A.L. and Hook, K. (1994). Using Cognitive Walkthrough for Evaluating a CSCW Application. Proc ACM CHI’94, 91–92.
Gaver, W. (1991). Sound Support for Collaboration, Proc. 2nd ECSCW’91, 293–308.
Goodwin, C. (1981). Conversational Organization: Interaction Between Speakers and Hearers, Academic Press.
Greenberg, S., Fitzpatrick, G., Gutwin, C. and Kaplan, S. (1999). Adapting the Locales Framework for Heuristic Evaluation of Groupware. Proc. OZCHI’99 Australian Conference on Computer Human Interaction, 28–30.
Greenberg S. and Roseman, M. (1998). Using a Room Metaphor to Ease Transitions in Groupware. Research report 98/611/02, Dept of Computer Science, University of Calgary, Canada.
Greenberg, S., Roseman, M., Webster, D. and Bohnet, R. (1992). Human and technical factors of distributed group drawing tools. Interacting with Computers, 4(1), 364–392.
Grudin, J. (1988) Why CSCW Applications Fail: Problems in the Design and Evaluation of Organizational Interfaces. Proc ACM CSCW’88, 85–93.
Gutwin, C. (1997). Workspace Awareness in Real-Time Distributed Groupware. Ph.D Thesis, Dept of Computer Science, University of Calgary, Canada.
Gutwin, C. and Greenberg, S. (1999). The Effects of Workspace Awareness Support on the Usability of Real-Time Distributed Groupware. ACM Transactions on Computer-Human Interaction, 6(3), 243–281.
Gutwin, C. and Greenberg, S. (2000). The Mechanics of Collaboration: Developing Low Cost Usability Evaluation Methods for Shared Workspaces. IEEE 9th Int’l Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises (WET-ICE’00).
Hill, W., Hollan, J., Wroblewski, D., and McCandless, T. (1991) Edit Wear and Read Wear. Proc CHI’91, 3–9.
Heath, C., Jirotka, M., Luff, P., and Hindmarsh, J. (1995). Unpacking Collaboration: The Interactional Organisation of Trading in a City Dealing Room. Computer Supported Cooperative Work, 3(2), 147–165.
Ishii, H., Kobayshi, M., and Grudin, J. (1992). Integration of interpersonal space and shared workspace: ClearBoard design and experiments. Proc ACM CSCW’92, 33–42.
Kraut, R., Egido, C., and Galegher, J. (1988). Patterns of Contact and Communication in Scientific Research Collaboration Remote Communications. Proc ACM CSCW’88, 1–12
Mack, R. and Nielsen, J. (1994). Executive Summary. In Usability Inspection Methods, Nielsen, J. and Mack, R., Eds. John Wiley and Sons, New York, 1–23.
McGrath, J. (1996). Methodology matters: Doing research in the behavioural and social sciences. In R. Baecker, J. Grudin, W. Buxton and S. Greenberg (eds) Readings in Human Computer Interaction: Towards the Year 2000, Morgan-Kaufmann, 152–169.
McLaughlin, M., (1984). Conversation: How Talk is Organized, Sage, Beverly Hills.
Nielsen, J. (1992). Finding usability problems through heuristic evaluation. Proc ACM CHI’92, 372–380.
Nielsen, J. (1993). Usability Engineering. Academic Press.
Nielsen, J. (1994). Chapter 2: Heuristic Evaluation. In Usability Inspection Methods, Nielsen, J. and Mack, R., Eds. John Wiley and Sons, New York, 25–62.
Nielsen, J. (1994). Enhancing the explanatory power of usability heuristics. Proc ACM CHI’94, 152–158.
Nielsen, J., and Molich, R. (1990). Heuristic evaluation of user interfaces. Proc ACM CHI’90, 249–256.
Robinson, M. (1991) Computer-Supported Cooperative Work: Cases and Concepts. Proc Groupware’91, 59–75.
Sacks, H., Schegloff, E., and Jefferson, G. (1974). A Simplest Semantics for the Organization of Turn-Taking for Conversation, Language, 50, 696–735.
Salvador, T., Scholtz, J., and Larson, J. The Denver Model of Groupware Design, SIGCHI Bulletin, 28(1), 52–58
Segal, L. (1994). Effects of Checklist Interface on Non-Verbal Crew Communications, NASA Ames Research Center, Contractor Report 177639.
Short, J., Williams, E., and Christie, B. (1976). Communication Modes and Task Performance, in Readings in Groupware and Computer Supported Cooperative Work, R. M. Baecker Eds., Morgan-Kaufman Publishers, Moutain View, CA, 169–176.
Smith, R., O’shea, T., O'Malley, C., Scanlon, E., and Taylor, J. (1989). Preliminary experiences with a distributed, multi-media, problem environment. Proc EC-CSCW’89.
Stefik, M., Foster, G., Bobrow, D., Kahn, K., Lanning, S., and Suchman, L. (1987). Beyond the Chalkboard: Computer Supported for Collaboration and Problem Solving in Meetings. Comm. ACM, 30(1), 32–47.
Stefik, M., Bobrow, D., Foster, G., Lanning, S., and Tatar, D. (1987) WYSIWIS Revised: Early Experiences with Multiuser Interfaces. ACM Transactions on Office Information Systems, 5(2), 147–167.
Tang, J. (1991). Findings from Observational Studies of Collaborative Work. Intl J Man-Machine Studies, 34(2), 143–160.
Tang, J. and Leifer, L. (1988). A Framework for Understanding the Workspace Activity of Design Teams. Proc ACM CSCW’88, 244–249.
Tang, J. and Minneman, S. (1990). VideowDraw: A Video Interface for Collaborative Drawing. Proc ACM CHI’90, 313–320.
Tatar, D., Foster, G., and Bobrow, D. (1991). Design for Conversation: Lessons from Cognoter. International Journal of Man-Machine Studies, 34(2), 185–210.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Baker, K., Greenberg, S., Gutwin, C. (2001). Heuristic Evaluation of Groupware Based on the Mechanics of Collaboration. In: Little, M.R., Nigay, L. (eds) Engineering for Human-Computer Interaction. EHCI 2001. Lecture Notes in Computer Science, vol 2254. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45348-2_14
Download citation
DOI: https://doi.org/10.1007/3-540-45348-2_14
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43044-5
Online ISBN: 978-3-540-45348-2
eBook Packages: Springer Book Archive