Awareness Checklist: Reviewing the Quality of Awareness Support in Collaborative Applications

  • Pedro Antunes
  • Claudio Sapateiro
  • Jose A. Pino
  • Valeria Herskovic
  • Sergio F. Ochoa
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6257)


A proposal of a method to assess awareness support is made. This proposal is intended for the use of collaborative applications developers at any time during development. It consists of a checklist. It is made with the inclusion of design elements obtained by the analysis of Quality Assurance ideas applied to collaborative systems. The proposal is illustrated with its use in two cases.


Awareness Inspection Collaborative Applications 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Antunes, P., Pino, J.: A Review of CRIWG Research. In: 16th CRIWG (2010) (in press)Google Scholar
  2. 2.
    Aurm, A., Petersson, H., Wohlin, C.: State-of-the-Art: Software Inspections after 25 Years. Software Testing Verification and Reliability 12, 133–154 (2002)CrossRefGoogle Scholar
  3. 3.
    Baker, K., Greenberg, S., Gutwin, C.: Empirical Development of a Heuristic Evaluation Methodology for Shared Workspace Groupware. In: CSCW 2002, pp. 96–105 (2002)Google Scholar
  4. 4.
    Barney, M.: Motorola’s Second Generation. Six Sigma Forum Magazine (May 2002)Google Scholar
  5. 5.
    Boaden, R.: What Is Total Quality Management... And Does It Matter? Total Quality Management 8, 153–171 (1997)Google Scholar
  6. 6.
    Brewer, I., MacEachren, A., Abdo, H., Gundrum, J., Otto, G.: Collaborative Geographic Visualization: Enabling Shared Understanding of Environmental Processes. In: Proc. of IEEE Symposium on Information Visualization, Washington, DC, p. 137 (2000)Google Scholar
  7. 7.
    Brewer, J., Dourish, P.: Storied Spaces: Cultural Accounts of Mobility, Technology, and Environmental Knowing. Int. Journal of Human-Computer Studies 66, 963–976 (2008)CrossRefGoogle Scholar
  8. 8.
    Cecez-Kecmanovic, D.: A Sensemaking Theory of Knowledge in Organizations and Its Application. In: Davis, J., et al. (eds.) Knowledge Management. Organizational and Technological Dimensions. Springer, Heidelberg (2005)Google Scholar
  9. 9.
    Chan, L.: Quality Function Deployment: A Literature Review. European Journal of Operational Research 143, 463–497 (2002)zbMATHCrossRefGoogle Scholar
  10. 10.
    Cheverst, K., Davies, N., Mitchell, K., Friday, A., Efstratiou, C.: Developing a Context-Aware Electronic Tourist Guide: Some Issues and Experiences. In: Proc. SIGCHI Conf. on Human Factors in Comp. Systems, pp. 17–24. ACM Press, The Hague (2000)CrossRefGoogle Scholar
  11. 11.
    Convertino, G., Ganoe, C., Schafer, W., Yost, B., Carroll, J.: A Multiple View Approach to Support Common Ground in Distributed and Synchronous Geo-Collaboration. In: 3rd Int. Conf. on Coordinated and Multiple Views in Exploratory Visualization, pp. 121–132 (2005)Google Scholar
  12. 12.
    Convertino, G., Neale, D., Hobby, L., Carroll, J., Rosson, M.: A Laboratory Method for Studying Activity Awareness. In: Proc. Third Nordic Conf. on Human-Computer interaction, pp. 313–322. ACM Press, Tampere (2004)CrossRefGoogle Scholar
  13. 13.
    Daft, R., Lengel, R.: Organizational Information Requirements, Media Richness and Structural Design. Management Science 32 (1986)Google Scholar
  14. 14.
    Davis, G.: Anytime/Anyplace Computing and the Future of Knowledge Work. Communications of ACM 45, 67–73 (2002)CrossRefGoogle Scholar
  15. 15.
    DeSanctis, G., Gallupe, R.: A Foundation for the Study of Group Decision Support Systems. Management Science 33, 589–609 (1987)CrossRefGoogle Scholar
  16. 16.
    Dix, A., Rodden, T., Davies, N., Trevor, J., Friday, A., Palfreyman, K.: Exploiting Space and Location as a Design Framework for Interactive Mobile Systems. ACM Transactions on CHI 7 (2000)Google Scholar
  17. 17.
    Dourish, P., Bellotti, V.: Awareness and Coordination in Shared Workspaces. In: ACM Conf. on Computer-Supported Cooperative Work, pp. 107–114. ACM Press, New York (1992)Google Scholar
  18. 18.
    Dourish, P.: Re-Space-Ing Place: "Place" And "Space" Ten Years On. In: 20th Conf. on Computer Supported Cooperative Work, pp. 299–308. ACM Press, Alberta (2006)Google Scholar
  19. 19.
    Dourish, P.: Where the Action Is. The MIT Press, Cambridge (2001)Google Scholar
  20. 20.
    Endsley, M., Aircraft, N., Hawthorne, C.: Situation Awareness Global Assessment Technique (Sagat). In: Proc. IEEE National Aerospace and Electronics Conf., pp. 789–795 (1988)Google Scholar
  21. 21.
    Endsley, M., Garland, D.: Situation Awareness Analysis and Measurement. CRC Press, Boca Raton (2000)Google Scholar
  22. 22.
    Endsley, M., Jones, W.: A Model of Inter and Intra Team Situation Awareness: Implications for Design, Training and Measurement. New Trends in Cooperative Activities: Understanding System Dynamics in Complex Environments, pp. 46–67. Human Factors and Ergonomics Society, Santa Monica (2001)Google Scholar
  23. 23.
    Endsley, M.: Designing for Situation Awareness. Taylor & Francis, Abington (2003)Google Scholar
  24. 24.
    Endsley, M.: Toward a Theory of Situation Awareness in Dynamic Systems. Human Factors 31, 32–64 (1995)CrossRefGoogle Scholar
  25. 25.
    Fagan, M.: Design and Code Inspections to Reduce Errors in Program Development. IBM Systems Journal 15, 182–211 (1976)CrossRefGoogle Scholar
  26. 26.
    Fisher, D., Dourish, P.: Social and Temporal Structures in Everyday Collaboration. In: Proc. SIGCHI Conf. on Human Factors in Comp. Syst., pp. 551–558. ACM Press, New York (2004)Google Scholar
  27. 27.
    Gaver, W.: Sound support for collaboration. In: Proc. of ECSCW 1991, pp. 293–308 (1991)Google Scholar
  28. 28.
    Greenberg, S., Boyle, M., Laberge, J.: PDAs and Shared Public Displays: Making Personal Information Public, and Public Information Personal. Personal Technol. 3, 54–64 (1999)CrossRefGoogle Scholar
  29. 29.
    Greenberg, S., Roseman, M.: Using a Room Metaphor to Ease Transitions in Groupware. In: Ackerman, M., et al. (eds.) Sharing Expertise. Beyond Knowledge Management, pp. 203–256. MIT Press, Cambridge (2003)Google Scholar
  30. 30.
    Grønbæk, K., Vestergaard, P., Ørbæk, P.: Towards Geo-Spatial Hypermedia: Concepts and Prototype Implementation. In: 13th ACM Conf. on Hypertext and Hypermedia, pp. 117–126 (2002)Google Scholar
  31. 31.
    Gutwin, C., Greenberg, S.: A Descriptive Framework of Workspace Awareness for Real-Time Groupware. Computer Supported Cooperative Work 11, 411–446 (2002)CrossRefGoogle Scholar
  32. 32.
    Gutwin, C., Greenberg, S.: The Effects of Workspace Awareness Support on the Usability of Real-Time Distributed Groupware. ACM T. on Comp.-Human Int. 6, 243–281 (1999)Google Scholar
  33. 33.
    Gutwin, C., Greenberg, S.: The Mechanics of Collaboration: Developing Low Cost Usability Eval. Methods for Shared Workspaces. In: WETICE 2000, pp. 98–103. IEEE Press, Los Alamitos (2000)Google Scholar
  34. 34.
    Gutwin, C., Roseman, M., Greenberg, S.: A usability study of awareness widgets in a shared workspace groupware system. In: Proc. of CSCW 1996, pp. 258–267 (1996)Google Scholar
  35. 35.
    Haag, S., Raja, M., Schkade, L.: Quality Function Deployment Usage in Software Development. Communications of the ACM 39, 41–49 (1996)CrossRefGoogle Scholar
  36. 36.
    Hauser, J., Clausing, D.: The House of Quality. Harvard Business Review 66, 63–73 (1988)Google Scholar
  37. 37.
    Hazas, M., Scott, J., Krumm, J.: Location-Aware Computing Comes of Age. Computer 37, 95–97 (2004)CrossRefGoogle Scholar
  38. 38.
    Herskovic, V., Pino, J., Ochoa, S., Antunes, P.: Evaluation Methods for Groupware Systems. In: Haake, J.M., Ochoa, S.F., Cechich, A. (eds.) CRIWG 2007. LNCS, vol. 4715, pp. 328–336. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  39. 39.
    Hinkley, C.: Defining the Best Quality-Control Systems by Design and Inspection. Clinical Chemistry 43, 873–879 (1997)Google Scholar
  40. 40.
    Holzinger, A.: Usability engineering methods for software developers. Communications of the ACM 48, 71–74 (2005)CrossRefGoogle Scholar
  41. 41.
    Hornecker, E., Marshall, P., Dalton, N.S., Rogers, Y.: Collaboration and interference: awareness with mice or touch input. In: Proc. of CSCW 2008, pp. 167–176 (2008)Google Scholar
  42. 42.
    Howell, J.: Statistical Quality Control. Mathematics Magazine 25, 155–157 (1952)CrossRefMathSciNetGoogle Scholar
  43. 43.
    Hoyle, D.: ISO9000 Quality Systems Handbook. Elsevier, Oxford (2009)Google Scholar
  44. 44.
    Jensen, E.: Sensemaking in Military Planning: A Methodological Study of Command Teams. Cognition, Technology & Work 11, 103–118 (2009)CrossRefGoogle Scholar
  45. 45.
    Johansen, R., Sibbet, D., Benson, S., Martin, A., Mittman, R., Saffo, P.: Leading Business Teams. Addison-Wesley, Reading (1991)Google Scholar
  46. 46.
    Johnson, P.: Reegineering Inspection. Communications of ACM 41, 49–52 (1998)CrossRefGoogle Scholar
  47. 47.
    Koch, M., Koch, J.: Application of Frameworks in Groupware—the Iris Group Editor Environment. ACM Computing Surveys (CSUR) 32 (2000)Google Scholar
  48. 48.
    Kock, N.: Media Richness or Media Naturalness? The Evolution of Our Biological Communication Apparatus and Its Influence on Our Behavior toward E-Communication Tools. IEEE Transactions on Professional Communications 48, 117–130 (2005)CrossRefGoogle Scholar
  49. 49.
    Kristoffersen, S., Ljungberg, F.: Your Mobile Computer Is a Stationary Computer. In: CSCW 1998 Handheld CSCW Ws., Seattle, USA (1998)Google Scholar
  50. 50.
    Laitenberger, O., DeBaud, J.: An Encompassing Life-Cycle Centric Survey of Software Inspection. The Journal of Systems & Software 50, 5–31 (2000)CrossRefGoogle Scholar
  51. 51.
    Liechti, O.: Supporting Social Awareness on the World Wide Web with the Handheld Cyberwindow. In: Ws. on Handheld CSCW at CSCW 1998, Seattle, USA (1998)Google Scholar
  52. 52.
    MacEachren, A., Brewer, I.: Developing a Conceptual Framework for Visually-Enabled Geocollaboration. Int. Journal of Geographical Information Science 18, 1–34 (2004)CrossRefGoogle Scholar
  53. 53.
    MacMillan, J., Paley, M., Entin, E.: Questionnaires for Distributed Assessment of Team Mutual Awareness. In: Salas (ed.) Handbook of Human Factors and Ergonomic Methods, pp. 3–32. Taylor & Francis, Abington (2004)Google Scholar
  54. 54.
    Mills, H., Dyer, M., Linger, R.: Cleanroom Software Engineering. IEEE Software 4, 19–25 (1987)CrossRefGoogle Scholar
  55. 55.
    Nacenta, M., Pinelle, D., Stuckel, D., Gutwin, C.: The Effects of Interaction Technique on Coordination in Tabletop Groupware. In: Graphics Interface 2007, pp. 191–198. ACM Press, New York (2007)CrossRefGoogle Scholar
  56. 56.
    Pinelle, D., Gutwin, C.: Groupware Walkthrough: Adding Context to Groupware Usability Evaluation. In: Proc. SIGCHI Conf. on Human factors in computing systems, pp. 455–462. ACM Press, Minneapolis (2002)Google Scholar
  57. 57.
    Rodden, T., Blair, G.: CSCW and Distributed Systems: The Problem of Control. In: Proc. 2nd Conf. on European Conf. on Computer-Supported Coop. Work, pp. 49–64. Kluwer, Dordrecht (1991)Google Scholar
  58. 58.
    Rodden, T.: Populating the Application: A Model of Awareness for Cooperative Applications. In: ACM Conf. on Computer Supported Coop. Work, pp. 87–96. ACM Press, New York (1996)Google Scholar
  59. 59.
    Sacramento, V., Endler, M., Rubinsztejn, H., Lima, L.S., Goncalves, K., Nascimento, F., Bueno, G.: Moca: A Middleware for Developing Collaborative Applications for Mobile Users. IEEE Distributed Systems Online 5 (2004)Google Scholar
  60. 60.
    Snowdon, D., Munro, A. (eds.): Collaborative Virtual Environments: Digital Places and Spaces for Interaction. Springer, New York (2000)Google Scholar
  61. 61.
    Tang, J.: Findings from observational studies of collaborative work. International Journal of Man-Machine Studies 34, 143–160 (1991)CrossRefGoogle Scholar
  62. 62.
    Vizcaíno, A., Martinez, M., Aranda, G., Piattini, M.: Evaluating Collaborative Applications from a Knowledge Management Approach. In: 14th WETICE 2005, pp. 221–225. IEEE Press, Los Alamitos (2005)Google Scholar
  63. 63.
    Weick, K.: Making Sense of the Organization. Blackwell, Oxford (2001)Google Scholar
  64. 64.
    Weick, K.: The Collapse of Sensemaking in Organizations: The Mann Gulch Disaster. Administrative Science Quarterly 38, 628–652 (1993)CrossRefGoogle Scholar
  65. 65.
    Yanco, H., Drury, J.: “Where Am I?” Acquiring Situation Awareness Using a Remote Robot Platform. IEEE Conf. on Systems, Man and Cybernetics 3, 2835–2840 (2004)Google Scholar
  66. 66.
    Zhang, W., Hill, R.: A Template-Based and Pattern-Driven Approach to Situation Awareness and Assessment in Virtual Humans. In: 4th Int. Conf. on Autonomous Agents, pp. 116–123 (2000)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Pedro Antunes
    • 1
  • Claudio Sapateiro
    • 1
  • Jose A. Pino
    • 2
  • Valeria Herskovic
    • 2
  • Sergio F. Ochoa
    • 2
  1. 1.Department of Informatics of the Faculty of SciencesLisbonPortugal
  2. 2.Computer Science DepartmentUniversidad de ChileSantiagoChile

Personalised recommendations