Evaluating Accessibility and Usability of an Experimental Situational Awareness Room

  • Terje GjøsæterEmail author
  • Jaziar Radianti
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 776)


New advanced emergency management facilities such as a control room which is equipped with advanced ICT technologies should consider universal design principles and ensure the accessibility and usability of some important technical functions available in the room. This paper aims at evaluating the accessibility and usability of an experimental control room. This room has a flexible architecture, i.e., the information displays are interchangeable through drag-drop system on a control-panel. We used a complementary heuristic and user testing approach. A video analysis, open questionnaire and discussion with testers were applied to detect technology usage barriers. The results show that the proprietary control tablet and its setup has some room for improvement. Our approach can examine the sources of difficulties of our testers, especially on linking the information sources, machines and wall or desk displays. Several recommendations are outlined to be a basis for developing guidelines for future usage of this room.


Control room Situational awareness Universal design Testing Accessibility Usability Heuristic testing User testing 


  1. 1.
    Brehmer, B.: Command and control as design. In: 15th International Command and Control Research and Technology Symposium (ICCRTS) 2010, US DoD Command and Control Research Program, US (2010)Google Scholar
  2. 2.
    Ryan, M.: Planning in the emergency operations center. Technol. Forecast. Soc. Chang. 80(9), 1725–1731 (2013)CrossRefGoogle Scholar
  3. 3.
    Jensen, J., Thompson, S.: The incident command system: a literature review. Disasters 40(1), 158–182 (2016)CrossRefGoogle Scholar
  4. 4.
    Giri, J., et al.: The situation room: control center analytics for enhanced situational awareness. IEEE Power Energ. Mag. 10(5), 24–39 (2012)CrossRefGoogle Scholar
  5. 5.
    Koskinen, H., Norros, L.: Expanding control room–a new frame for designing spatial affordances of control places, VTT (2010)Google Scholar
  6. 6.
    Padilha, R.P., et al.: The design of collaboration support between command and operation teams during emergency response. In: 2010 14th International Conference on Computer Supported Cooperative Work in Design (CSCWD). IEEE (2010)Google Scholar
  7. 7.
    Endsley, M.R.: Designing for situation awareness: an approach to user-centered design. CRC Press (2016)Google Scholar
  8. 8.
    May, A., Mitchell, V., Piper, J.: A user centred design evaluation of the potential benefits of advanced wireless sensor networks for fire-in-tunnel emergency response. Fire Saf. J. 63, 79–88 (2014)CrossRefGoogle Scholar
  9. 9.
    Kim, S.K., et al.: Empirical research on an ecological interface design for improving situation awareness of operators in an advanced control room. Nucl. Eng. Des. 253, 226–237 (2012)CrossRefGoogle Scholar
  10. 10.
    Hughes, J., et al.: Moving out from the control room: ethnography in system design. In: Proceedings of the 1994 ACM Conference on Computer Supported Cooperative Work. ACM (1994)Google Scholar
  11. 11.
    Nixon, M.J., Beoughter, K.J., Christensen D.D.: Method and apparatus for seamless state transfer between user interface devices in a mobile control room, Google Patents (2017)Google Scholar
  12. 12.
    Lee, H.-C., Lee, G.: Prototype of operator interface for monitoring and controlling in the mobile control room. In: Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces. ACM (2013)Google Scholar
  13. 13.
    Williams, A.: Putting it on display: the impact of visual information on control room dynamics. J. Art Rec. Prod. 6 (2012)Google Scholar
  14. 14.
    Shen, M., et al.: Emergency management information systems: could decision makers be supported in choosing display formats? Decis. Support Syst. 52(2), 318–330 (2012)CrossRefGoogle Scholar
  15. 15.
    Lundberg, J., Törnqvist, E., Nadjm-Tehrani, S.: Resilience in sensemaking and control of emergency response. Int. J. Emerg. Manage. 8(2), 99–122 (2012)CrossRefGoogle Scholar
  16. 16.
    Middleton, S.E., Middleton, L., Modafferi, S.: Real-time crisis mapping of natural disasters using social media. IEEE Intell. Syst. 29(2), 9–17 (2014)CrossRefGoogle Scholar
  17. 17.
    Bharosa, N., Lee, J., Janssen, M.: Challenges and obstacles in sharing and coordinating information during multi-agency disaster response: propositions from field exercises. Inf. Syst. Front. 12(1), 49–65 (2010)CrossRefGoogle Scholar
  18. 18.
    Ikuma, L.H., et al.: A guide for assessing control room operator performance using speed and accuracy, perceived workload, situation awareness, and eye tracking. J. Loss Prev. Process Ind. 32, 454–465 (2014)CrossRefGoogle Scholar
  19. 19.
    Boring, R., et al.: Operator Performance Metrics for Control Room Modernization: A Practical Guide for Early Design Evaluation. INL/EXT-14-31511, Idaho National Laboratory, Idaho Falls (2014)Google Scholar
  20. 20.
    Pew, R., Miller, D., Feeher, C.: Evaluation of proposed control room improvements through analysis of critical operator decisions. Final report. Bolt, Beranek and Newman, Inc., Cambridge, MA (1981)Google Scholar
  21. 21.
    Roth, E.M., et al.: Person-in-the-loop testing of a digital power plant control room. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2010. SAGE Publications, Los Angeles, CA (2010)CrossRefGoogle Scholar
  22. 22.
    Boring, R.L., et al.: Early-stage design and evaluation for nuclear power plant control room upgrades. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2014. SAGE Publications, Los Angeles, CA (2014)Google Scholar
  23. 23.
    Bastien, J.C.: Usability testing: a review of some methodological and technical aspects of the method. Int. J. Med. Inf. 79(4), e18–e23 (2010)CrossRefGoogle Scholar
  24. 24.
    Nielsen, J.: 10 usability heuristics for user interface design. Nielsen Norman Gr. 1(1) (1995)Google Scholar
  25. 25.
    Friess, E.: Personas in heuristic evaluation: an exploratory study. IEEE Trans. Prof. Commun. 58(2), 176–191 (2015)CrossRefGoogle Scholar
  26. 26.
    Radianti, J., Gjøsæter, T., Chen, W.: Universal design of information sharing tools for disaster risk reduction. In: ITDRR 2017. Springer, Sofia, Bulgaria (2017)Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Oslo Metropolitan UniversityOsloNorway
  2. 2.Centre for Integrated Emergency Management (CIEM), University of AgderKristiansandNorway

Personalised recommendations