Skip to main content
SpringerLink
Log in
Book cover

Simulator-based Human Factors Studies Across 25 Years pp 57–74Cite as

Methodological Challenges in HAMMLAB

  • Conference paper
  • First Online:

  • 739 Accesses

Abstract

Classical experimental methods have to be adjusted and expanded to serve the simulator studies in HAMMLAB. Experiences from this methodological development process are presented in this chapter, focusing on insights from experimental design and human performance measurement.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    From a technical point of view, ‘realism’ should be understood as external validity and/or ecological validity, i.e., the generalizability of findings to populations of subjects, settings, times, and behaviour in real life (see Chap. 3).

  2. 2.

    Statistical power is the ability of an experimental design or inferential statistic to detect an effect.

References

  • American Institute of Aeronautics and Astronautics (1992) Guide to human performance measurement (AIAA Publication No G-035-1992). AIAA, Washington, DC

    Google Scholar 

  • Andresen G, Drøivoldsmo A (2000) Human performance assessment: methods and measures (HPR-353). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Andresen G, Strand S (2007) Usability questionnaires and human system interface evaluations: review of standardize questionnaires and lessons learned from HAMMLAB (HWR-856). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Andresen G, Svengren H, Heimdal J, Nilsen S, Hulsund JE, Bisio R, Debroise X (2004) Procedure automation: the effect of automated procedure execution on situation awareness and human performance (HWR-759). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Baker S, Hollnagel E, Marshall E, Øwre F (1985a) An experimental comparison of three computer based alarm systems: design, procedure and execution (HWR-134). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Baker S, Gertman D, Hollnagel E, Holmstrøm C, Marshall E, Øwre F (1985b) An experimental comparison of three computer-based alarm systems—results and conclusions (HWR-142). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Braarud PØ (1998) Complexity factors and prediction of crew performance (HWR-521). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Braarud PØ (2000) Subjective task complexity in the control room (HWR-621). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Braarud PØ, Brendryen H (2001) Task demand, task management, and teamwork (HWR-657). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Braarud PØ, Ludvigsen JT (2002) Experimental study of the effect of task priority and coordination strategy on crew performance (HWR-704). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Bye A, Laumann K, Braarud P, Massaiu S (2006) Methodology for improving HRA by simulator studies. In: PSAM8, proceedings of the 8th international conference on probabilistic safety assessment and management, New Orleans, Louisiana, pp 205–209

    Google Scholar 

  • Collier S (1998) Development of a diagnostic complexity questionnaire (HWR-536). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Collier S, Andresen G (2000) A second study of the prediction of cognitive errors using the “CREAM” technique (HWR-625). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Cook TD, Campbell DT (1979) Quasi-experimentation: design and analysis issues for field settings. Rand McNally, Chicago

    Google Scholar 

  • Cronbach LJ (1990) Essentials of psychological testing, 5th edn. HarperCollins, New York

    Google Scholar 

  • Drøivoldsmo A, Skraaning G, Sverrbo M, Dalen J, Grimstad T, Andresen G (1998) Continuous measures of situation awareness and workload (HWR-539). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Drury C (1992) Do speed and accuracy trade off? In: Proceedings of the 28th annual conference on unlocking the potential for the future productivity and quality of life, Melbourne, Australia

    Google Scholar 

  • Follesø K, Volden FS (1993) Lessons learned on test and evaluation from test and evaluation activities performed at the OECD Halden reactor project (HWR-336). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Follesø K, Drøivoldsmo A, Kaarstad M, Collier S, Kirwan B (1995) Human error—the third pilot study (HWR-430). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Follesø K, Kaarstad M, Drøivoldsmo A, Hollnagel E, Kirwan B (1996) Practical insights from initial studies related to the Human Error Analysis Project (HEAP) (HWR-459). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Grimstad T, Andresen G, Skjerve AB (2000) Human-centred automation programme: review of experiment related studies (HWR-628). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Heidegger M (1926) Being and time. Blackwell, Oxford

    Google Scholar 

  • Hogg DN, Follesø K, Torralba B, Volden FS (1994) Measurement of the operator’s situation awareness for use within process control research: four methodological studies (HWR-377). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Hopkin VD (1995) Human factors in air traffic control. Taylor & Francis, London

    Google Scholar 

  • Howell DC (1997) Statistical methods for psychology, 4th edn. Wadsworth, CA

    Google Scholar 

  • Jones JL (1995) Understanding psychological science. HarperCollins, New York

    Google Scholar 

  • Kaarstad M, Andresen A (2001) Performance recovery and goal conflict (HWR-653). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Kaarstad M, Kirwan B, Follesø K, Endestad T, Torralba B (1994) Human error—the first pilot study (HWR-417). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Kaarstad M, Follesø K, Collier S, Hauland G, Kirwan B (1995) Human error—the second pilot study (HWR-421). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Kaarstad M, Hollnagel E, Lee H (1998) Human error analysis project (HEAP)—report from main experiment (HWR-540). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Kirk RE (1995) Experimental design: procedures for the behavioral sciences, 3rd edn. Brooks Cole, Pacific Grove

    MATH  Google Scholar 

  • Laumann K, Braarud PØ, Svengren H (2005) The task complexity experiment 2003/04 (HWR-758). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Massaiu S, Skjerve AB, Skraaning G, Strand S, Wærø I (2004) Studying human-automation interactions: methodological lessons learned from the human-centred automation experiments 1997–2001 HWR-760). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Montgomery DC (1997) Design and analysis of experiments. Wiley, New York

    MATH  Google Scholar 

  • Moracho MJ (1998) Plant performance assessment system (PPAS) for crew performance evaluations. Lessons learned from an alarm study conducted in HAMMLAB (HWR-504). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Murphy KR, Davidshofer CO (1991) Psychological testing: principles and applications. Englewood Cliffs, Prentice-Hall

    Google Scholar 

  • Neale JM, Liebert RM (1986) Science and behavior: an introduction to methods of research. Englewood Cliffs, Prentice-Hall

    Google Scholar 

  • O’Hara JM, Brown WS, Hallbert B, Skraaning G, Persensky JJ, Wachtel J (2000) The effects of alarm display, processing and availability on crew performance (NUREG/CR-6691). US Nuclear Regulatory Commission

    Google Scholar 

  • Parkes JT (1998) Reducing task-related variance in performance assessment using concept maps. Thesis in educational psychology. Pennsylvania State University, USA

    Google Scholar 

  • Rasmussen J (1987) Reasons, causes, and human error. In: Rasmussen J, Duncan K, Leplat J (eds) New technology and human error. Wiley, Chichester

    Google Scholar 

  • Rouse WB, Cannon-Bowers JA, Salas E (1992) The role of mental models in team performance in complex systems. IEEE Trans Syst Man Cybern 22(6):1296–1308

    Article  Google Scholar 

  • Skjerve AB (2002) The Halden co-operation scale. Human-automation co-operation in control room settings (HWR-685). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Skjerve AB, Skraaning G (2004) The Quality of human-automation cooperation in human-system interface for nuclear power plants. Int J Hum Comput Stud 61:649–677

    Article  Google Scholar 

  • Skjerve AB, Andresen G, Saarni R, Skraaning G (2001a) The influence of automation malfunctions on operator performance. Study plan for the human-centred automation 2000 experiment (HWR-659). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Skjerve AB, Andresen G, Saarni R, Skraaning G, Brevig L (2001b) Human-centred automation 2000 experiment. Preliminary results (HWR-660). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Skjerve AB, Strand S, Saarni R, Skraaning G (2002) The influence of automation malfunctions and interface design on operator performance. The HCA-2001 experiment (HWR-686). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Skjerve AB, Strand S, Skraaning G, Nihlwing C, Helgar S, Olsen A, Kvilesjø HØ, Meyer G, Drøivoldsmo A, Svengren H (2005a) The extended teamwork 2004/2005 exploratory study. Study plan (HWR-791). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Skjerve AB, Strand S, Skraaning G, Nihlwing C (2005b) The extended teamwork 2004/2005 exploratory study. Preliminary results (HWR-812). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Skraaning G (1998) The operator performance assessment system (OPAS) (HWR-538). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Skraaning G (2003) Experimental control versus realism: methodological solutions for simulator studies in complex operating environments (HPR-361). OECD Halden Reactor Project, Dr. philos. dissertation NTNU, Trondheim, Norway Human Performance. OECD Halden Reactor Project, Halden

    Google Scholar 

  • Skraaning G, Lau N, Welch R, Nihlwing C, Andresen G, Brevig LH, Veland Ø, Jamieson G, Burns CM, Kwok J (2007) The ecological interface design experiment (2005) (HWR-833). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Stanton N (1996) Simulators: a review of research and practice. In: Stanton N (ed) Human factors in nuclear safety. Taylor & Francis, London

    Chapter  Google Scholar 

  • Strand S (2001) Trust and automation: the influence of automation malfunctions and system feedback on operator trust (HWR-643). OECD Halden Reactor Project, Halden

    Google Scholar 

  • Wioland L, Kaarstad M, Skraaning G (2000) Error detection and recovery—results from experiment 1997 (HWR-622). OECD Halden Reactor Project, Halden

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. OECD Halden Reactor Project, Institutt for Energiteknikk, Halden, Norway

    Gyrd Skraaning Jr. & Maren Helene Rø Eitrheim

Authors
  1. Gyrd Skraaning Jr.
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Maren Helene Rø Eitrheim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gyrd Skraaning Jr. .

Editor information

Editors and Affiliations

  1. , OECD Halden Reactor Project, Institute for Energy Technology, Halden, 1751, Norway

    Ann Britt Skjerve

  2. , OECD Halden Reactor Project, Institute for Energy Technology, Halden, 1751, Norway

    Andreas Bye

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag London Limited

About this paper

Cite this paper

Skraaning, G., Rø Eitrheim, M.H. (2010). Methodological Challenges in HAMMLAB. In: Skjerve, A., Bye, A. (eds) Simulator-based Human Factors Studies Across 25 Years. Springer, London. https://doi.org/10.1007/978-0-85729-003-8_4

Download citation

  • DOI: https://doi.org/10.1007/978-0-85729-003-8_4

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-0-85729-002-1

  • Online ISBN: 978-0-85729-003-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation