Skip to main content
SpringerLink
Log in

Work load evaluation method for engine-room resource management training: a quantitative approach

  • IAMU Section Article
  • Published:
WMU Journal of Maritime Affairs Aims and scope Submit manuscript

Abstract

The requirements concerning engine room resource management (ERM) have been introduced as mandatory requirements for engineers. The fundamental procedure of ERM training and evaluation methods is introduced in the International Maritime Organization (IMO) model course, and several studies have been carried out by maritime education institutes and universities. This study aims to propose a work load evaluation method and a quantitative evaluation method for non-technical skills of the participants regarding ERM training. The work load during training was evaluated through an objective evaluation using the VACP (visual, auditory, cognitive, and psychomotor) method and compared with a subjective evaluation applying the NASA-Task Load Index (NASA-TLX). The quantitative evaluation of non-technical skills was evaluated by 16 evaluators. The non-technical skill evaluation form is referred to as the IMO model course 2.07 2017 Edition evaluation. The results of the work load evaluation indicated that the proposed objective evaluation method can describe the work load of participants in different roles and their performance during ERM training. Further, the results of the quantitative evaluation method indicate the difference in score of non-technical skills on the roles and tasks of the participants by comparing the evaluation criteria. The relationship between the work load and non-technical skills was investigated, and the effectiveness of both the work load evaluation method and quantitative evaluation method during ERM training was discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  • Barnett M, Gatfield D, Pekcan C (2006) Non-technical skills: the vital ingredient in world maritime technology? In Proceedings of the International Conference on World Maritime Technology. London: institute of Marine Engineering, Science and Technology (IMarEST)

  • Bierbaum CR, Szabo SM, Aldrich TB (1989) Task analysis of the UH-60 mission and decision rules for developing a UH-60 workload prediction model: summary report. Vol. 1. US Army Research Institute for the Behavioral and Social Sciences

  • Fátima PS (2014) Mental workload, task demand and driving performance: what Relation? Procedia Soc Behav Sci 62:310–319. https://doi.org/10.1016/j.sbspro.2014.12.212

    Article  Google Scholar 

  • Flin R, Martin L, Goeters K, Hoermann J, Amalberti R, Valot C, Nijhuis H (2003) Development of the NOTECHS (non-technical skills) system for assessing pilots’ CRM skills. Human Factors and Aerospace Safety 3:95–117

    Google Scholar 

  • Gatfield D (2012) Text for engine-room resource management. The Maritime Human Resource Institute, Japan

  • Hart SG, Staveland LE (1988) Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Adv Psychol 52:139–183. https://doi.org/10.1016/S0166-4115(08)62386-9

    Article  Google Scholar 

  • Hetherington C, Flin R, Mearns K (2006) Safety in shipping: the human element. J Saf Res 37(4):401–411. https://doi.org/10.1016/j.jsr.2006.04.007

    Article  Google Scholar 

  • Hjelmervik K, Nazir S, Myhrvold A (2018) Simulator training for maritime complex tasks: an experimental study. WMU J Marit Affairs 17:17–30. https://doi.org/10.1007/s13437-017-0133-0

    Article  Google Scholar 

  • Horiki S, Kojima M, Tsukamoto T (2014) Engine-room simulator for ETM/ERM training at faculty of marine technology. J JIME 49(3):370–372. https://doi.org/10.5988/jime.49.288

    Article  Google Scholar 

  • International Maritime Organization (2010) Standards regarding engine department. Convention on Standards of Training, Certification and Watchkeeping for Seafarers, London

    Google Scholar 

  • International Maritime Organization (2017) Model Course 2.07 Engine-room Simulator 2017 Edition. London

  • Ito T, Yamazaki K (2016) A study of a driver model using unconscious driving behaviors. Procedia Computer Science 96:754–761. https://doi.org/10.1016/j.procs.2016.08.260

    Article  Google Scholar 

  • Kandemir C, Akyuz E, Celik M (2015) Investigation of an ERS functionality to conduct human error assessment studies comply with the STCW’2010 requirements. Proceedings of 12th International Conference on Engine Room Simulators (ICERS12):101–106

  • Lochner M, Duenser A, Lutzhoft MH, Brooks BP, Rozado D (2018) Analysis of maritime team workload and communication dynamics in standard and emergency scenarios. J Shipping and Trade 3(2):1–22. https://doi.org/10.1186/s41072-018-0028-z

    Article  Google Scholar 

  • Lützhöft M, Grech MR, Porathe T (2011) Information environment, fatigue, and culture in the maritime domain. Rev Hum Factors Ergo 7(1):280–322. https://doi.org/10.1177/1557234X11410391

    Article  Google Scholar 

  • McCracken JH, Aldrich TB (1984) Analyses of selected LHX mission functions: Implications for operator workload and system automation goals. Army Research Institute Aviation Research and Development Activity. https://doi.org/10.21236/ada232330

  • Melcher Z, Marit W, Fenneke B, Devid B (2014) Development of future scenarios by prediction of mental workload in a traffic management control room. Proceedings of 11th International Symposium on Human Factors in Organizational Design and Management (ODAM). http://doi.org/https://doi.org/10.4122/dtu:2379

  • Murai K, Hayashi Y, Nagata N, Inokuchi S (2003) Mental workload of ship’s navigator, a few comments on heart rate variability during navigational watch keeping, knowledge-based intelligent information and engineering systems, 7th International Conference, Proceedings,897–903

  • Pfeffer S, Decker P, Maier T, Stricker E (2013) Estimation of operator input and output workload in complex human-machine-systems for usability issues with iflow, In International Conference on Engineering Psychology and Cognitive Ergonomics (EPCE). Lect Notes Comput Sci 8019:167–176. https://doi.org/10.1007/978-3-642-39360-0_19

  • Reid, G.B. and Nygren, T.E. (1988). The subjective workload assessment technique: a scaling procedure for measuring mental workload. Human Mental Workload. P.A.M. Hancock, N. Amsterdam, Elsevier Science Publishers B.V. (North-Holland): 185–218

  • Saeed F, Wall A, Roberts C et al (2017) A proposed quantitative methodology for the evaluation of the effectiveness of human element, leadership and management (HELM) training in the UK. WMU J Marit Affairs 16:115–138. https://doi.org/10.1007/s13437-016-0107-7

    Article  Google Scholar 

  • Tsoukalas VD, Papachristos DA, Tsoumas NK et al (2008) Marine engineers’ training: educational assessment for an engine room simulator. WMU J Marit Affairs 7:429–448. https://doi.org/10.1007/BF03195143

    Article  Google Scholar 

  • Uchida N, Sekimoto N, Takada S, Mori N (2015) A study of driver workload estimation by the VACP method. Transactions of Society of Automotive Engineers of Japan. 46 (6): 1171–1176. https://doi.org/10.11351/jsaeronbun.46.1171

  • Wu Y, Miwa T, Shimamoto K, Uchida M (2015) Development of quantitative team performance evaluation method for ERM. WMU J Marit Aff 14:333–347. https://doi.org/10.1007/s13437-015-0088-y

    Article  Google Scholar 

  • Wu Y, Miwa T, Uchida M (2017) Using physiological signals to measure operator’s mental workload in shipping – an engine room simulator study. Proc Inst Mar Eng Ence Technol 16:61–69

    Article  Google Scholar 

  • Zincir B, Dere C, Deniz C (2017). Scenario based assessment method for engine room simulator courses. Proceedings of 13th International Conference on Engine Room Simulators (ICERS13):165–171

Download references

Acknowledgements

The author would like to thank Mr. Daiichi Aburagi and the 16 students at the Graduate School of Maritime Sciences, Kobe University, for completing the experiment, as well as the 16 evaluators who kindly completed the evaluation, for completing this quantitative research.

Funding

This work was supported by the JSPS KAKENHI (Grant No. 17K06964).

Author information

Authors and Affiliations

  1. Graduate School of Maritime Sciences, Kobe University, 5-1-1, Fukae, Higashinada, Kobe, 658-0022, Japan

    Tatsuro Ishida, Takashi Miwa & Makoto Uchida

Authors
  1. Tatsuro Ishida
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Takashi Miwa
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Makoto Uchida
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tatsuro Ishida.

Additional information

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

*Proceedings of the International Association of Maritime Universities (IAMU) Conference, Technological Impact pp158-167

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ishida, T., Miwa, T. & Uchida, M. Work load evaluation method for engine-room resource management training: a quantitative approach. WMU J Marit Affairs 20, 335–355 (2021). https://doi.org/10.1007/s13437-021-00245-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13437-021-00245-z

Keywords

Search

Navigation