Skip to main content

Advertisement

SpringerLink
Log in

Proposing a practical training assessment technique to adopt simulators into marine engineering education

  • Article
  • Published:
WMU Journal of Maritime Affairs Aims and scope Submit manuscript

Abstract

In marine engineering programmes, simulators are the key infrastructures to support learning outcomes comply with the designated minimum competencies within the International Convention on Standards of Training, Certification and Watchkeeping for Seafarers (STCW). The practical training concept in full mission engine room simulators (FM-ERSs) includes the key aspects such as competency selection, scenario description, task identification, observation procedure, data gathering, initial condition preparation, briefing, conducting exercises, assessment and debriefing. At this insight, the learning outcomes are highly depending upon assessment system aligning with the knowledge, understanding and proficiency to consistently prove whether the competencies are achieved or not. To achieve a comprehensive competency analysis, this paper offers a methodological approach based on Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) method. The proposed assessment system is demonstrated with different scenarios (i.e. test, start and prepare D/G-II for standby) applied to 16 marine engineering students in a team context. The demonstration study yields the individual performance and team achievements through the given tasks. Consequently, the suggested assessment system contributes to marine engineering competencies in term of enhancing learning outcomes, instructor capability, course and infrastructure development. Furthermore, the assessment approach can be extended to practical studies in other disciplines.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Abbreviations

STCW:

Standards of Training, Certification and Watchkeeping for Seafarers

MET:

maritime education and training

ERS:

engine room simulator

FM-ERS:

full mission engine room simulator

MCDM:

multi-criteria decision making

S/W:

seawater

F/W:

freshwater

T/G:

turbo generator

L/O:

lubricating oil

D/G:

diesel generator

D/O:

diesel oil

F/O:

fuel oil

LTFW:

low-temperature freshwater

HFO:

heavy fuel-oil

M/E:

main engine

References

  • Akyuz E, Celik M (2014) Utilisation of cognitive map in modelling human error in marine accident analysis and prevention. Saf Sci 70(2014):19–28

    Article  Google Scholar 

  • Ali A (2006) Simulator instructor-STCW requirements and reality. Pomorstvo: Sci J Marit Res 20(2):23–32

    Google Scholar 

  • Alimen, R. A. (2013). Engine room simulator (ERS) training course: practicability and essentiality onboard ship. Mar Navig Saf Sea Transport: Marit Transp Shipp, 259

  • Batalden BM, Sydnes AK (2014) Maritime safety and the ISM code: a study of investigated casualties and incidents. WMU J Marit Aff 13(1):3–25

    Article  Google Scholar 

  • Bertram, V. (2015) The role of simulation in design and operation of engine rooms. International Conference on Engine Room Simulators, ICERS12, November 19–20, Turkey, pp:137–141, ISBN:978-605-01-0782-1

  • Cross SJ (2011) Quality MET through quality simulator applications. International Conference IMLA 19 Opatija 2011:127–140

    Google Scholar 

  • Deeley SJ (2017) Using technology to facilitate effective assessment for learning and feedback in higher education. Assessment & Evaluation in Higher Education. https://doi.org/10.1080/02602938.2017.1356906

    Google Scholar 

  • Demirel D et al (2016) A hierarchical task analysis of cricothyroidotomy procedure for a virtual airway skills trainer simulator. Am J Surg 212(Issue 3):475–484

    Article  Google Scholar 

  • Dimitrios G (2014) Engine control simulator as a tool for preventive maintenance. J Marit Res 9(1):39–44

    Google Scholar 

  • García-Cascales MS, Lamata MT (2012) On rank reversal and TOPSIS method. Math Comput Model 56(5):123–132

    Article  Google Scholar 

  • Hwang CL, Yoon K (1981) Multiple attribute decision making: methods and applications. Springer, Berlin

    Book  Google Scholar 

  • IMO, 2010. The Manila Amendments to the Seafarers’ Training, Certification and Watchkeeping (STCW) Code, The 2010 Manila Conference

  • Islam R, Yu H, Abbassi R, Garaniya V, Khan F (2017) Development of a monograph for human error likelihood assessment in marine operations. Saf Sci 91:33–39 ISO 690

    Article  Google Scholar 

  • Jurian, M., Chiotoroiu, L., & Buibas, M. (2006). Work in progress: E-learning impact on Romanian maritime education. Proceedings. Frontiers in Education. 36th Annual Conference, 27–28. https://doi.org/10.1109/FIE.2006.322612

  • Kandemir, C., Akyuz E & Celik M. (2015). Investigation of an ERS functionality to conduct human error assessment studies comply with the STCW’2010 requirements. International Conference on Engine Room Simulators, ICERS12, November 19–20, Turkey, pp:101–106, ISBN:978-605-01-0782-1

  • Kandemir, C., Celik, M. (2017) Identifying training requirements to enhance basic skills for maintenance 4.0 in marine engineering through engine room simulator, 13th International Conference on Engine Room Simulators, 20–21 September 2017, Odessa Maritime Academy, pp: 92–101, ISBN 978-966-7591 -72-4

  • Kaur A, Noman M, Awang-Hashim R (2017) The role of goal orientations in students’ perceptions of classroom assessment in higher education. Assess Eval High Educ. https://doi.org/10.1080/02602938.2017.1359818

  • Kluj, S. (2001). The relation between learning objectives and the appropriate simulator type. In Proceedings of 5th International Conference on Engine Room Simulators: Singapore Polytechnic, Singapore (pp. 25-26)

  • Kluj S (2003) Usability criteria for simulators applied in the maritime engineering education. World Trans Eng Technol Educ 2(3):445–448

    Google Scholar 

  • Lateef M (2009) Simulation-based learning: just like the real thing. J Emerg Trauma Shock 2010 3(4):348–352. https://doi.org/10.4103/0974-2700.70743

    Article  Google Scholar 

  • Martz W (2010) Validating an evaluation checklist using a mixed method design. Eval Program Plann 33(3):215–222

    Article  Google Scholar 

  • Miller GE (1990) The assessment of clinical skills/competence/performance. Acad Med 65(9):S63–S67

    Article  Google Scholar 

  • Nwachukwu B, Gaudiani M, Hammann-Scala J, Ranawat A (2017) A checklist intervention to assess resident diagnostic knee and shoulder arthroscopic efficiency. J Surg Educ 74(1):9–15

    Article  Google Scholar 

  • Pennie, D., Brook-Carter, N., &Gibson, W., 2007. Human factors guidance for maintenance. In: Human factors in ship design, safety and operation conference. The Royal Institution of Naval Architects, London, UK

  • Poudel S et al (2016) Development and validation of a checklist for assessing recorded performance of laparoscopic inguinal hernia repair. Am J Surg 212(3):468–474 ISO 690

    Article  Google Scholar 

  • Reed SJ (2010) Designing a simulation for student evaluation using Scriven’s key evaluation checklist. Clin Simul Nurs 6(2):e41–e44

    Article  Google Scholar 

  • Rewari, S., Bagga, P., Kumar, V., & Bhatia R. (2015). Engine room simulation—next generation solutions (3D immersion, VR displays and more). International Conference on Engine Room Simulators, ICERS12, November 19–20, Turkey, pp:131–135, ISBN:978-605-01-0782-1

  • Rothblum, A. (2000) Human error and marine safety, U.S. Maritime Human Factors Conference

  • Santos, E. M. R., & Galang, G. R. S. (2015). Training of simulator instructors and assessors according to IMO model course 6.10. International Conference on Engine Room Simulators, ICERS12, November 1920, Turkey, pp:19–23, ISBN:978-605-01-0782-1

  • Saremi M et al (2009) TQM consultant selection in SMEs with TOPSIS under fuzzy environment. Expert Syst Appl 36(2009):2742–2749

    Article  Google Scholar 

  • Scalese RJ, Obeso VT, Issenberg SB (2008) Simulation technology for skills training and competency assessment in medical education. J Gen Intern Med 23(1):46–49

    Article  Google Scholar 

  • Scriven, M. (2007). Key evaluation checklist (KEC). Retrieved September, 19, 2007

  • Sellberg C (2017) Simulators in bridge operations training and assessment: a systematic review and qualitative synthesis. WMU J Marit Aff 16(2):247–263

    Article  Google Scholar 

  • Shen H, Zhang J, Cao H, Feng J (2016) Development research of marine engine room simulator for offshore supply vessel based on virtual reality technology. Int J Multimed Ubiquitous Eng 11(5):105–120

    Article  Google Scholar 

  • Stefanidis D et al (2017) Implementation results of a novel comprehensive mental skills curriculum during simulator training. Am J Surg 213(Issue 2):353–361

    Article  Google Scholar 

  • Squire, D. (2005). Competent people make the difference, alert!: the international maritime human element bulletin. The Nautical Institute (Great Britain); Lloyd’s Register of Shipping, London

  • Thatcher S (2007) Scenario-based learning and assessment for second year aviation students. Glob J Eng Educ 11(2):123

    Google Scholar 

  • Tsoukalas VD, Papachristos DA, Tsoumas NK, Mattheu EC (2008) Marine engineers’ training: educational assessment for an engine room simulator. WMU J Marit Aff 7(2):429–448

    Article  Google Scholar 

  • Vaessen BE, van den Beemt A, van de Watering G, van Meeuwen LW, Lemmens L, den Brok P (2017) Students’ perception of frequent assessments and its relation to motivation and grades in a statistics course: a pilot study. Assess Eval High Educ 42(6):872–886

    Article  Google Scholar 

  • Vasilakis, P., & Nikitakos, N. (2011). A methodological framework for evaluating maritime simulation. Navigational systems and simulators: marine navigation and safety of sea Transportation, 147

  • Vinodh S, Prasanna M, Prakash NH (2014) Integrated fuzzy AHP–TOPSIS for selecting the best plastic recycling method: a case study. Appl Math Model 38(19):4662–4672

    Article  Google Scholar 

  • Vos L (2015) Simulation games in business and marketing education: how educators assess student learning from simulations. Int J Manag Educ 13(1):57–74

    Article  Google Scholar 

  • Willhaus J, Burleson G, Palaganas J, Jeffries P (2014) Authoring simulations for high-stakes student evaluation. Clin Simul Nurs 10(4):e177–e182

    Article  Google Scholar 

  • Wu Y, Miwa T, Uchida M (2017) Using physiological signals to measure operator’s mental workload in shipping—an engine room simulator study. J Marine Eng Technol. https://doi.org/10.1080/20464177.2016.1275496

  • Yabuki H (2011) The 2010 Manila amendments to the STCW convention and code and changes in maritime education and training. J Marit Res 1(1):11–17

    Google Scholar 

  • Ziewacz J et al (2011) Crisis checklists for the operating room: development and pilot testing. J Am Coll Surg 213(2):212–217

    Article  Google Scholar 

  • Zhang, Q. F., Sun, J. B., Sun, C. Q., & Shi, C. J. (2014). Marine engine simulation system for crew operation examination based on virtual reality. In Applied mechanics and materials (Vol. 441, pp. 465-469). Trans Tech Publications

  • Zincir, B., Dere, C., Deniz, C. (2017) Scenario based assessment method for engine room simulator courses. 13th International Conference on Engine Room Simulators, 20–21 September 2017, Odessa Maritime Academy, pp: 165–171, ISBN 978–966-7591-72-4

Download references

Author information

Authors and Affiliations

  1. Department of Marine Engineering, Istanbul Technical University, Tuzla, 34940, Istanbul, Turkey

    Cagatay Kandemir & Metin Celik

  2. Department of Maritime Transportation and Management Engineering, Istanbul Technical University, Tuzla, 34940, Istanbul, Turkey

    Omer Soner

Authors
  1. Cagatay Kandemir
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Omer Soner
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Metin Celik
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Cagatay Kandemir.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kandemir, C., Soner, O. & Celik, M. Proposing a practical training assessment technique to adopt simulators into marine engineering education. WMU J Marit Affairs 17, 1–15 (2018). https://doi.org/10.1007/s13437-018-0137-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13437-018-0137-4

Keywords

Search

Navigation