Acta Oceanologica Sinica

, Volume 32, Issue 9, pp 74–81

Development of a skill assessment tool for the Korea operational oceanographic system

  • Kyoung-Ho Cho
  • Jin-Yong Choi
  • Sang-Hun Jeong
  • Jung-Woon Choi
  • Jae-Il Kwon
  • Kwang-Soon Park
Article

DOI: 10.1007/s13131-013-0354-9

Cite this article as:
Cho, KH., Choi, JY., Jeong, SH. et al. Acta Oceanol. Sin. (2013) 32: 74. doi:10.1007/s13131-013-0354-9
  • 46 Downloads

Abstract

A standard skill assessment (SA) tool was developed and implemented to evaluate the performance of operational forecast models in the Korea operational oceanographic system. The SA tool provided a robust way to assess model skill in the system by comparing predictions and observations, and involved the computation of multiple skill metrics including correlation and error skills. User- and system-based acceptance criteria of skill metrics were applied to determine whether predictions were acceptable for the system. To achieve this, the tool produced a time series comparison plot, a skill score table, and an advanced summarized diagram to effectively demonstrate the multiple skill scores. Moreover, the SA was conducted to evaluate both atmospheric and hydrodynamic forecast variables. For the atmospheric variables, acceptable error criteria were preferable to acceptable correlation criteria over short timescales, since the mean square error overwhelmed the observation variance. Conversely, for the hydrodynamic variables, acceptable root mean square percentage error (e.g., perms) criteria were preferable to acceptable error (e.g., erms) criteria owing to the spatially variable tidal intensity around the Korean Peninsula. Furthermore, the SA indicated that predetermined acceptance error criteria were appropriate to satisfy a target central frequency (fc) for which errors fell within the specified limits (i.e., the fc equals 70%).

Key words

skill assessment tool operational forecast system Korea operational oceanographic system 

Copyright information

© The Chinese Society of Oceanography and Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Kyoung-Ho Cho
    • 1
  • Jin-Yong Choi
    • 1
  • Sang-Hun Jeong
    • 1
  • Jung-Woon Choi
    • 1
  • Jae-Il Kwon
    • 1
  • Kwang-Soon Park
    • 1
  1. 1.Coastal Disaster Research CenterKorea Institute of Ocean Science and TechnologyAnsanRepublic of Korea

Personalised recommendations