What Makes Situational Informatics Tasks Difficult?

  • Jiří Vaníček
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9973)


Organizers of the informatics contest Bebras in many countries face the obstacle of how to state the difficulty of contest tasks and problems accurately. This is essential if tasks with good prediction of success are to be selected for the contest.

The paper discusses five different indicators of a contest task difficulty. We study which of the indicators are correlated. Index of task difficulty was defined as a combination of indicators with the aim of pinpointing the factors that have impact on a contest task difficulty. The index has been constructed on the basis of calculations from some of these indicators.

Using statistical analysis of data from Czech Beaver of Informatics contest we try to assess if some of the proposed factors can be reliable indicators of whether a task is more or less difficult. The findings show that there is a provable link between a task difficulty and the use of formalized description of the task, structuring, optimization, task assignment reading comprehension difficulty and interactivity of answers. The findings of this research study will be useful for organizers of informatics contests as well as school curricula developers.


Bebras Beaver of informatics Situational informatics task Task difficulty Difficulty factors 



The research was supported by the project GAJU 121/2016/S


  1. 1.
    Dagienė, V.: What kinds of tasks are good for contests? In: 6th International Conference on Creativity in Mathematics Education and the Education of Gifted Students, Riga, Latvia, pp. 62–65 (2011). ISBN 9789984453606Google Scholar
  2. 2.
    Tomcsányiová, M., Kabátová, M.: Categorization of pictures in tasks of the Bebras contest. In: Diethelm, I., Mittermeir, R.T. (eds.) ISSEP 2013. LNCS, vol. 7780, pp. 184–195. Springer, Heidelberg (2013). ISBN 978-3-642-36616-1CrossRefGoogle Scholar
  3. 3.
    Pohl, W., Hein, H.-W.: Aspects of quality in the presentation of informatics challenge tasks. In: Jekovec, M. (ed.) The Proceedings of International Conference on Informatics in Schools: Situation, Evolution and Perspectives — ISSEP 2015, pp. 21–32. Založba FRI, Ljubljana (2015)Google Scholar
  4. 4.
    Tomcsányi, P., Vaníček, J.: International comparison of problems from an informatic contest. In: ICTE 2009: Information and Communication Technology in Education 2009, pp. 219–221. University of Ostrava, Ostrava (CZ) (2009). ISBN 978-80-7368-459-4Google Scholar
  5. 5.
    Dagienė, V., Stupurienė, G.: Bebras – a sustainable community building model for the concept based learning of informatics and computational thinking. Inform. Educ. 15(1), 25–44 (2016)CrossRefGoogle Scholar
  6. 6.
    Tomcsányi, P.: Náročnosť úloh v súťaži Informatický bobor (Difficulty of tasks in Informatický bobr contest. In: Konferencia DidInfo 2009. Univerzita Mateja Bela, Banská Bystrica (SK) (2009). ISBN 978-80-8083-720-4Google Scholar
  7. 7.
    Tomcsányiová, M., Tomcsányi, P.: Analýza riešení úloh súťaže iBobor v školskom roku 2013/14. (Analysis of solutions in iBobor contest tasks in 2012/13 year). Konference DidactIG 2014. Technical University, Liberec (CZ) (2014)Google Scholar
  8. 8.
    van der Vegt, W.: Predicting the difficulty level of a Bebras task. Olympiads Inform. 7, 132–139 (2013)Google Scholar
  9. 9.
    Yagunova, E., Podznyakov, S., Ryzhova, N., Razumovskaia, E., Korovkin, N.: Tasks classification and age differences in task perception. Case study of international on-line competition “Beaver”. In: Jekovec, M. (ed.) The Proceedings of International Conference on Informatics in Schools: Situation, Evolution and Perspectives — ISSEP 2015, pp. 33–43. Založba FRI, Ljubljana (2015)Google Scholar
  10. 10.
    Gujberová, M.: Výber úloh do informatickej súťaže iBobor (Collection tasks for informatics contest iBobor. In: Konference DidactIG 2014. Technical Universoty, Liberec (CZ) (2014)Google Scholar
  11. 11.
    Vaníček, J., Křížová, M.: Kritéria obtížnosti testových otázek v informatické soutěži (criteria of informatics contest tasks difficulty). In: Lovászová, G. (ed.) DidInfo 2014, pp. 191–199. Univerzita Mateja Béla, Banská Bystrica (SK) (2014)Google Scholar
  12. 12.
    Šimandl, V.: Odhalování podvádění v online soutěžích (detecting of cheating in online competitions). J. Technol. Inf. Educ. 6(2), 114–121 (2014). ISSN 1803-537XGoogle Scholar
  13. 13.
    Dagienė, V., Futschek, G.: Bebras international contest on informatics and computer literacy: criteria for good tasks. In: Mittermeir, R.T., Sysło, M.M. (eds.) ISSEP 2008. LNCS, vol. 5090, pp. 19–30. Springer, Heidelberg (2008)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  1. 1.University of South Bohemia in České BudějoviceČeské BudějoviceCzech Republic

Personalised recommendations