Search-Based Estimation of Problem Difficulty for Humans
Conference paper
Abstract
The research question addressed in this paper is: Given a problem, can we automatically predict how difficult the problem will be to solve by humans? We focus our investigation on problems in which the difficulty arises from the combinatorial complexity of problems. We propose a measure of difficulty that is based on modeling the problem solving effort as search among alternatives and the relations among alternative solutions. In experiments in the chess domain, using data obtained from very strong human players, this measure was shown at a high level of statistical significance to be adequate as a genuine measure of difficulty for humans.
Keywords
human problem solving heuristic search problem difficultyPreview
Unable to display preview. Download preview PDF.
References
- 1.Kotovsky, K., Hayes, J., Simon, H.: Why are some problems hard? Evidence from tower of Hanoi. Cognitive Psychology 17(2), 248–294 (1985)CrossRefGoogle Scholar
- 2.Kenneth Kotovsky, H.A.S.: What makes some problems really hard: Explorations in the problem space of difficulty. Cognitive Psychology 22(2), 143–183 (1990)CrossRefGoogle Scholar
- 3.Pizlo, Z., Li, Z.: Solving combinatorial problems: The 15-puzzle. Memory and Cognition 33(6), 1069–1084 (2005)CrossRefGoogle Scholar
- 4.Dry, M., Lee, M., Vickers, D., Hughes, P.: Human performance on visually presented traveling salesperson problems with varying numbers of nodes. Journal of Problem Solving 1(1), 20–32 (2006)Google Scholar
- 5.Jarušek, P., Pelánek, R.: Difficulty rating of sokoban puzzle. In: Proc. of the Fifth Starting AI Researchers’ Symposium (STAIRS 2010), pp. 140–150. IOS Press (2010)Google Scholar
- 6.Pelánek, R.: Difficulty rating of sudoku puzzles by a computational model. In: Proc. of Florida Artificial Intelligence Research Society Conference (FLAIRS 2011), pp. 434–439. AAAI Press (2011)Google Scholar
- 7.Guid, M., Bratko, I.: Computer analysis of world chess champions. ICGA Journal 29(2), 65–73 (2006)Google Scholar
- 8.Guid, M., Bratko, I.: Using heuristic-search based engines for estimating human skill at chess. ICGA Journal 34(2), 71–81 (2011)Google Scholar
Copyright information
© Springer-Verlag Berlin Heidelberg 2013