Abstract
Corporate and educational settings increasingly address more decision-making, problem-solving and other complex cognitive skills to handle complex cognitive, or heuristic, tasks, but the ever-increasing need for heuristic knowledge has outpaced the refinement of task analysis methods for heuristic expertise. Utilizing the Heuristic Task Analysis (HTA) process, a method developed for eliciting, analyzing, and representing expertise in complex cognitive tasks, a formative research study was conducted on the task of group counseling to further improve the HTA process. Implications of the findings include the need for incorporating various interview strategies and techniques, developing strategies for working with multiple experts, and considering the level of task expertise of the analyst. A revised version of the HTA process is presented based on these implications.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Benbenishty, R. (1992). An overview of methods to elicit and model expert clinical judgment and decision making.Social Science Review, 66(4), 598–616.
Black, J.B., Dimaraki, E., Esselstyn, D., & Flanagan, R.(1995). Using a knowledge representations approach to cognitive task analysis.Proceedings of the 1995 Annual National Convention of the Association for Educational Communications and Technology (AECT).
Brown, A.L. (1992). Design experiments: Theoretical and methodological challenges in creating complex interventions in classroom settings.Journal of the Learning Sciences, 2, 141–178.
Cooke, N.J. (1994). Varieties of knowledge elicitation techniques.International Journal of Human-Computer Studies, 41(6), 801–849.
Cronbach, L.J., & Suppes, P. (Eds.). (1969).Research for tomorrow’s schools: Disciplined inquiry for education. New York: Macmillan.
Davies, I.K. (1981). Task analysis for reliable human performance.Performance and Instruction, 20(2), 4–7.
Dehoney, J. (1995).Cognitive task analysis: Implications for the theory and practice of instructional design. Paper presented at the Association for Educational Communications and Technology, Anaheim, CA.
Design-Based Research Collective. (2003). Design-based research: An emerging paradigm for educational inquiry.Educational Researcher, 32(1), 5–8.
Ericsson, K.A., & Charness, N. (1997). Cognitive and developmental factors in expert performance. In P.J. Feltovich, K.M. Ford, & R.R. Hoffman (Eds.),Expertise in context: Human and machine (pp. 3–41). Menlo Park, CA: American Association for Artificial Intelligence.
Forsythe, D.E., & Buchanan, B.G. (1989). Knowledge acquisition for expert systems: Some pitfalls and suggestions.IEEE Transactions on Systems, Man, and Cybernetics, 19, 435–442.
Fredericksen, N. (1984). Implications of cognitive theory for instruction in problem solving.Review of Educational Research, 7, 38–40.
Gordon, S.E., & Gill, R.T. (1997). Cognitive task analysis. In C.E. Zsambok & G. Klein (Eds.),Naturalistic decision making (pp. 131–140). Mahwah, NJ: Lawrence Erlbaum Assoc.
Hoffman, R.R., Crandall, B., & Shadbolt, N. (1998). Use of the critical decision method to elicit expert knowledge: A case study in the methodology of cognitive task analysis.Human Factors, 40(2), 254–276.
Jones, S.R., Miles, J.C., & Read, M.W. (1996). A comparison of knowledge elicitation methods.Expert Systems, 13(4), 277–295.
Kitto, C.M., & Boose, J.H. (1987).Choosing knowledge acquisition strategies for knowledge acquisition tasks. Paper presented at the WESTEX-87 Western Conference on Expert Systems.
LaFrance, M. (1992). Excavation, capture, collection and creation—Computer scientists’ metaphors for eliciting human expertise.Metaphor and Symbolic Activity, 7(3–4), 135–156.
Lijnse, P.L. (1995). “Developmental research” as a way to an empirically based “didactical structure” of science.Science Education, 79(2), 189–199.
Merriam, S.B. (1998).Qualitative research and case study applications in education. San Francisco: Jossey-Bass, Inc.
Nelson, W.A. (1989). Artificial intelligence knowledge acquisition techniques for instructional development.Educational Technology Research and Development, 37(3), 81–94.
Olson, D.L., Mechitov, A.I., & Moshkovich, H.M. (1995). The role of rules and examples in the process of knowledge acquisition in direct classification tasks.Expert Systems with Applications, 8(1), 203–212.
Olson, J.R., & Biolsi, K.J. (1991). Techniques for representing expert knowledge. In K.A. Ericsson & J. Smith (Eds.),Toward a general theory of expertise (pp. 240–285). Cambridge: Cambridge University Press.
Reigeluth, C.M. (1999). The elaboration theory: Guidance for scope and sequence decisions. In C.M. Reigeluth (Ed.),Instructional-design theories and models: A new paradigm of instructional theory. Mahwah, NJ: Lawrence Erlbaum Associates.
Reigeluth, C.M., & Frick, T.W. (1999). Formative research: A methodology for creating and improving design theories. In C.M. Reigeluth (Ed.),Instructional-design theories and models: A new paradigm of instructional theory (Vol. 2) (pp. 633–651), NJ: Lawrence Erlbaum Associates.
Resnick, L. (1988). Treating mathematics as an ill-structured discipline. In R.I. Charles & E.A. Silver (Eds.),The teaching and assessing of mathematical problem solving (pp. 32–60). Hillsdale, NJ: Lawrence Erlbaum Associates.
Ryder, J.M., & Redding, R.E. (1993). Integrating cognitive task analysis into instructional systems development.Educational Technology Research and Development, 41(2), 75–96.
Schraagen, J.M., Chipman, S.F., & Shalin, V.L. (Eds.). (2000).Cognitive task analysis. Mahwah, NJ: Lawrence Erlbaum Associates, Publishers.
Shaw, M.L.G., & Woodward, J.B. (1989).Mental models in the knowledge acquisition process. Paper presented at the AAAI, Alberta, Canada.
Simon, H.A. (1973). The structure of ill structured problems.Artificial Intelligence, 23, 181–201.
Sommer, E., Morik, K., Andre, J.M., & Uszynski, M. (1994). What on-line machine learning can do for knowledge acquisition—A case study.Knowledge Acquisition, 6(4), 435–460.
Stockton, R., Morran, D.K., & Nitza, A.G. (2000). Processing group events: A conceptual map for leaders.Journal for Specialists in Group Work, 25 (4), 343–355.
Tomlinson, C.M., & Johnson, L. (1994). Notes on techniques developed for knowledge elicitation.Systems Research and Information Science, 6(4), 179–185.
Wenger, E. (1987).Artificial intelligence and tutoring systems. Los Altos, CA: Morgan Kaufmann.
Wielinga, B.J., Schreiber, A.T.H., & Breuker, J.A. (1992). KADS: A modeling to knowledge engineering.Knowledge Acquisition, 4, 5–53.
Wood, L.E., & Ford, J.M. (1993). Structuring interviews with experts during knowledge elicitation.International Journal of Intelligent Systems, 8(1), 71–90.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Lee, JY., Reigeluth, C.M. Formative research on the Heuristic Task Analysis process. ETR&D 51, 5–17 (2003). https://doi.org/10.1007/BF02504541
Issue Date:
DOI: https://doi.org/10.1007/BF02504541