Pilot Scenario Design for Evaluating a Metacognitive Skills Learning Dialogue System

  • Dimitris Spiliotopoulos
  • Olga Petukhova
  • Dimitris Koryzis
  • Maria Aretoulaki
Part of the Communications in Computer and Information Science book series (CCIS, volume 435)


This work describes the experimentation on the application of evaluation methodologies for creating metrics that evaluate the experience of the users of the Metalogue system as they learn and using them to validate the effective ability of the system to assess them. Pilot scenarios were formulated in order to effectively train the system to train the users on metacognitive skills learning. Usability design common approaches, such as focus groups and user experience needfinding sessions were used to collect the data.


TEL multimodal interaction usability evaluation 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Paris, S.G., Winograd, P.: How metacognition can promote academic learning and instruction. Dimensions of Thinking and Cognitive Instruction 1, 15–51 (1990)Google Scholar
  2. 2.
    Magaldi, L.G.: Metacognitive Strategies Based Instruction to Support Learner Autonomy in Language Learning. Revistacanaria de Estudiosingleses (61), 73–86 (2010)Google Scholar
  3. 3.
    Marshall-Mies, J.C., Fleishman, E.A., Martin, J.A., Zaccaro, S.J., Baughman, W.A., McGee, M.L.: Development and evaluation of cognitive and metacognitive measures for predicting leadership potential. The Leadership Quarterly 11(1), 135–153 (2000)CrossRefGoogle Scholar
  4. 4.
    Magno, C.: The role of metacognitive skills in developing critical thinking. Metacognition and Learning 5(2), 137–156 (2010)CrossRefGoogle Scholar
  5. 5.
    Cohen, M.S., Freeman, J.T., Thompson, B.: Critical thinking skills in tactical decision making: A model and a training strategy. In: Making Decisions Under Stress: Implications for Individual and Team Training, pp. 155–190 (1998)Google Scholar
  6. 6.
    McLoughlin, C., Hollingworth, R.: The weakest link: Is web-based learning capable of supporting problem-solving and metacognition. In: 18th Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education, pp. 9–12 (December 2001)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Dimitris Spiliotopoulos
    • 1
  • Olga Petukhova
    • 2
  • Dimitris Koryzis
    • 3
  • Maria Aretoulaki
    • 4
  1. 1.Interaction Design LabUniversity of PeloponneseGreece
  2. 2.University of SaarlandGermany
  3. 3.Hellenic ParliamentGreece
  4. 4.DialogConnectionUK

Personalised recommendations