Characteristics and Addressed Challenges in Evaluating the Aniketos Project Outcome

  • Elke Beck
  • Sandra Trösterer
  • Alexander G. Mirnig
  • Manfred Tscheligi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8900)

Abstract

Aside from technical R&D and outreach activities in the Aniketos project, one part of the project work comprised of validation and end user evaluation tasks. We describe the particular characteristics of the Aniketos project evaluation and the overall challenges we encountered during our evaluation tasks. These challenges are structured along four elements of evaluation work; viz., 1) project-internal stakeholders who were doing evaluation work or benefiting from the findings, 2) the developed objects that were evaluated, 3) the development process in which the evaluation process was embedded, and 4) the beneficiaries of the project outcome who participated in evaluation studies. We outline the multi-perspective evaluation approach pursued to address these challenges and to ultimately conduct evaluations of such a highly complex and multifaceted project. We conclude with examples and lessons learned from our evaluation work and provide recommendations for project evaluations under similar conditions.

Keywords

Evaluation HCI user-centred evaluation project management 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Aniketos D7.1 - Validation and evaluation plan, http://www.aniketos.eu/content/deliverables
  2. 2.
    Golafshani, N.: Understanding Reliability and Validity in Qualitative Research. The Qualitative Report 8(4), 597–606 (2003)Google Scholar
  3. 3.
    Wilson, C.E.: Triangulation: the explicit use of multiple methods, measures, and approaches for determining core issues in product development. Interactions 13(6), 46 (2006)CrossRefGoogle Scholar
  4. 4.
    Janzen, D.S., Saiedian, H.: Test-driven development: Concepts, taxonomy, and future direction. Computer Science and Software Engineering 38(9), 43–50 (2005)Google Scholar
  5. 5.
    International Standard: ISO 9241-210:2010: Ergonomics of human-system interaction – Part 210: Human-centred design for interactive systemsGoogle Scholar
  6. 6.
    EUROCONTROL. European Operational Concept Validation Methodology (E-OCVM), http://www.eurocontrol.int/eec/public/standard_page/validation_ocvm.html

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Elke Beck
    • 1
  • Sandra Trösterer
    • 1
  • Alexander G. Mirnig
    • 1
  • Manfred Tscheligi
    • 1
  1. 1.HCI & Usability Unit, ICT&S CenterUniversity of SalzburgSalzburgAustria

Personalised recommendations