Characteristics and Addressed Challenges in Evaluating the Aniketos Project Outcome
Aside from technical R&D and outreach activities in the Aniketos project, one part of the project work comprised of validation and end user evaluation tasks. We describe the particular characteristics of the Aniketos project evaluation and the overall challenges we encountered during our evaluation tasks. These challenges are structured along four elements of evaluation work; viz., 1) project-internal stakeholders who were doing evaluation work or benefiting from the findings, 2) the developed objects that were evaluated, 3) the development process in which the evaluation process was embedded, and 4) the beneficiaries of the project outcome who participated in evaluation studies. We outline the multi-perspective evaluation approach pursued to address these challenges and to ultimately conduct evaluations of such a highly complex and multifaceted project. We conclude with examples and lessons learned from our evaluation work and provide recommendations for project evaluations under similar conditions.
KeywordsEvaluation HCI user-centred evaluation project management
Unable to display preview. Download preview PDF.
- 1.Aniketos D7.1 - Validation and evaluation plan, http://www.aniketos.eu/content/deliverables
- 2.Golafshani, N.: Understanding Reliability and Validity in Qualitative Research. The Qualitative Report 8(4), 597–606 (2003)Google Scholar
- 4.Janzen, D.S., Saiedian, H.: Test-driven development: Concepts, taxonomy, and future direction. Computer Science and Software Engineering 38(9), 43–50 (2005)Google Scholar
- 5.International Standard: ISO 9241-210:2010: Ergonomics of human-system interaction – Part 210: Human-centred design for interactive systemsGoogle Scholar
- 6.EUROCONTROL. European Operational Concept Validation Methodology (E-OCVM), http://www.eurocontrol.int/eec/public/standard_page/validation_ocvm.html