Computer benchmarks are standard tools that allow evaluating and comparing different systems or components according to specific characteristics (performance, dependability, security, etc). Resilience encompasses all attributes of the quality of ‘working well in a changing world that includes faults, failures, errors and attacks’. This way, resilience benchmarking merges concepts from performance, dependability, and security. This chapter presents an overview on the state-of-the-art on benchmarking performance, dependability and security. The goal is to identify the existing approaches, techniques and problems relevant to the resilience-benchmarking problem.
KeywordsAutonomic Computing Hardware Fault Security Metrics Preliminary Proposal Workstation Performance
The work of Marco Vieira and Henrique Madeira was partially funded by the European Commission under project AMBER - Assessing, Measuring and Benchmarking Resilience, IST - 216295, funded by the European Union, 2009. The work of Samuel Kounev was partially funded by the German Research Foundation (DFG) under grant No. KO 3445/6-1.