Requirements-Driven Log Analysis (Extended Abstract)
Imagine that you are tasked to help a project improve their testing effort. In a realistic scenario it will quickly become clear, that having an impact is difficult. First of all, it will likely be a challenge to suggest an alternative approach which is significantly more automated and/or more effective than current practice. The reality is that an average software system has a complex input/output behavior. An automated testing approach will have to auto-generate test cases, each being a pair (i, o) consisting of a test input i and an oracle o. The test input i has to be somewhat meaningful, and the oracle o can be very complicated to compute. Second, even in the case where some testing technology has been developed that might improve current practice, it is then likely difficult to completely change the current behavior of the testing team unless the technique is obviously superior and does everything already done by existing technology.
KeywordsTemporal Logic Test Input Mars Science Laboratory NASA Ames Research Testing Team
Unable to display preview. Download preview PDF.
- 1.Allan, C., Avgustinov, P., Christensen, A.S., Hendren, L., Kuzins, S., Lhoták, O., de Moor, O., Sereni, D., Sittamplan, G., Tibble, J.: Adding trace matching with free variables to AspectJ. In: OOPSLA 2005. ACM Press (2005)Google Scholar
- 5.Barringer, H., Havelund, K., Kurklu, E., Morris, R.: Checking flight rules with TraceContract: Application of a Scala DSL for trace analysis. In: Scala Days 2011. Stanford University, California (2011)Google Scholar
- 8.Groce, A., Havelund, K., Smith, M.H.: From scripts to specifications: the evolution of a flight software testing effort. In: 32nd Int. Conference on Software Engineering (ICSE 2010), pp. 129–138. ACM SIG, Cape Town (2010)Google Scholar
- 9.Havelund, K.: Closing the gap between specification and programming: VDM + + and Scala. In: Korovina, M., Voronkov, A. (eds.) HOWARD-60: Higher-Order Workshop on Automated Runtime Verification and Debugging. EasyChair Proceedings, Manchester, UK, vol. 1 (December 2011)Google Scholar
- 10.LADEE: Lunar Atmosphere Dust Environment Explorer, http://www.nasa.gov/mission_pages/LADEE/main
- 12.MSL: Mars Science Laboratory, http://mars.jpl.nasa.gov/msl
- 13.SMAP: Soil Moisture Active Passive, http://smap.jpl.nasa.gov