Information Sources and Their Importance to Prioritize Test Cases in the Heterogeneous Systems Context
Context: Testing techniques proposed in the literature rely on various sources of information for test case selection (e.g., requirements, source code, system structure, etc.). The challenge of test selection is amplified in the context of heterogeneous systems, where it is unknown which information/data sources are most important.
Contribution: (1) Achieve in-depth understanding of test processes in heterogeneous systems; (2) Elicit information sources for test selection in the context of heterogeneous systems. (3) Capture the relative importance of the identified information sources.
Method: Case study research is used for the elicitation and understanding of which information sources are relevant for test case privatization, followed by an exploratory survey capturing the relative importance of information sources for testing heterogeneous systems.
Results: We classified different information sources that play a vital role in the test selection process, and found that their importance differs largely for the different test levels observed in heterogeneous testing. However, overall all sources were considered essential in test selection for heterogeneous systems.
Conclusion: Heterogeneous system testing requires solutions that take all information sources into account when suggesting test cases for selection. Such approaches need to be developed and compared with existing solutions.
KeywordsInformation Source Heterogeneous System Test Level Test Selection Case Company
Unable to display preview. Download preview PDF.
- 1.Ali, N.B., Petersen, K., Mäntylä, M.: Testing highly complex system of systems: an industrial case study. In: ESEM, pp. 211–220 (2012)Google Scholar
- 2.Andaloussi, B., Braun, A.: A Test Specification Method for Software Interoperability Tests in Offshore Scenarios: A Case Study. In: ICGSE, pp. 169–178 (2006)Google Scholar
- 5.Otani, T.W., Michael, J.B., Shing, M.-T.: Software Reuse in the IV&V of System of Systems, May 30-June 3, pp. 1–5 (2009)Google Scholar
- 6.Otani, T.W., Michael, J.B., Shing, M.-T.: Goal-Driven Software Reuse in the IV & V of System of Systems, pp. 1–6 (June 2010)Google Scholar
- 7.Petersen, K., Gencel, C.: Worldviews, research methods, and their relationship to validity in empirical software engineering research. Mensura (2013)Google Scholar
- 8.Petersen, K., Wohlin, C.: Context in industrial software engineering research. In: ESEM, pp. 401–404 (2009)Google Scholar
- 10.Singh, Y., Kaur, A., Suri, B., Singhal, S.: Systematic literature review on regression test prioritization techniques. Informatica 36(4), 379–408 (2012)Google Scholar
- 11.Vega, D.E.: Towards an Automated and Dynamically Adaptable Test System for Testing Healthcare Information Systems. In: ICST, pp. 331–334 (2010)Google Scholar