Data Driven Testing of Open Source Software
- 1.2k Downloads
The increasing adoption of open source software (OSS) components in software systems introduces new quality risks and testing challenges. OSS components are developed and maintained by open communities and the fluctuation of community members and structures can result in instability of the software quality. Hence, an investigation is necessary to analyze the impact open community dynamics and the quality of the OSS, such as the level and trends in internal communications and content distribution. The analysis results provide inputs to drive selective testing for effective validation and verification of OSS components. The paper suggests an approach for monitoring community dynamics continuously, including communications like email and blogs, and repositories of bugs and fixes. Detection of patterns in the monitored behavior such as changes in traffic levels within and across clusters can be used in turn to drive testing efforts. Our proposal is demonstrated in the case of the XWiki OSS, a Java-based environment that allows for the storing of structured data and the execution of server side scripts within the wiki interface. We illustrate our concepts, methods and approach behind this approach for risk based testing of OSS.
KeywordsOpen Source Software Confusion Matrix Software Quality Email Communication Open Source Software Project
Unable to display preview. Download preview PDF.
- 1.Kenett, R.S., Baker, E.: Process Improvement and CMMI for Systems and Software. CRC Press (2010)Google Scholar
- 2.Franch, X., Susi, A., Annosi, M.C., Ayala, C., Glott, R., Gross, D., Kenett, R., Mancinelli, F., Pop Ramsamy, C.T., Ameller, D., et al.: Managing risk in open source software adoption. In: Proc. 8th Int. Conf. on Software Engineering and Applications (ICSOFT-EA 2013). SciTePress (2013)Google Scholar
- 4.Harel, A., Kenett, R.S., Ruggeri, F.: Modeling web usability diagnostics on the basis of usage statistics. In: Statistical Methods in eCommerce Research, pp. 131–172 (2008)Google Scholar
- 6.Clauset, A., Newman, M.E., Moore, C.: Finding community structure in very large networks. Physical Review E 70(6), 066111 (2004)Google Scholar
- 7.Nagappan, N., Ball, T., Zeller, A.: Mining metrics to predict component failures. In: Proceedings of the 28th International Conference on Software Engineering (ICSE 2006), pp. 452–461. ACM, New York (2006)Google Scholar