Empirical evidence in global software engineering: a systematic review

Abstract

Recognized as one of the trends of the 21st century, globalization of the world economies brought significant changes to nearly all industries, and in particular it includes software development. Many companies started global software engineering (GSE) to benefit from cheaper, faster and better development of software systems, products and services. However, empirical studies indicate that achieving these benefits is not an easy task. Here, we report our findings from investigating empirical evidence in GSE-related research literature. By conducting a systematic review we observe that the GSE field is still immature. The amount of empirical studies is relatively small. The majority of the studies represent problem-oriented reports focusing on different aspects of GSE management rather than in-depth analysis of solutions for example in terms of useful practices or techniques. Companies are still driven by cost reduction strategies, and at the same time, the most frequently discussed recommendations indicate a necessity of investments in travelling and socialization. Thus, at the same time as development goes global there is an ambition to minimize geographical, temporal and cultural separation. These are normally integral parts of cross-border collaboration. In summary, the systematic review results in several descriptive classifications of the papers on empirical studies in GSE and also reports on some best practices identified from literature.

Appendices

Appendix 1: Data Extraction Form

Appendix 2: Included Studies

Ref	Paper
1	Andaloussi B. S.; Braun A. “A Test Specification Method for Software Interoperability Tests in Offshore Scenarios: A Case Study”, In the Proceedings of the 1st International Conference on Global Software Engineering, Oct. 2006, pp.169–178
2	Babar M. Ali, B. Kitchenham and R. Jeffery “Comparing distributed and face-to-face meetings for software architecture evaluation: A controlled experiment”, Empirical Software Engineering, Vol. 13, Issue 1, 2008, pp. 39–62 (In SpringerLink since 4 Oct 2007)
3	Babar M. Ali, B. Kitchenham, R. Jeffery “Distributed versus face-to-face meetings for architecture evalution: a controlled experiment”, In the Proceedings of the ACM/IEEE International Symposium on Empirical Software Engineering, 2006, pp. 252–261
4	Babar M. Ali, J. M. Verner, and P.T. Nguyen “Establishing and maintaining trust in software outsourcing relationships: An empirical investigation”, Journal of Systems and Software, Vol. 80, No. 9, September, 2007, pp. 1438–1449
5	Battin R. D., R. Crocker, J. Kreidler and K. Subramanian “Leveraging resources in global software development”, IEEE Software, Vol. 18, No. 2, March/April, 2001, pp. 70–77
6	Bhat J. M., M. Gupta, and S. N. Murthy “Overcoming Requirements Engineering Challenges: Lessons from Offshore Outsourcing”, IEEE Software, Vol.23, No.5, Sept.–Oct. 2006, pp. 38–44
7	Boden A., B. Nett and V. Wulf “Coordination Practices in Distributed Software Development of Small Enterprises”, In the Proceedings of the 2nd International Conference on Global Software Engineering, 27–30 Aug. 2007, pp.235–246
8	Calefato F., D. Damian and F. Lanubile “An Empirical Investigation on Text-Based Communication” in Distributed Requirements Workshops of the 2nd International Conference on Global Software Engineering, 27–30 Aug. 2007, pp.3–11
9	Calefato, F., Lanubile, F., Mallardo, T. “A Controlled Experiment on the Effects of Synchronicity in Remote Inspection Meetings”, In the 1st International symposium on Empirical Software Engineering and Measurement, Sept. 2007, pp.473–475
10	Casey V. and I. Richardson “Uncovering the reality within virtual software teams”, In the Proceedings of the international workshop on Global software development for the practitioner, 2006, pp. 66–72
11	Cataldo M., M. Bass, J. D. Herbsleb, and L. Bass “On Coordination Mechanisms in Global Software Development”, In the Proceedings of the 2nd International Conference on Global Software Engineering, 27–30 Aug. 2007, pp.71–80
12	Conchúir Ó., H. Holmström, P. J. Ågerfalk and B. Fitzgerald “Exploring the Assumed Benefits of Global Software Development”, In the Proceedings of the 1st International Conference on Global Software Engineering, Oct. 2006, pp.159–168
13	Dalberg V., E. Angelvik, D. R. Elvekrok, A. K. Fossberg “Cross-cultural collaboration in ICT procurement” In the International Conference on Software Engineering Proceedings of the 2006 international workshop on Global software development for the practitioner, 2006, pp. 51–57
14	Damian D., F. Lanubile and T. Mallardo “An empirical study of the impact of asynchronous discussions on remote synchronous requirements meetings”, published by Lecture Notes in Computer Science, Vol. 3922, In the Proceedings of the 9th international conference on Fundamental Approaches to Software Engineering, 2006, pp. 155–169
15	Damian D., L. Izquierdo, J. Singer and I. Kwan “Awareness in the Wild: Why Communication Breakdowns Occur”, In the Proceedings of the 2nd International Conference on Global Software Engineering, 27–30 Aug. 2007, pp.81–90
16	Damian D. and D. Zowghi “The impact of stakeholders’ geographical distribution on managing requirements in a multi-site organization” In the Proceedings of the IEEE Joint International Conference on Requirements Engineering, 2002, pp. 319–328
17	De Souza C. R. B., T. Hildenbrand and D. Redmiles “Toward Visualization and Analysis of Traceability Relationships in Distributed and Offshore Software Development Projects”, published by LNCS, Vol. 4716, Software Engineering Approaches for Offshore and Outsourced Development, 2007, pp. 182–199
18	Dutoit A. H., J. Johnstone and B. Bruegge “Knowledge scouts: Reducing communication barriers in a distributed software development project”, In the Proceedings of the Asia-Pacific Software Engineering Conference and International Computer Science Conference, 2001, pp. 427–430
19	Ebert C. and P. De Neve, “Surviving global software development”, IEEE Software, Vol. 18, No. 2, March/April, 2001, pp. 62–69
20	Ebert C., C. H. Parro, R. Suttels, and H. Kolarczyk “Improving validation activities in a global software development”, In the Proceedings of the International Conference on Software Engineering, 2001, pp. 545–554
21	Favela J., H. Natsu, C. Pérez, O. Robles, A. L. Morán, R. Romero, A. M. Martínez-Enríquez and D. Decouchant “Empirical Evaluation of Collaborative Support for Distributed Pair Programming”, In Lecture Notes in Computer Science: Groupware: Design, Implementation and Use, Vol. 3198, 2004, pp. 215–222
22	Gumm D.-C. “Mutual Dependency of Distribution, Benefits and Causes: An Empirical Study”, In the Proceedings of the 2nd International Conference on Global Software Engineering, 27–30 Aug. 2007, pp.113–124
23	Harjumaa L. “Distributed software inspections—An experiment with Adobe Acrobat”, In the Proceedings of the IASTED International Conference on Computer Science and Technology, 2003, pp. 26–31
24	Herbsleb J. D., D. J. Paulish, and M. Bass “Global software development at Siemens: Experience from nine project”, In the proceedings of the 27th International Conference on Software Engineering, 2005, pp. 524–533
25	Herbsleb J. D. and A. Mockus “An empirical study of speed and communication in globally distributed software development”, IEEE Transactions on Software Engineering, Vol. 29, No. 6, June, 2003, pp. 481–494
26	Holmström H., E. Ó. Conchúir, P. J. Ågerfalk and B. Fitzgerald “Global Software Development Challenges: A Case Study on Temporal, Geographical and Socio-Cultural Distance”, In the Proceedings of the 1st International Conference on Global Software Engineering, Oct. 2006, pp. 3–11
27	Holmström H., B. Fitzgerald, P. J. Ågerfalk and E. Ó. Conchúir “Agile practices reduce distance in global software development”, Information Systems Management 23 (3), 2006, pp. 7–18
28	Huang H. and R. Ocker “Preliminary insights into the in-group/out-group effect in partially distributed teams: an analysis of participant reflections”, In the Proceedings of the ACM SIGMIS conference on computer personnel research: Forty 4 years of computer personnel research: achievements, challenges & the future, pp. 264–272
29	Jacobs J., J. van Moll, P. Krause, R. Kusters, J. Trienekens and A. Brombacher “Exploring defect causes in products developed by virtual teams”, Information and software technology, Vol. 47, No. 6, 2005, pp. 399–410
30	Kommeren R. and P. Parviainen “Philips experiences in global distributed software development”, Empirical Software Engineering, Vol. 12, No. 6, December 2007, pp. 647–660
31	Korkala M. and P. Abrahamsson “Communication in Distributed Agile Development: A Case Study” In the Proceedings of the 33rd EUROMICRO Conference on Software Engineering and Advanced Applications, 28–31 Aug. 2007, pp.203–210
32	Kotlarsky J., I. Oshri, K. Kumar and J. van Hillegersberg “Globally distributed component-based software development: an exploratory study of knowledge management and work division”, Journal of Information Technology No. 22 (2), June 2007, pp. 161–173
33	Lanubile F., T. Mallardo, and F. Calefato “Tool support for geographically dispersed inspection teams”, Software Process Improvement and Practice, Vol. 8, No. 4, October/December, 2003, pp. 217–231
34	Lasser S. and M. Heiss, “Collaboration maturity and the offshoring cost barrier: The trade-off between flexibility in team composition and cross-site communication effort in geographically distributed development projects”, In the Proceedings of the IEEE International Professional Communication Conference, 2005, pp. 718–728
35	Layman L., L. Williams, D. Damian, and H. Bures, “Essential communication practices for Extreme Programming in a global software development team”, Information and Software Technology, Vol. 48, No. 9, September, 2006, Distributed Software Development, pp. 781–794
36	Lings B., B. Lundell, P. J. Ågerfalk and B. Fitzgerald “A reference model for successful Distributed Development of Software Systems”, In the Proceedings of the 2nd International Conference on Global Software Engineering, 27–30 Aug. 2007, pp.130–139
37	Ma J., J. Li, W. Chen, R. Conradi, J. Ji and C. Liu “An Industrial Survey of Software Outsourcing in China”, published by LNCS, Vol. 4589, In the Proceedings of the International PROFES Conference, 2007, pp. 5–19
38	McChesney I. R. and S. Gallagher “Communication and co-ordination practices in software engineering projects”, Information and Software Technology, Vol. 46, Issue 7, June 2004, pp. 473–489
39	Moe N. B., and D. Smite “Understanding lacking trust in global software teams: A multi-case study”, published by Lecture Notes in Computer Science, Vol. 4589, In the proceedings of the 8th international PROFES conference, 2007, pp. 20–34
40	Munkvold B. E.and I. Zigurs “Process and technology challenges in swift-starting virtual teams”, Information & Management, Vol. 44, Issue 3, April 2007, pp. 287–299
41	Nicholson B. and S. Sahay “Some political and cultural issues in the globalisation of software development: case experience from Britain and India”, Information and Organization, Vol. 11, Issue 1, January 2001, pp. 25–43
42	Oshri I., J. Kotlarsky and L. P. Willcocks “Global software development: Exploring socialization and face-to-face meetings in distributed strategic projects”, The Journal of Strategic Information Systems, Volume 16, Issue 1, March 2007, pp. 25–49
43	Ovaska P., M. Rossi, P. Marttiin “Architecture as a coordination tool in multi-site software development”, Software Process Improvement and Practice, Vol. 8, Issue 4, October/December 2003, pp. 233–247
44	Prikladnicki R., J. L. N. Audy, D. Damian and T. C. de Oliveira “Distributed Software Development: Practices and challenges in different business strategies of offshoring and onshoring”, In the proceedings of the 2nd International Conference on Global Software Engineering, 27–30 Aug. 2007, pp. 262–274
45	Prikladnicki R.; J. L. N. Audy and R. Evaristo “Reference Model for Global Software Development: Findings from a Case Study”, In the Proceedings of the 2nd International Conference on Global Software Engineering, 27–30 Aug. 2007, pp.18–28
46	Prikladnicki R., J. L. N. Audy and R. Evaristo “Global software development in practice lessons learned”, Software Process Improvement and Practice, Vol. 8, No. 4, October/December, 2003, pp. 267–281
47	Ramasubbu N. and R. K. Balan “Globally distributed software development project performance: an empirical analysis”, In the Proceedings of the 6th joint meeting of the European software engineering conference and the ACM SIGSOFT symposium on the foundations of software engineering, pp. 125–134
48	Ramesh B., L. Cao, K. Mohan and P. Xu “Flexible and distributed software processes: old petunias in new bowls?: Can distributed software development be agile?”, Communications of the ACM, Vol. 49, Issue 10, October 2006 pp.: 41–46
49	Smite D. “Project Outcome Predictions: Risk Barometer Based on Historical”, In the Proceedings of the 2nd International Conference on Global Software Engineering, 27–30 Aug. 2007, pp.–112
50	Smite D. “Global software development projects in one of the biggest companies in Latvia: Is geographical distribution a problem?”, Software Process Improvement and Practice, Vol. 11, No. 1, January/February, 2006, pp. 61–76
51	Smite D. “A case study: Coordination practices in global software development”, published by Lecture Notes in Computer Science, Vol. 3547, In the proceedings of the 6th International PROFES Conference, 2005, pp. 234–244
52	Spinellis D. “Case studies: Global software development in the freeBSD project”, In the International Conference on Software Engineering Proceedings of the 2006 international workshop on Global software development for the practitioner, pp. 73–79
53	Stewart K. J., G. Sanjay “The moderating role of development stage in free/open source software project performance”, Software Process Improvement and Practice, V. 11, Issue 2, March/April 2006, pp. 177–191
54	Swigger K., F. Alpaslan, R. Brazile and M. Monticino “Effects of culture on computer-supported international collaborations”, International Journal of Human-Computer Studies, Vol. 60, Issue 3, March 2004, pp. 365–380
55	Taweel A. and P. Brereton “Developing software across time zones: An exploratory empirical study”, Informatica (Ljubljana), Vol. 26, No. 3, November, 2002, pp. 333–344
56	Taxen L. “An integration centric approach for the coordination of distributed software development projects”, Information and Software Technology, Vol. 48, No. 9, September, 2006, Distributed Software Development, pp. 767–780
57	Treinen J. J. and S.L. Miller-Frost “Following the sun: Case studies in global software development”, IBM Systems Journal, 45 (4), October–December 2006, pp. 773–783
58	Välimäki A. and J. Kääriäinen “Requirements Management Practices as Patterns for Distributed Product Management”, published by LNCS Vol. 4589, In the Proceedings of the International PROFES Conference, 2007, pp.188–200
59	Van de Walle B., C. Campbell and F. P. Deek “The Impact of Task Structure and Negotiation Sequence on Distributed Requirements Negotiation Activity, Conflict, and Satisfaction”, published by LNCS, Vol. 4495, Advanced Information Systems Engineering, 2007, pp. 381–394