Back to top

Guided Research Shun Long Hong

Last modified Apr 12, 2021

Investigating the Lessons Learned on the Introduction of Scaling Agile Frameworks in Large Organizations

 

Abstract

Agile methodologies emphasize change tolerance, collaboration, and the involvement of customers during the software development process. Since thesemethodologies prove to be successful for small, co-located team environments, large organizations aim to scale the underlying methods onto an enterprise-level to har- ness the same benefits, such as shorter time to market, and increased responsiveness to change. To support this agile transformation, a growing number of companies rely on scaling agile frameworks, e.g., Scaled Agile Framework (SAFe) or Large- Scale Scrum (LeSS). Despite a growing attention from the industry and increasing amount of scientific research, literature investigating the reasons and motivation for companies to choose particular frameworks is still scarce. Also, there is no scientific literature focusing on the satisfaction with scaling agile frameworks. This paper aims to fill these gaps by providing a quantitative study analyzing the reasons to choose specific scaling agile frameworks and the fulfillment of expectations. We collected and statistically analyzed data from more than 20 countries, including USA, Germany, Denmark, Brazil, Japan, and New Zealand. Our sample indicates that 75.4% of survey participants are satisfied with their framework. Contrary to existing expectations in literature, we could not confirm that wide adoption is the primary reason for organizations to adopt scaling agile frameworks. We divided the sample data into different groups depending on organizational characteristics, e.g. size of development organization, distribution of teams and development sites. Using inferential analysis we compared different sizes of development organiza- tions and found that there is no significant difference regarding the agreement towards documentation or support as relevant framework selection reasons. Also, respondents where more organizational areas were included within the scaling agile framework were significantly more satisfied than organizations that included less areas. SAFe and LeSS practitioners agreed significantly more with documentation and definition, and available support (e.g., training, coaching, and certifications) of frameworks being relevant for framework selection than organizations that used Spotify or internally created frameworks.

 

Objectives

Despite the fact that there is a rising interest in adopting scaling agile frame- works, scientific literature providing empirical evidence on the reasons and satisfac- tion with adopting scaling agile frameworks is still scarce [1], [2], [3], [4], [5], [6]. Also, there is a lack of literature comparing the adoption of different scaling agile frameworks.

We aim to fill this gap by presenting the results of an empirical study investi- gating the underlying reasons and satisfaction of scaling agile framework adoptions. First, we aim to shed light into the process of selecting scaling agile frameworks by understanding most significant and relevant reasons. Second, we strive to under- stand the satisfaction of practitioners. Third, we investigate and compare different scaling agile framework adoptions concerning their selection criterion and fulfillment of expectations. For this purpose we formulated three research questions:

RQ1: How do organizational characteristics influence the selection process of scaling agile framework?

RQ2: How do organizational characteristics affect the satisfaction with selected scaling agile frameworks?

RQ3: How do different frameworks such as LeSS, internally created ones, SAFe, and Spotify affect selection process and satisfaction regarding scaling agile frameworks?

Research method

Existing research predominantly consists of literature reviews and in-depth case studies considering selected scaling agile frameworks at a limited number of organizations. We were wondering if there is any empirical evidence proving that particular scaling agile frameworks are chosen over others due to specific reasons. Furthermore, we were interested in understanding what practitioners anticipated before they introduced scaling agile frameworks. For this purpose, we decided to conduct a survey as this is the best way to collect information from a broad population [7]. The survey aims to uncover the underlying reasons for scaling agile framework adoptions, as well as the fulfillment of expectations across different enterprise contexts.

Literature

[1] T. Dingsøyr, D. Falessi, and K. Power, “Agile development at scale: The next frontier,” in IEEE Software, vol. 36, no. 2, pp. 30–38, March 2019. 

[2] M. Alqudah and R. Razali, “A review of scaling agile methods in large software development,” in International Journal on Advanced Science, Engineering and Information Technology, vol. 6, no. 6, pp. 828–837, 2016.

[3] K. Conboy and N. Carroll, “Implementing large-scale agile frameworks: Challenges and recommendations,” in IEEE Software, vol. 36, no. 2, pp. 44–50, March 2019.

[4] M. Laanti and P. Kettunen, “Safe adoptions in finland: A survey research,” in Agile Processes in Software Engineering and Extreme Programming – Workshops, R. Hoda, Ed. Cham: Springer International Publishing, 2019, pp. 81–87.

[5] O. Turetken, I. Stojanov, and J. J. M. Trienekens, “Assessing the adoption level of scaled agile development: a maturity model for scaled agile framework,” in Journal of Software: Evolution and Process, vol. 29, no. 6, p. e1796, 2017, e1796 JSME-15-0085.R2. [Online]. Available: https://onlinelibrary.wiley.com/doi/abs/10.1002/smr.1796

[6] A. Putta, M. Paasivaara, and C. Lassenius, “Benefits and challenges of adopting the scaled agile framework (safe): Preliminary results from a multivocal literature review,” in Product-Focused Software Process Improvement, Springer International Publishing, 2018, pp. 334–351.

[7] M. Kasunic, “Designing an effective survey,” in Carnegie-Mellon Univ Pittsburgh PA Software Engineering Institute, Tech. Rep., 2005.

 

Files and Subpages

Name Type Size Last Modification Last Editor
191021 Shun Long Hong Abschluss GR v0.02.pdf 9,36 MB 28.10.2019
SEBIS_ShunLong_Hong_GR_Scaling_Agile_Frameworks_v0.02.pdf 7,87 MB 20.10.2019