Design and Validation of a Capability Measurement Instrument for DevOps Teams: A Participatory Action Research Approach

Olivia H. Plant; Jos van Hillegersberg; Adina Aldea

doi:10.1007/978-3-031-08169-9_10

Design and Validation of a Capability Measurement Instrument for DevOps Teams: A Participatory Action Research Approach

Olivia H. Plant^*, Jos van Hillegersberg, Adina Aldea

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

4 Citations (Scopus)

92 Downloads (Pure)

Abstract

This paper reports on the design and validation of a capability measurement instrument for software delivery teams that make use of the DevOps approach. The instrument is based on the results of a systematic literature review and was developed and validated by involving a total of five domain experts and conducting a field study among six DevOps team members. To this end, we used qualitative and survey-based data collection methods from participatory action research as well as design science. The resulting instrument encompasses five dimensions, covering seventeen capabilities and thirty-eight associated practices. The practices are evaluated on five capability levels. The results of the validation process indicate clear agreement of the domain experts and team members with all aspects of the instrument. As a contribution to practice, this research offers a pragmatic tool for IS practitioners which provides insight into the status of their DevOps transformation and offers directions for improving DevOps team performance. Furthermore, this research contributes to the ongoing research stream on DevOps by providing novel insights into the nature of DevOps capabilities and their potential configurations.

Original language	English
Title of host publication	Agile Processes in Software Engineering and Extreme Programming -
Subtitle of host publication	23rd International Conference on Agile Software Development, XP 2022, Copenhagen, Denmark June 13-17, 2022. Proceedings
Editors	Viktoria Stray, Klaas-Jan Stol, Maria Paasivaara, Philippe Kruchten
Place of Publication	Cham
Publisher	Springer
Pages	151-167
Number of pages	17
ISBN (Electronic)	978-3-031-08169-9
ISBN (Print)	978-3-031-08168-2
DOIs	https://doi.org/10.1007/978-3-031-08169-9_10
Publication status	Published - 2022
Event	23rd International Conference on Agile Software Development, XP 2022 - Copenhagen, Denmark Duration: 13 Jun 2022 → 17 Jun 2022 Conference number: 23

Publication series

Name	Lecture Notes in Business Information Processing
Publisher	Springer
Volume	445
ISSN (Print)	1865-1348
ISSN (Electronic)	1865-1356

Conference

Conference	23rd International Conference on Agile Software Development, XP 2022
Abbreviated title	XP 2022
Country/Territory	Denmark
City	Copenhagen
Period	13/06/22 → 17/06/22

Keywords

Agile
DevOps
DevOps teams
IS capabilities
Measurement instrument development

Access to Document

10.1007/978-3-031-08169-9_10Licence: CC BY

Plant2022_Chapter_DesignAndValidationOfACapabiliFinal published version, 444 KBLicence: CC BY

Cite this

Plant, O. H., van Hillegersberg, J., & Aldea, A. (2022). Design and Validation of a Capability Measurement Instrument for DevOps Teams: A Participatory Action Research Approach. In V. Stray, K.-J. Stol, M. Paasivaara, & P. Kruchten (Eds.), Agile Processes in Software Engineering and Extreme Programming - : 23rd International Conference on Agile Software Development, XP 2022, Copenhagen, Denmark June 13-17, 2022. Proceedings (pp. 151-167). (Lecture Notes in Business Information Processing; Vol. 445 ). Springer. https://doi.org/10.1007/978-3-031-08169-9_10

Plant, Olivia H. ; van Hillegersberg, Jos ; Aldea, Adina. / Design and Validation of a Capability Measurement Instrument for DevOps Teams : A Participatory Action Research Approach. Agile Processes in Software Engineering and Extreme Programming - : 23rd International Conference on Agile Software Development, XP 2022, Copenhagen, Denmark June 13-17, 2022. Proceedings. editor / Viktoria Stray ; Klaas-Jan Stol ; Maria Paasivaara ; Philippe Kruchten. Cham : Springer, 2022. pp. 151-167 (Lecture Notes in Business Information Processing).

@inproceedings{2b9eaac9df2240e98a723ca2563a4d02,

title = "Design and Validation of a Capability Measurement Instrument for DevOps Teams: A Participatory Action Research Approach",

abstract = "This paper reports on the design and validation of a capability measurement instrument for software delivery teams that make use of the DevOps approach. The instrument is based on the results of a systematic literature review and was developed and validated by involving a total of five domain experts and conducting a field study among six DevOps team members. To this end, we used qualitative and survey-based data collection methods from participatory action research as well as design science. The resulting instrument encompasses five dimensions, covering seventeen capabilities and thirty-eight associated practices. The practices are evaluated on five capability levels. The results of the validation process indicate clear agreement of the domain experts and team members with all aspects of the instrument. As a contribution to practice, this research offers a pragmatic tool for IS practitioners which provides insight into the status of their DevOps transformation and offers directions for improving DevOps team performance. Furthermore, this research contributes to the ongoing research stream on DevOps by providing novel insights into the nature of DevOps capabilities and their potential configurations.",

keywords = "Agile, DevOps, DevOps teams, IS capabilities, Measurement instrument development",

author = "Plant, {Olivia H.} and {van Hillegersberg}, Jos and Adina Aldea",

year = "2022",

doi = "10.1007/978-3-031-08169-9_10",

language = "English",

isbn = "978-3-031-08168-2",

series = "Lecture Notes in Business Information Processing",

publisher = "Springer",

pages = "151--167",

editor = "Viktoria Stray and Klaas-Jan Stol and Maria Paasivaara and Philippe Kruchten",

booktitle = "Agile Processes in Software Engineering and Extreme Programming -",

address = "Germany",

note = "23rd International Conference on Agile Software Development, XP 2022, XP 2022 ; Conference date: 13-06-2022 Through 17-06-2022",

}

Plant, OH , van Hillegersberg, J & Aldea, A 2022, Design and Validation of a Capability Measurement Instrument for DevOps Teams: A Participatory Action Research Approach. in V Stray, K-J Stol, M Paasivaara & P Kruchten (eds), Agile Processes in Software Engineering and Extreme Programming - : 23rd International Conference on Agile Software Development, XP 2022, Copenhagen, Denmark June 13-17, 2022. Proceedings. Lecture Notes in Business Information Processing, vol. 445 , Springer, Cham, pp. 151-167, 23rd International Conference on Agile Software Development, XP 2022, Copenhagen, Denmark, 13/06/22. https://doi.org/10.1007/978-3-031-08169-9_10

Design and Validation of a Capability Measurement Instrument for DevOps Teams: A Participatory Action Research Approach. / Plant, Olivia H.; van Hillegersberg, Jos ; Aldea, Adina.
Agile Processes in Software Engineering and Extreme Programming - : 23rd International Conference on Agile Software Development, XP 2022, Copenhagen, Denmark June 13-17, 2022. Proceedings. ed. / Viktoria Stray; Klaas-Jan Stol; Maria Paasivaara; Philippe Kruchten. Cham: Springer, 2022. p. 151-167 (Lecture Notes in Business Information Processing; Vol. 445 ).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Design and Validation of a Capability Measurement Instrument for DevOps Teams

T2 - 23rd International Conference on Agile Software Development, XP 2022

AU - Plant, Olivia H.

AU - van Hillegersberg, Jos

AU - Aldea, Adina

N1 - Conference code: 23

PY - 2022

Y1 - 2022

N2 - This paper reports on the design and validation of a capability measurement instrument for software delivery teams that make use of the DevOps approach. The instrument is based on the results of a systematic literature review and was developed and validated by involving a total of five domain experts and conducting a field study among six DevOps team members. To this end, we used qualitative and survey-based data collection methods from participatory action research as well as design science. The resulting instrument encompasses five dimensions, covering seventeen capabilities and thirty-eight associated practices. The practices are evaluated on five capability levels. The results of the validation process indicate clear agreement of the domain experts and team members with all aspects of the instrument. As a contribution to practice, this research offers a pragmatic tool for IS practitioners which provides insight into the status of their DevOps transformation and offers directions for improving DevOps team performance. Furthermore, this research contributes to the ongoing research stream on DevOps by providing novel insights into the nature of DevOps capabilities and their potential configurations.

AB - This paper reports on the design and validation of a capability measurement instrument for software delivery teams that make use of the DevOps approach. The instrument is based on the results of a systematic literature review and was developed and validated by involving a total of five domain experts and conducting a field study among six DevOps team members. To this end, we used qualitative and survey-based data collection methods from participatory action research as well as design science. The resulting instrument encompasses five dimensions, covering seventeen capabilities and thirty-eight associated practices. The practices are evaluated on five capability levels. The results of the validation process indicate clear agreement of the domain experts and team members with all aspects of the instrument. As a contribution to practice, this research offers a pragmatic tool for IS practitioners which provides insight into the status of their DevOps transformation and offers directions for improving DevOps team performance. Furthermore, this research contributes to the ongoing research stream on DevOps by providing novel insights into the nature of DevOps capabilities and their potential configurations.

KW - Agile

KW - DevOps

KW - DevOps teams

KW - IS capabilities

KW - Measurement instrument development

U2 - 10.1007/978-3-031-08169-9_10

DO - 10.1007/978-3-031-08169-9_10

M3 - Conference contribution

AN - SCOPUS:85133003163

SN - 978-3-031-08168-2

T3 - Lecture Notes in Business Information Processing

SP - 151

EP - 167

BT - Agile Processes in Software Engineering and Extreme Programming -

A2 - Stray, Viktoria

A2 - Stol, Klaas-Jan

A2 - Paasivaara, Maria

A2 - Kruchten, Philippe

PB - Springer

CY - Cham

Y2 - 13 June 2022 through 17 June 2022

ER -

Plant OH , van Hillegersberg J , Aldea A. Design and Validation of a Capability Measurement Instrument for DevOps Teams: A Participatory Action Research Approach. In Stray V, Stol KJ, Paasivaara M, Kruchten P, editors, Agile Processes in Software Engineering and Extreme Programming - : 23rd International Conference on Agile Software Development, XP 2022, Copenhagen, Denmark June 13-17, 2022. Proceedings. Cham: Springer. 2022. p. 151-167. (Lecture Notes in Business Information Processing). Epub 2022 Jun 9. doi: 10.1007/978-3-031-08169-9_10