Prevalence of continuous integration failures in industrial systems with hardware-in-the-loop testingShow others and affiliations
2022 (English)In: Proceedings - 2022 IEEE International Symposium on Software Reliability Engineering Workshops, ISSREW 2022, Institute of Electrical and Electronics Engineers Inc. , 2022, p. 61-66Conference paper, Published paper (Refereed)
Abstract [en]
Faults in the automated continuous integration (CI) process can seriously impact the development of industrial code. To reduce manual intervention in automated CI processes, we want to understand better the CI systems' failure distribution to improve efficiency, reliability, and maintainability. This paper investigates failures in CI in four large industrial projects. We gather 11 731 builds over six months, identifying 1 414 failing builds. We also identify the distribution of different types of build failures in each of the four CI projects. Our results show that compilation is the most significant individual cause of failure with 47 %, followed by testing at 36 %. The checkout step with associated checks also incurs a non-negligible portion of failures with 12 %. Furthermore, we identify 14 distinct types of failures in the testing step. We conclude that configuration problems are a significant issue, as pipeline scripting and dependency errors make up a large number of failures. © 2022 IEEE.
Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers Inc. , 2022. p. 61-66
Keywords [en]
continuous integration, embedded system, failure classification, industry study, Integration, Integration testing, Continuous integrations, Embedded-system, Hardware-in-the-loop testing, Industrial codes, Industrial systems, Integration process, Integration systems, Manual intervention, Embedded systems
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:mdh:diva-61724DOI: 10.1109/ISSREW55968.2022.00040ISI: 000909333700011Scopus ID: 2-s2.0-85146335651ISBN: 9781665476799 (print)OAI: oai:DiVA.org:mdh-61724DiVA, id: diva2:1732998
Conference
33rd IEEE International Symposium on Software Reliability Engineering Workshops, ISSREW 2022, Virtual, Online, 31 October 2022 through 3 November 2022
2023-02-012023-02-012023-03-01Bibliographically approved