https://www.mdu.se/

mdh.sePublikasjoner
Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
An Empirical Evaluation of System-Level Test Effectiveness for Safety-Critical Software
Mälardalens universitet, Akademin för innovation, design och teknik, Inbyggda system.ORCID-id: 0000-0001-8746-7209
Mälardalens universitet, Akademin för innovation, design och teknik, Inbyggda system.ORCID-id: 0000-0003-0611-2655
Mälardalens universitet, Akademin för innovation, design och teknik, Inbyggda system.ORCID-id: 0000-0003-2416-4205
2023 (engelsk)Inngår i: International Conference on Evaluation of Novel Approaches to Software Engineering, ENASE - Proceedings, INSTICC , 2023, s. 293-305Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

Combinatorial Testing (CT) and Model-Based Testing (MBT) are two recognized test generation techniques. The evidence of their fault detection effectiveness and comparison with industrial state-of-the-practice is still scarce, more so at the system level for safety-critical systems, such as those found in trains. We use mutation analysis to perform a comparative evaluation of CT, MBT, and industrial manual testing in terms of their fault detection effectiveness using an industrial case study of the safety-critical train control management system. We examine the fault detection rate per mutant and relationship between the mutation scores and structural coverage using Modified Condition Decision Coverage (MC/DC). Our results show that CT 3-ways, CT 4-ways, and MBT provide higher mutation scores. MBT did not perform better in detecting 'Logic Replacement Operator-Improved' mutants when compared with the other techniques, while manual testing struggled to find 'Logic Block Replacement Operator' mutants. None of the test suites were able to find 'Time Block Replacement Operator' mutants. CT 2-ways was found to be the least effective test technique. MBT-generated test suite achieved the highest MC/DC coverage. We also found a generally consistent positive relationship between MC/DC coverage and mutation scores for all test suites.

sted, utgiver, år, opplag, sider
INSTICC , 2023. s. 293-305
Serie
Proceedings of the International Conference on Evaluation of Novel Approaches to Software Engineering (ENASE), ISSN 2184-4895
Emneord [en]
Fault Detection Effectiveness, Safety-Critical Software, System-Level Tests
HSV kategori
Identifikatorer
URN: urn:nbn:se:mdh:diva-62926DOI: 10.5220/0011756800003464ISI: 001119034200025Scopus ID: 2-s2.0-85160537558ISBN: 9789897586477 (tryckt)OAI: oai:DiVA.org:mdh-62926DiVA, id: diva2:1763666
Konferanse
18th International Conference on Evaluation of Novel Approaches to Software Engineering, ENASE 2023, Prague, Czech Republic, 24/4-25/4, 2023
Tilgjengelig fra: 2023-06-07 Laget: 2023-06-07 Sist oppdatert: 2026-02-25bibliografisk kontrollert

Open Access i DiVA

Fulltekst mangler i DiVA

Andre lenker

Forlagets fulltekstScopus

Person

Zafar, Muhammad NoumanAfzal, WasifEnoiu, Eduard Paul

Søk i DiVA

Av forfatter/redaktør
Zafar, Muhammad NoumanAfzal, WasifEnoiu, Eduard Paul
Av organisasjonen

Søk utenfor DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric

doi
isbn
urn-nbn
Totalt: 352 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf