https://www.mdu.se/

mdu.sePublikationer
Driftstörningar
Det förekommer återkommande driftstörningar på några av sök-portalerna på grund av hög belastning. Vi arbetar på att lösa problemet, ni kan tillfälligt mötas av ett felmeddelande.
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
An Empirical Evaluation of System-Level Test Effectiveness for Safety-Critical Software
Mälardalens universitet, Akademin för innovation, design och teknik, Inbyggda system.ORCID-id: 0000-0001-8746-7209
Mälardalens universitet, Akademin för innovation, design och teknik, Inbyggda system.ORCID-id: 0000-0003-0611-2655
Mälardalens universitet, Akademin för innovation, design och teknik, Inbyggda system.ORCID-id: 0000-0003-2416-4205
2023 (Engelska)Ingår i: International Conference on Evaluation of Novel Approaches to Software Engineering, ENASE - Proceedings, INSTICC , 2023, s. 293-305Konferensbidrag, Publicerat paper (Refereegranskat)
Abstract [en]

Combinatorial Testing (CT) and Model-Based Testing (MBT) are two recognized test generation techniques. The evidence of their fault detection effectiveness and comparison with industrial state-of-the-practice is still scarce, more so at the system level for safety-critical systems, such as those found in trains. We use mutation analysis to perform a comparative evaluation of CT, MBT, and industrial manual testing in terms of their fault detection effectiveness using an industrial case study of the safety-critical train control management system. We examine the fault detection rate per mutant and relationship between the mutation scores and structural coverage using Modified Condition Decision Coverage (MC/DC). Our results show that CT 3-ways, CT 4-ways, and MBT provide higher mutation scores. MBT did not perform better in detecting 'Logic Replacement Operator-Improved' mutants when compared with the other techniques, while manual testing struggled to find 'Logic Block Replacement Operator' mutants. None of the test suites were able to find 'Time Block Replacement Operator' mutants. CT 2-ways was found to be the least effective test technique. MBT-generated test suite achieved the highest MC/DC coverage. We also found a generally consistent positive relationship between MC/DC coverage and mutation scores for all test suites.

Ort, förlag, år, upplaga, sidor
INSTICC , 2023. s. 293-305
Serie
Proceedings of the International Conference on Evaluation of Novel Approaches to Software Engineering (ENASE), ISSN 2184-4895
Nyckelord [en]
Fault Detection Effectiveness, Safety-Critical Software, System-Level Tests
Nationell ämneskategori
Datorsystem
Identifikatorer
URN: urn:nbn:se:mdh:diva-62926DOI: 10.5220/0011756800003464ISI: 001119034200025Scopus ID: 2-s2.0-85160537558ISBN: 9789897586477 (tryckt)OAI: oai:DiVA.org:mdh-62926DiVA, id: diva2:1763666
Konferens
18th International Conference on Evaluation of Novel Approaches to Software Engineering, ENASE 2023, Prague, Czech Republic, 24/4-25/4, 2023
Tillgänglig från: 2023-06-07 Skapad: 2023-06-07 Senast uppdaterad: 2026-02-25Bibliografiskt granskad

Open Access i DiVA

Fulltext saknas i DiVA

Övriga länkar

Förlagets fulltextScopus

Person

Zafar, Muhammad NoumanAfzal, WasifEnoiu, Eduard Paul

Sök vidare i DiVA

Av författaren/redaktören
Zafar, Muhammad NoumanAfzal, WasifEnoiu, Eduard Paul
Av organisationen
Inbyggda system
Datorsystem

Sök vidare utanför DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetricpoäng

doi
isbn
urn-nbn
Totalt: 352 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf