mdh.sePublikasjoner
Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Dynamic Integration Test Selection Based on Test Case Dependencies
Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system. IS (Embedded Systems).ORCID-id: 0000-0002-8724-9049
Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system. IS (Embedded Systems).ORCID-id: 0000-0002-1512-0844
Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system. ww.sics.se.ORCID-id: 0000-0002-0921-0878
Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system. IS (Embedded Systems).ORCID-id: 0000-0003-0611-2655
Vise andre og tillknytning
2016 (engelsk)Inngår i: 2016 IEEE NINTH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION WORKSHOPS (ICSTW), Chicago, United States, 2016, s. 277-286Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

Prioritization, selection and minimization of test cases are well-known problems in software testing. Test case prioritization deals with the problem of ordering an existing set of test cases, typically with respect to the estimated likelihood of detecting faults. Test case selection addresses the problem of selecting a subset of an existing set of test cases, typically by discarding test cases that do not add any value in improving the quality of the software under test. Most existing approaches for test case prioritization and selection suffer from one or several drawbacks. For example, they to a large extent utilize static analysis of code for that purpose, making them unfit for higher levels of testing such as integration testing. Moreover, they do not exploit the possibility of dynamically changing the prioritization or selection of test cases based on the execution results of prior test cases. Such dynamic analysis allows for discarding test cases that do not need to be executed and are thus redundant. This paper proposes a generic method for prioritization and selection of test cases in integration testing that addresses the above issues. We also present the results of an industrial case study where initial evidence suggests the potential usefulness of our approach in testing a safety-critical train control management subsystem.

sted, utgiver, år, opplag, sider
Chicago, United States, 2016. s. 277-286
Emneord [en]
Software testing, Integration testing, Test selection, Test prioritization, Fuzzy, AHP, Optimization
HSV kategori
Identifikatorer
URN: urn:nbn:se:mdh:diva-33116DOI: 10.1109/ICSTW.2016.14ISI: 000382490200038Scopus ID: 2-s2.0-84992215253ISBN: 978-1-5090-3674-5 (tryckt)OAI: oai:DiVA.org:mdh-33116DiVA, id: diva2:967492
Konferanse
9th IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)
Prosjekter
ITS-EASY Post Graduate School for Embedded Software and SystemsTOCSYC - Testing of Critical System Characteristics (KKS)IMPRINT - Innovative Model-Based Product Integration Testing (Vinnova)Tilgjengelig fra: 2016-09-08 Laget: 2016-09-08 Sist oppdatert: 2018-11-01bibliografisk kontrollert
Inngår i avhandling
1. A Decision Support System for Integration Test Selection
Åpne denne publikasjonen i ny fane eller vindu >>A Decision Support System for Integration Test Selection
2016 (engelsk)Licentiatavhandling, med artikler (Annet vitenskapelig)
Abstract [en]

Software testing generally suffers from time and budget limitations. Indiscriminately executing all available test cases leads to sub-optimal exploitation of testing resources. Selecting too few test cases for execution on the other hand might leave a large number of faults undiscovered. Test case selection and prioritization techniques can lead to more efficient usage of testing resources and also early detection of faults. Test case selection addresses the problem of selecting a subset of an existing set of test cases, typically by discarding test cases that do not add any value in improving the quality of the software under test. Test case prioritization schedules test cases for execution in an order to increase their effectiveness at achieving some performance goals such as: earlier fault detection, optimal allocation of testing resources and reducing overall testing effort. In practice, prioritized selection of test cases requires the evaluation of different test case criteria, and therefore, this problem can be formulated as a multi-criteria decision making problem. As the number of decision criteria grows, application of a systematic decision making solution becomes a necessity. In this thesis, we propose a tool-supported framework using a decision support system, for prioritizing and selecting integration test cases in embedded system development. The framework provides a complete loop for selecting the best candidate test case for execution based on a finite set of criteria. The results of multiple case studies, done on a train control management subsystem from Bombardier Transportation AB in Sweden, demonstrate how our approach helps to select test cases in a systematic way. This can lead to early detection of faults while respecting various criteria. Also, we have evaluated a customized return on investment metric to quantify the economic benefits in optimizing system integration testing using our framework.

sted, utgiver, år, opplag, sider
Västerås: Mälardalen University, 2016
Serie
Mälardalen University Press Licentiate Theses, ISSN 1651-9256 ; 242
HSV kategori
Forskningsprogram
datavetenskap
Identifikatorer
urn:nbn:se:mdh:diva-33118 (URN)978-91-7485-282-0 (ISBN)
Presentation
2016-10-25, Omega, Mälardalens högskola, Västerås, 13:15 (engelsk)
Opponent
Veileder
Tilgjengelig fra: 2016-09-12 Laget: 2016-09-09 Sist oppdatert: 2016-10-04bibliografisk kontrollert
2. Multi-Criteria Optimization of System Integration Testing
Åpne denne publikasjonen i ny fane eller vindu >>Multi-Criteria Optimization of System Integration Testing
2018 (engelsk)Doktoravhandling, med artikler (Annet vitenskapelig)
Abstract [en]

Optimizing software testing process has received much attention over the last few decades. Test optimization is typically seen as a multi-criteria decision making problem. One aspect of test optimization involves test selection, prioritization and execution scheduling. Having an efficient test process can result in the satisfaction of many objectives such as cost and time minimization. It can also lead to on-time delivery and a better quality of the final software product. To achieve the goal of test efficiency, a set of criteria, having an impact on the test cases, need to be identified. The analysis of several industrial case studies and also state of the art in this thesis, indicate that the dependency between integration test cases is one such criterion, with a direct impact on the test execution results. Other criteria of interest include requirement coverage and test execution time. In this doctoral thesis, we introduce, apply and evaluate a set of approaches and tools for test execution optimization at industrial integration testing level in embedded software development. Furthermore, ESPRET (Estimation and Prediction of Execution Time) and sOrTES (Stochastic Optimizing of Test Case Scheduling) are our proposed supportive tools for predicting the execution time and the scheduling of manual integration test cases, respectively. All proposed methods and tools in this thesis, have been evaluated at industrial testing projects at Bombardier Transportation (BT) in Sweden. As a result of the scientific contributions made in this doctoral thesis, employing the proposed approaches has led to an improvement in terms of reducing redundant test execution failures of up to 40% with respect to the current test execution approach at BT. Moreover, an increase in the requirements coverage of up to 9.6% is observed at BT. In summary, the application of the proposed approaches in this doctoral thesis has shown to give considerable gains by optimizing test schedules in system integration testing of embedded software development.

sted, utgiver, år, opplag, sider
Västerås: Mälardalen University, 2018
Serie
Mälardalen University Press Dissertations, ISSN 1651-4238 ; 281
HSV kategori
Forskningsprogram
datavetenskap
Identifikatorer
urn:nbn:se:mdh:diva-41273 (URN)978-91-7485-414-5 (ISBN)
Disputas
2018-12-21, Lambda, Mälardalens högskola, Västerås, 13:15 (engelsk)
Opponent
Veileder
Tilgjengelig fra: 2018-11-02 Laget: 2018-11-01 Sist oppdatert: 2018-11-20bibliografisk kontrollert

Open Access i DiVA

Fulltekst mangler i DiVA

Andre lenker

Forlagets fulltekstScopus

Personposter BETA

Tahvili, SaharSaadatmand, MehrdadLarsson, StigAfzal, WasifBohlin, MarkusSundmark, Daniel

Søk i DiVA

Av forfatter/redaktør
Tahvili, SaharSaadatmand, MehrdadLarsson, StigAfzal, WasifBohlin, MarkusSundmark, Daniel
Av organisasjonen

Søk utenfor DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric

doi
isbn
urn-nbn
Totalt: 126 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf