https://www.mdu.se/

mdu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
ESPRET: A Tool for Execution Time Estimation of Manual Test Cases
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems. RISE SICS Västerås, Sweden.ORCID iD: 0000-0002-8724-9049
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems.ORCID iD: 0000-0003-0611-2655
RISE SICS Västerås, Sweden.ORCID iD: 0000-0002-1512-0844
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems. RISE SICS Västerås, Sweden.ORCID iD: 0000-0003-1597-6738
Show others and affiliations
2018 (English)In: Journal of Systems and Software, ISSN 0164-1212, E-ISSN 1873-1228, Vol. 146, p. 26-41Article in journal (Refereed) Published
Abstract [en]

Manual testing is still a predominant and an important approach for validation of computer systems, particularly in certain domains such as safetycritical systems. Knowing the execution time of test cases is important to perform test scheduling, prioritization and progress monitoring. In this work, we present, apply and evaluate ESPRET (EStimation and PRediction of Execution Time) as our tool for estimating and predicting the execution time of manual test cases based on their test specifications. Our approach works by extracting timing information for various steps in manual test specifcation. This information is then used to estimate the maximum time for test steps that have not previously been executed, but for which textual specifications exist. As part of our approach, natural language parsing of the specifications is performed to identify word combinations to check whether existing timing information on various test steps is already available or not. Since executing test cases on the several machines may take different time, we predict the actual execution time for test cases by a set of regression models. Finally, an empirical evaluation of the approach and tool has been performed on a railway use case at Bombardier Transportation (BT) in Sweden.

Place, publisher, year, edition, pages
2018. Vol. 146, p. 26-41
National Category
Computer Systems
Identifiers
URN: urn:nbn:se:mdh:diva-40905DOI: 10.1016/j.jss.2018.09.003ISI: 000451488900004Scopus ID: 2-s2.0-85053193472OAI: oai:DiVA.org:mdh-40905DiVA, id: diva2:1247074
Projects
ITS-EASY Post Graduate School for Embedded Software and SystemsMegaMaRt2 - Megamodelling at Runtime (ECSEL/Vinnova)TESTOMAT Project - The Next Level of Test AutomationAvailable from: 2018-09-11 Created: 2018-09-11 Last updated: 2023-09-13Bibliographically approved
In thesis
1. Multi-Criteria Optimization of System Integration Testing
Open this publication in new window or tab >>Multi-Criteria Optimization of System Integration Testing
2018 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Optimizing software testing process has received much attention over the last few decades. Test optimization is typically seen as a multi-criteria decision making problem. One aspect of test optimization involves test selection, prioritization and execution scheduling. Having an efficient test process can result in the satisfaction of many objectives such as cost and time minimization. It can also lead to on-time delivery and a better quality of the final software product. To achieve the goal of test efficiency, a set of criteria, having an impact on the test cases, need to be identified. The analysis of several industrial case studies and also state of the art in this thesis, indicate that the dependency between integration test cases is one such criterion, with a direct impact on the test execution results. Other criteria of interest include requirement coverage and test execution time. In this doctoral thesis, we introduce, apply and evaluate a set of approaches and tools for test execution optimization at industrial integration testing level in embedded software development. Furthermore, ESPRET (Estimation and Prediction of Execution Time) and sOrTES (Stochastic Optimizing of Test Case Scheduling) are our proposed supportive tools for predicting the execution time and the scheduling of manual integration test cases, respectively. All proposed methods and tools in this thesis, have been evaluated at industrial testing projects at Bombardier Transportation (BT) in Sweden. As a result of the scientific contributions made in this doctoral thesis, employing the proposed approaches has led to an improvement in terms of reducing redundant test execution failures of up to 40% with respect to the current test execution approach at BT. Moreover, an increase in the requirements coverage of up to 9.6% is observed at BT. In summary, the application of the proposed approaches in this doctoral thesis has shown to give considerable gains by optimizing test schedules in system integration testing of embedded software development.

Place, publisher, year, edition, pages
Västerås: Mälardalen University, 2018
Series
Mälardalen University Press Dissertations, ISSN 1651-4238 ; 281
National Category
Embedded Systems
Research subject
Computer Science
Identifiers
urn:nbn:se:mdh:diva-41273 (URN)978-91-7485-414-5 (ISBN)
Public defence
2018-12-21, Lambda, Mälardalens högskola, Västerås, 13:15 (English)
Opponent
Supervisors
Available from: 2018-11-02 Created: 2018-11-01 Last updated: 2018-11-20Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Tahvili, SaharAfzal, WasifSaadatmand, MehrdadBohlin, Markus

Search in DiVA

By author/editor
Tahvili, SaharAfzal, WasifSaadatmand, MehrdadBohlin, MarkusHasan Ameerjan, Sharvathul
By organisation
Embedded SystemsEmbedded Systems
In the same journal
Journal of Systems and Software
Computer Systems

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 230 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf