mdh.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Experience Report: Automated System Level Regression Test Prioritization Using Multiple Factors
Westermo Research and Development AB, Västerås, Sweden.
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems.ORCID iD: 0000-0002-5032-2310
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems.ORCID iD: 0000-0003-0611-2655
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems.
Show others and affiliations
2016 (English)In: 27th International Symposium on Software Reliability Engineering ISSRE'16, 2016Conference paper (Refereed)
Abstract [en]

We propose a new method of determining an effective ordering of regression test cases, and describe its implementation as an automated tool called SuiteBuilder developed by Westermo Research and Development AB. The tool generates an efficient order to run the cases in an existing test suite by using expected or observed test duration and combining priorities of multiple factors associated with test cases, including previous fault detection success, interval since last executed, and modifications to the code tested. The method and tool were developed to address problems in the traditional process of regression testing, such as lack of time to run a complete regression suite, failure to detect bugs in time, and tests that are repeatedly omitted. The tool has been integrated into the existing nightly test framework for Westermo software that runs on large-scale data communication systems.  In experimental evaluation of the tool, we found significant improvement in regression testing results. The re-ordered test suites finish within the available time, the majority of fault-detecting test cases are located in the first third of the suite, no important test case is omitted, and the necessity for manual work on the suites is greatly reduced.

Place, publisher, year, edition, pages
2016.
Keyword [en]
Automation; Data communication systems; Fault detection; Program debugging; Regression analysis; Software reliability Automated systems; Experience report; Experimental evaluation; Large scale data; Regression suites; Regression testing; Regression tests; Research and development
National Category
Computer Systems
Identifiers
URN: urn:nbn:se:mdh:diva-33812DOI: 10.1109/ISSRE.2016.23ISI: 000391437700002ScopusID: 2-s2.0-85013287871OAI: oai:DiVA.org:mdh-33812DiVA: diva2:1048574
Conference
27th International Symposium on Software Reliability Engineering ISSRE'16, 23-27 Oct 2016, Ottawa, Canada
Available from: 2016-11-21 Created: 2016-11-21 Last updated: 2017-03-02Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Sundmark, DanielAfzal, WasifOstrand, ThomasWeyuker, Elaine
By organisation
Embedded Systems
Computer Systems

Search outside of DiVA

GoogleGoogle Scholar

Altmetric score

Total: 50 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf