mdh.sePublikationer
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Automated Functional Dependency Detection Between Test Cases Using Text Semantic Similarity
RISE SICS Västerås.ORCID-id: 0000-0002-8724-9049
Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.ORCID-id: 0000-0003-0073-1674
University of Innsbruck Innsbruck, Austria.
Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.ORCID-id: 0000-0003-0611-2655
Visa övriga samt affilieringar
2019 (Engelska)Ingår i: 2019 IEEE International Conference On Artificial Intelligence Testing (AITest), 2019, s. 19-26, artikel-id 8718215Konferensbidrag, Publicerat paper (Övrigt vetenskapligt)
Abstract [en]

Knowing about dependencies and similarities between test cases is beneficial for prioritizing them for cost-effective test execution. This holds especially true for the time consuming, manual execution of integration test cases written in natural language. Test case dependencies are typically derived from requirements and design artifacts. However, such artifacts are not always available, and the derivation process can be very time-consuming. In this paper, we propose, apply and evaluate a novel approach that derives test cases' similarities and functional dependencies directly from the test specification documents written in natural language, without requiring any other data source. Our approach uses an implementation of Doc2Vec algorithm to detect text-semantic similarities between test cases and then groups them using two clustering algorithms HDBSCAN and FCM. The correlation between test case text-semantic similarities and their functional dependencies is evaluated in the context of an on-board train control system from Bombardier Transportation AB in Sweden. For this system, the dependencies between the test cases were previously derived and are compared to the results our approach. The results show that of the two evaluated clustering algorithms, HDBSCAN has better performance than FCM or a dummy classifier. The classification methods' results are of reasonable quality and especially useful from an industrial point of view. Finally, performing a random undersampling approach to correct the imbalanced data distribution results in an F1 Score of up to 75% when applying the HDBSCAN clustering algorithm.

Ort, förlag, år, upplaga, sidor
2019. s. 19-26, artikel-id 8718215
Nationell ämneskategori
Inbäddad systemteknik
Identifikatorer
URN: urn:nbn:se:mdh:diva-41272DOI: 10.1109/AITest.2019.00-13ISI: 000470916100004Scopus ID: 2-s2.0-85067096441ISBN: 9781728104928 (tryckt)OAI: oai:DiVA.org:mdh-41272DiVA, id: diva2:1260293
Konferens
2019 IEEE International Conference On Artificial Intelligence Testing (AITest), 4-9 April 2019, Newark, CA, USA
Tillgänglig från: 2018-11-01 Skapad: 2018-11-01 Senast uppdaterad: 2019-06-27Bibliografiskt granskad
Ingår i avhandling
1. Multi-Criteria Optimization of System Integration Testing
Öppna denna publikation i ny flik eller fönster >>Multi-Criteria Optimization of System Integration Testing
2018 (Engelska)Doktorsavhandling, sammanläggning (Övrigt vetenskapligt)
Abstract [en]

Optimizing software testing process has received much attention over the last few decades. Test optimization is typically seen as a multi-criteria decision making problem. One aspect of test optimization involves test selection, prioritization and execution scheduling. Having an efficient test process can result in the satisfaction of many objectives such as cost and time minimization. It can also lead to on-time delivery and a better quality of the final software product. To achieve the goal of test efficiency, a set of criteria, having an impact on the test cases, need to be identified. The analysis of several industrial case studies and also state of the art in this thesis, indicate that the dependency between integration test cases is one such criterion, with a direct impact on the test execution results. Other criteria of interest include requirement coverage and test execution time. In this doctoral thesis, we introduce, apply and evaluate a set of approaches and tools for test execution optimization at industrial integration testing level in embedded software development. Furthermore, ESPRET (Estimation and Prediction of Execution Time) and sOrTES (Stochastic Optimizing of Test Case Scheduling) are our proposed supportive tools for predicting the execution time and the scheduling of manual integration test cases, respectively. All proposed methods and tools in this thesis, have been evaluated at industrial testing projects at Bombardier Transportation (BT) in Sweden. As a result of the scientific contributions made in this doctoral thesis, employing the proposed approaches has led to an improvement in terms of reducing redundant test execution failures of up to 40% with respect to the current test execution approach at BT. Moreover, an increase in the requirements coverage of up to 9.6% is observed at BT. In summary, the application of the proposed approaches in this doctoral thesis has shown to give considerable gains by optimizing test schedules in system integration testing of embedded software development.

Ort, förlag, år, upplaga, sidor
Västerås: Mälardalen University, 2018
Serie
Mälardalen University Press Dissertations, ISSN 1651-4238 ; 281
Nationell ämneskategori
Inbäddad systemteknik
Forskningsämne
datavetenskap
Identifikatorer
urn:nbn:se:mdh:diva-41273 (URN)978-91-7485-414-5 (ISBN)
Disputation
2018-12-21, Lambda, Mälardalens högskola, Västerås, 13:15 (Engelska)
Opponent
Handledare
Tillgänglig från: 2018-11-02 Skapad: 2018-11-01 Senast uppdaterad: 2018-11-20Bibliografiskt granskad

Open Access i DiVA

Fulltext saknas i DiVA

Övriga länkar

Förlagets fulltextScopus

Personposter BETA

Tahvili, SaharHatvani, LeoAfzal, WasifBohlin, Markus

Sök vidare i DiVA

Av författaren/redaktören
Tahvili, SaharHatvani, LeoAfzal, WasifBohlin, Markus
Av organisationen
Inbyggda system
Inbäddad systemteknik

Sök vidare utanför DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetricpoäng

doi
isbn
urn-nbn
Totalt: 92 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf