https://www.mdu.se/

mdu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Comparing Automated Visual GUI Testing Tools: An Industrial Case Study
University of Luxembourg, Luxembourg.
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems.ORCID iD: 0000-0003-0611-2655
Havelsan, Turkey.
Havelsan, Turkey.
Show others and affiliations
2017 (English)In: The 8th ACM SIGSOFT International Workshop on Automated Software Testing A-TEST'17, 2017, p. 21-28Conference paper, Published paper (Refereed)
Abstract [en]

Visual GUI testing (VGT) is a tool-driven technique, which uses image recognition for interaction and assertion of the behaviour of system under test. Motivated by a real industrial need, in the context of a large Turkish software and systems company providing solutions in the areas of defense and IT sector, we systematically planned and applied a VGT project in this industrial context. The goal of the initial phase of the project was to empirically evaluate two well-known VGT tools (Sikuli and JAutomate) to help the company select the best tool for a given testing project. Our results show that both two tools suffer from similar test ‘Replay’ problems such as the inability to find smaller-sized images. The repeatability of test executions was better for JAutomate in case of one of the two software under test (SUT) while it was comparable for the other. In terms of test development effort, for both tools, there were high correlations with number of steps in test suites, however the effort is reduced if test code is reused. The study has already provided benefits to the test engineers and managers in the company by increasing the know-how in the company w.r.t. VGT, and by identifying the challenges and their workarounds in using the tools. The industrial case study in this paper intends to add to the body of evidence in VGT and help other researchers and practitioners.

Place, publisher, year, edition, pages
2017. p. 21-28
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:mdh:diva-37051DOI: 10.1145/3121245.3121250Scopus ID: 2-s2.0-85039414296ISBN: 978-1-4503-5155-3 (print)OAI: oai:DiVA.org:mdh-37051DiVA, id: diva2:1157851
Conference
The 8th ACM SIGSOFT International Workshop on Automated Software Testing A-TEST'17, 04 Sep 2017, PADERBORN, GERMANY, Germany
Projects
TOCSYC - Testing of Critical System Characteristics (KKS)TESTMINE - Mining Test Evolution for Improved Software Regression Test Selection (KKS)Available from: 2017-11-16 Created: 2017-11-16 Last updated: 2019-01-24Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Afzal, Wasif

Search in DiVA

By author/editor
Afzal, Wasif
By organisation
Embedded Systems
Software Engineering

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 153 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf