https://www.mdu.se/

mdh.sePublikasjoner
Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Factors Limiting Industrial Adoption of Test Driven Development: A Systematic Review
Mälardalens högskola, Akademin för innovation, design och teknik.ORCID-id: 0000-0001-8009-9052
Mälardalens högskola, Akademin för innovation, design och teknik.ORCID-id: 0000-0002-5032-2310
Mälardalens högskola, Akademin för innovation, design och teknik.ORCID-id: 0000-0001-5269-3900
2011 (engelsk)Inngår i: 4th IEEE International Conference on Software Testing, Verification, and Validation, ICST 2011; Berlin; 21 March 2011 through 25 March 2011, 2011, s. 337-346Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

Test driven development (TDD) is one of the basic practices of agile software development and both academia and practitioners claim that TDD, to a certain extent, improves the quality of the code produced by developers. However, recent results suggest that this practice is not followed to the extent preferred by industry. In order to pinpoint specific obstacles limiting its industrial adoption we have conducted a systematic literature review on empirical studies explicitly focusing on TDD as well as indirectly addressing TDD. Our review has identified seven limiting factors viz., increased development time, insufficient TDD experience/knowledge, lack of upfront design, domain and tool specific issues, lack of developer skill in writing test cases, insufficient adherence to TDD protocol, and legacy code. The results of this study is of special importance to the testing community, since it outlines the direction for further detailed scientific investigations as well as highlights the requirement of guidelines to overcome these limiting factors for successful industrial adoption of TDD.

sted, utgiver, år, opplag, sider
2011. s. 337-346
HSV kategori
Identifikatorer
URN: urn:nbn:se:mdh:diva-12206DOI: 10.1109/ICST.2011.19Scopus ID: 2-s2.0-79958704204ISBN: 978-076954342-0 (tryckt)OAI: oai:DiVA.org:mdh-12206DiVA, id: diva2:415324
Konferanse
Fourth International Conference on Software Testing, Verification and Validation
Tilgjengelig fra: 2011-05-10 Laget: 2011-05-06 Sist oppdatert: 2018-01-12bibliografisk kontrollert
Inngår i avhandling
1. Software Testing in Agile Development: Technological and Organisational Challenges
Åpne denne publikasjonen i ny fane eller vindu >>Software Testing in Agile Development: Technological and Organisational Challenges
2011 (engelsk)Licentiatavhandling, med artikler (Annet vitenskapelig)
Abstract [en]

The emerging industrial trend towards agile software development processes brings forth new concerns, challenges as well as opportunities. One of the main concerns is with respect to the achievable quality levels of the final product, for which testing is the well-known assurance mechanism. However, it is not well defined for the community on how to perform testing using existing expertise in an agile environment. This uncertainty may create confusion and contra productivity that can lead to testing teams and their practices considered as an obstacle for full implementation of agile processes within an organisation.

 

This thesis outlines our current research activities towards identifying and addressing important organisational and technical challenges in the agile environment.  In this context, we propose a new role for traditional testers which will enable them to integrate into the agile team as well as to fully exploit their knowledge in the new context. We have conducted an elaborate industrial survey on the preferences and practices with respect to the contemporary aspects of software testing and identified test-driven development as an important technical area for improvement.  A systematic review on empirical evidences related to test-driven development was performed subsequently, which revealed a list of factors limiting its widespread industrial acceptance. Knowledge of testing was identified as one of those factors and was further investigated in a controlled experiment performed with undergraduate students.

 

Our future works aim to confirm these research findings in wider as well as industrial settings and investigate other limiting factors in detail, with the aim of providing guidelines for achieving better utilisation of testers and testing practices.

 

sted, utgiver, år, opplag, sider
Västerås: Mälardalen University, 2011
Serie
Mälardalen University Press Licentiate Theses, ISSN 1651-9256 ; 136
Emneord
software testing, agile development, test-driven development, role of testers, empirical study, controlled experiment
HSV kategori
Forskningsprogram
datavetenskap
Identifikatorer
urn:nbn:se:mdh:diva-12174 (URN)978-91-7485-015-4 (ISBN)
Presentation
2011-06-21, Gamma, Högskoleplan 1, Västerås, 09:15 (engelsk)
Opponent
Veileder
Tilgjengelig fra: 2011-05-11 Laget: 2011-04-29 Sist oppdatert: 2018-01-12bibliografisk kontrollert
2. Quality of Test Design in Test Driven Development
Åpne denne publikasjonen i ny fane eller vindu >>Quality of Test Design in Test Driven Development
2013 (engelsk)Doktoravhandling, med artikler (Annet vitenskapelig)
Abstract [en]

One of the most emphasised software testing activities in an Agile environment is the usage of the Test Driven Development (TDD) approach. TDD is a development activity where test cases are created by developers before writing the code, and all for the purpose of guiding the actual development process. In other words, test cases created when following TDD could be considered as a by-product of software development. However, TDD is not fully adopted by the industry, as indicated by respondents from our industrial survey who pointed out that TDD is the most preferred but least practised activity.

Our further research identified seven potentially limiting factors for industrial adoption of TDD, out of which one of the prominent factor was lack of developers’ testing skills. We subsequently defined and categorised appropriate quality attributes which describe the quality of test case design when following TDD. Through a number of empirical studies, we have clearly established the effect of “positive test bias”, where the participants focused mainly on the functionality while generating test cases. In other words, there existed less number of “negative test cases” exercising the system beyond the specified functionality, which is an important requirement for high reliability systems. On an average, in our studies, around 70% of test cases created by the participants were positive while only 30% were negative. However, when measuring defect detecting ability of those sets of test cases, an opposite ratio was observed. Defect detecting ability of negative test cases were above 70% while positive test cases contributed only by 30%.

We propose a TDDHQ concept as an approach for achieving higher quality testing in TDD by using combinations of quality improvement aspects and test design techniques to facilitate consideration of unspecified requirements during the development to a higher extent and thus minimise the impact of potentially inherent positive test bias in TDD. This way developers do not necessarily focus only on verifying functionality, but they can as well increase security, robustness, performance and many other quality improvement aspects for the given software product. An additional empirical study, evaluating this method, showed a noticeable improvement in the quality of test cases created by developers utilising TDDHQ concept. Our research findings are expected to pave way for further enhancements to the way of performing TDD, eventually resulting in better adoption of it by the industry.

sted, utgiver, år, opplag, sider
Västerås: Mälardalen University, 2013. s. 224
Serie
Mälardalen University Press Dissertations, ISSN 1651-4238 ; 140
Emneord
agile, software testing, test driven development, quality of tests, developer testing, test design quality
HSV kategori
Forskningsprogram
datavetenskap
Identifikatorer
urn:nbn:se:mdh:diva-18773 (URN)978-91-7485-108-3 (ISBN)
Disputas
2013-06-11, Gamma, Högskoleplan 1, Västerås, 09:15 (engelsk)
Opponent
Veileder
Tilgjengelig fra: 2013-04-29 Laget: 2013-04-26 Sist oppdatert: 2018-01-11bibliografisk kontrollert

Open Access i DiVA

fulltekst(259 kB)2707 nedlastinger
Filinformasjon
Fil FULLTEXT01.pdfFilstørrelse 259 kBChecksum SHA-512
a4162142a19a72587fddc30dc7e63606e03281322566abe2f92d93b252ceae9afcd0dee6ea0f060f3bc2c47fc60e7478b10d879663d77ec5f7d17c7eb8a14ec2
Type fulltextMimetype application/pdf

Andre lenker

Forlagets fulltekstScopus

Person

Causevic, AdnanSundmark, DanielPunnekkat, Sasikumar

Søk i DiVA

Av forfatter/redaktør
Causevic, AdnanSundmark, DanielPunnekkat, Sasikumar
Av organisasjonen

Søk utenfor DiVA

GoogleGoogle Scholar
Totalt: 2707 nedlastinger
Antall nedlastinger er summen av alle nedlastinger av alle fulltekster. Det kan for eksempel være tidligere versjoner som er ikke lenger tilgjengelige

doi
isbn
urn-nbn

Altmetric

doi
isbn
urn-nbn
Totalt: 593 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf