mdh.sePublications
Change search
Link to record
Permanent link

Direct link
BETA
Alternative names
Publications (10 of 52) Show all publications
Tahvili, S., Bohlin, M., Saadatmand, M., Larsson, S., Afzal, W. & Sundmark, D. (2016). Cost-Benefit Analysis of Using Dependency Knowledge at Integration Testing. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics): . Paper presented at THE 17TH INTERNATIONAL CONFERENCE ON PRODUCT-FOCUSED SOFTWARE PROCESS IMPROVEMENT PROFES'16, 22-24 Nov 2016, TRONDHEIM, Norway (pp. 268-284). , 10027
Open this publication in new window or tab >>Cost-Benefit Analysis of Using Dependency Knowledge at Integration Testing
Show others...
2016 (English)In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2016, Vol. 10027, p. 268-284Conference paper, Published paper (Refereed)
Abstract [en]

In software system development, testing can take considerable time and resources, and there are numerous examples in the literature of how to improve the testing process. In particular, methods for selection and prioritization of test cases can play a critical role in efficient use of testing resources. This paper focuses on the problem of selection and ordering of integration-level test cases. Integration testing is performed to evaluate the correctness of several units in composition. Further, for reasons of both effectiveness and safety, many embedded systems are still tested manually. To this end, we propose a process, supported by an online decision support system, for ordering and selection of test cases based on the test result of previously executed test cases. To analyze the economic efficiency of such a system, a customized return on investment (ROI) metric tailored for system integration testing is introduced. Using data collected from the development process of a large-scale safety-critical embedded system, we perform Monte Carlo simulations to evaluate the expected ROI of three variants of the proposed new process. The results show that our proposed decision support system is beneficial in terms of ROI at system integration testing and thus qualifies as an important element in improving the integration testing process.

Keywords
Process improvement, Software testing, Decision support system, Integration testing, Test case selection, Prioritization, Optimization, Return on investment
National Category
Computer Systems
Identifiers
urn:nbn:se:mdh:diva-32887 (URN)10.1007/978-3-319-49094-6_17 (DOI)2-s2.0-84998880972 (Scopus ID)
Conference
THE 17TH INTERNATIONAL CONFERENCE ON PRODUCT-FOCUSED SOFTWARE PROCESS IMPROVEMENT PROFES'16, 22-24 Nov 2016, TRONDHEIM, Norway
Projects
ITS-EASY Post Graduate School for Embedded Software and SystemsTOCSYC - Testing of Critical System Characteristics (KKS)IMPRINT - Innovative Model-Based Product Integration Testing (Vinnova)
Available from: 2016-08-29 Created: 2016-08-24 Last updated: 2018-11-01Bibliographically approved
Tahvili, S., Saadatmand, M., Larsson, S., Afzal, W., Bohlin, M. & Sundmark, D. (2016). Dynamic Integration Test Selection Based on Test Case Dependencies. In: 2016 IEEE NINTH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION WORKSHOPS (ICSTW): . Paper presented at 9th IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) (pp. 277-286). Chicago, United States
Open this publication in new window or tab >>Dynamic Integration Test Selection Based on Test Case Dependencies
Show others...
2016 (English)In: 2016 IEEE NINTH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION WORKSHOPS (ICSTW), Chicago, United States, 2016, p. 277-286Conference paper, Published paper (Refereed)
Abstract [en]

Prioritization, selection and minimization of test cases are well-known problems in software testing. Test case prioritization deals with the problem of ordering an existing set of test cases, typically with respect to the estimated likelihood of detecting faults. Test case selection addresses the problem of selecting a subset of an existing set of test cases, typically by discarding test cases that do not add any value in improving the quality of the software under test. Most existing approaches for test case prioritization and selection suffer from one or several drawbacks. For example, they to a large extent utilize static analysis of code for that purpose, making them unfit for higher levels of testing such as integration testing. Moreover, they do not exploit the possibility of dynamically changing the prioritization or selection of test cases based on the execution results of prior test cases. Such dynamic analysis allows for discarding test cases that do not need to be executed and are thus redundant. This paper proposes a generic method for prioritization and selection of test cases in integration testing that addresses the above issues. We also present the results of an industrial case study where initial evidence suggests the potential usefulness of our approach in testing a safety-critical train control management subsystem.

Place, publisher, year, edition, pages
Chicago, United States: , 2016
Keywords
Software testing, Integration testing, Test selection, Test prioritization, Fuzzy, AHP, Optimization
National Category
Engineering and Technology Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:mdh:diva-33116 (URN)10.1109/ICSTW.2016.14 (DOI)000382490200038 ()2-s2.0-84992215253 (Scopus ID)978-1-5090-3674-5 (ISBN)
Conference
9th IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)
Projects
ITS-EASY Post Graduate School for Embedded Software and SystemsTOCSYC - Testing of Critical System Characteristics (KKS)IMPRINT - Innovative Model-Based Product Integration Testing (Vinnova)
Available from: 2016-09-08 Created: 2016-09-08 Last updated: 2018-11-01Bibliographically approved
Tahvili, S., Afzal, W., Saadatmand, M., Bohlin, M., Sundmark, D. & Larsson, S. (2016). Towards Earlier Fault Detection by Value-Driven Prioritization of Test Cases Using Fuzzy TOPSIS. In: Information Technology: New Generations, vol. 440: . Paper presented at 13th International Conference on Information Technology : New Generations (ITNG 2016) ITNG'16, 11-13 Apr 2016, Las Vegas, United States (pp. 745-759). Las Vegas, United States
Open this publication in new window or tab >>Towards Earlier Fault Detection by Value-Driven Prioritization of Test Cases Using Fuzzy TOPSIS
Show others...
2016 (English)In: Information Technology: New Generations, vol. 440, Las Vegas, United States, 2016, p. 745-759Conference paper, Published paper (Refereed)
Abstract [en]

In industrial software testing, development projects typically set up and maintain test suites containing large numbers of test cases. Executing a large number of test cases can be expensive in terms of effort and wall-clock time. Moreover, indiscriminate execution of all available test cases typically lead to sub-optimal use of testing resources. On the other hand, selecting too few test cases for execution might leave a large number of faults undiscovered. Limiting factors such as allocated budget and time constraints for testing further emphasizes the importance of test case prioritization in order to identify test cases that enable earlier detection of faults while respecting such constraints. In this paper, we propose a multi-criteria decision making approach for prioritizing test cases in order to detect faults earlier. This is achieved by applying the TOPSIS (Technique for Order of Preference by Similarity to Ideal Solution) decision making technique combined with fuzzy principles. Our solution is based on important criteria such as fault detection probability, execution time, complexity, and other test case properties. By applying the approach on a train control management subsystem from Bombardier Transportation in Sweden, we demonstrate how it helps, in a systematic way, to identify test cases that can lead to early detection of faults while respecting various criteria.

Place, publisher, year, edition, pages
Las Vegas, United States: , 2016
Keywords
Software Testing, Fault Detection, Test Cases Prioritization, Optimization, Fuzzy Logic, MCDM, TOPSIS, Failure Rate
National Category
Computer Systems
Identifiers
urn:nbn:se:mdh:diva-30517 (URN)10.1007/978-3-319-32467-8_65 (DOI)000385289400065 ()2-s2.0-84962655573 (Scopus ID)978-3-319-32466-1 (ISBN)
Conference
13th International Conference on Information Technology : New Generations (ITNG 2016) ITNG'16, 11-13 Apr 2016, Las Vegas, United States
Projects
ITS-EASY Post Graduate School for Embedded Software and SystemsTOCSYC - Testing of Critical System Characteristics (KKS)IMPRINT - Innovative Model-Based Product Integration Testing (Vinnova)
Available from: 2015-12-22 Created: 2015-12-21 Last updated: 2016-12-27Bibliographically approved
Hallmans, D., Sandström, K., Nolte, T. & Larsson, S. (2015). A method and industrial case: Replacement of an FPGA component in a legacy control system. In: Proceeding - 2015 IEEE International Conference on Industrial Informatics, INDIN 2015: . Paper presented at 13th International Conference on Industrial Informatics, INDIN 2015, 22 July 2015 through 24 July 2015 (pp. 208-214).
Open this publication in new window or tab >>A method and industrial case: Replacement of an FPGA component in a legacy control system
2015 (English)In: Proceeding - 2015 IEEE International Conference on Industrial Informatics, INDIN 2015, 2015, p. 208-214Conference paper, Published paper (Refereed)
Abstract [en]

A significant part of industrial systems have requirements on long life times. Such requirements on the complete system impose requirements on its corresponding embedded systems to be operational for an equally long time. As a consequence it is of paramount importance to be able to replace obsolete components of the embedded systems during the life time of the system, and to be able to update part of the design due to new requirements. In this paper we present a method to manage component replacement in such systems, and we present an industrial case study highlighting the work needed to replace an FPGA chip with another, including all corresponding legacy FPGA design challenges that comes with such a replacement. We have found one larger problem inherent in the ability to use the included components in a way that is not possible with the new circuits replacing the old ones. This problem significantly increased the work needed when performing the conversion and migration from the old design to the new, since parts of the design had to be redesigned from a functional perspective.

Keywords
Embedded systems, Evolvability, FPGA, Legacy, Obsolete components, Design, Field programmable gate arrays (FPGA), Information science, Integrated circuit design, Legacy systems, Complete system, Component replacement, Industrial case study, Industrial systems, Legacy control systems
National Category
Computer Systems
Identifiers
urn:nbn:se:mdh:diva-30599 (URN)10.1109/INDIN.2015.7281736 (DOI)000380453900029 ()2-s2.0-84949517473 (Scopus ID)9781479966493 (ISBN)
External cooperation:
Conference
13th International Conference on Industrial Informatics, INDIN 2015, 22 July 2015 through 24 July 2015
Available from: 2015-12-23 Created: 2015-12-23 Last updated: 2018-04-30Bibliographically approved
Fröberg, J., Larsson, S., Dersten, S. & Nordlander, P.-A. -. (2014). Defining a method for identifying architectural candidates as part of engineering a system architecture. In: 8th Annual IEEE International Systems Conference, SysCon 2014 - Proceedings: . Paper presented at 8th Annual IEEE International Systems Conference, SysCon 2014, 31 March 2014 through 3 April 2014, Ottawa, ON (pp. 266-271).
Open this publication in new window or tab >>Defining a method for identifying architectural candidates as part of engineering a system architecture
2014 (English)In: 8th Annual IEEE International Systems Conference, SysCon 2014 - Proceedings, 2014, p. 266-271Conference paper, Published paper (Refereed)
Abstract [en]

Engineering system architectures for complex systems involves the tasks of analyzing architectural drivers, identifying architectural concerns, identifying valid architecture candidates, and evaluation of alternatives. One problem to overcome when architecting a system is the identification of valid of architectural candidates. We have developed a step-wise method for performing system architecture analysis and tested it on a sub-system in a project developing a drive system for heavy automotive applications. In this paper we present the complete method of nine steps for engineering an architecture and we elaborate in detail on the procedure to identify architectural candidates based on previously identified architectural drivers. We present a diagram depicting the proposed information model, its concepts and their relationships. In addition, the expectations on such a method as expressed by practitioners have been elicited, and we elaborate on the validity by examining how well the method indicate fulfillment. Our conclusion is that the proposed method does not fail to deliver on any of the needs and this gives an indication of usefulness. When identifying architectural candidates it is important to use proper criteria in the process. Our conclusion is that the practitioners should focus on candidates that affect the system at hand (within system boundaries), and on the candidates that address the architecturally significant system use. This is reflected in our method where we prescribe evaluation of the design candidates by validating that they solve only the right problem and by ensuring that they address the system at hand.

Series
8th Annual IEEE International Systems Conference, SysCon 2014 - Proceedings
Keywords
architectural candidate, architecture analysis, architecture evaluation, system architecture
National Category
Engineering and Technology Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:mdh:diva-25595 (URN)10.1109/SysCon.2014.6819268 (DOI)000341949700040 ()2-s2.0-84902489588 (Scopus ID)9781479920877 (ISBN)
Conference
8th Annual IEEE International Systems Conference, SysCon 2014, 31 March 2014 through 3 April 2014, Ottawa, ON
Available from: 2014-07-04 Created: 2014-07-04 Last updated: 2015-02-02Bibliographically approved
Cedergren, S. & Larsson, S. (2014). Evaluating performance in the development of software-intensive products. Information and Software Technology, 56(5), 516-526
Open this publication in new window or tab >>Evaluating performance in the development of software-intensive products
2014 (English)In: Information and Software Technology, ISSN 0950-5849, E-ISSN 1873-6025, Vol. 56, no 5, p. 516-526Article in journal (Refereed) Published
Abstract [en]

Context: Organizational performance measurements in software product development have received a lot of attention in the literature. Still, there is a general discontent regarding the way performance is evaluated in practice, with few studies really focusing on why this is the case. In this paper research focusing on the context of developing software-intensive products in large established multi-national organizations is reported on. Objective: The purpose of this research is to investigate performance measurement practices related to software product development activities. More specifically, focus is on exploring how managers engaged in software product development activities perceive and evaluate performance in large organizations from a managerial perspective. Method: The research approach pursued in this research consist of exploratory multiple case studies. Data is collected mainly through 54 interviews in five case studies in large international organizations developing software-intensive products in Sweden. Focused group interviews with senior managers from eight companies have also been used in the data collection. Results: The results of this research indicate that managers within software product development in general are dissatisfied with their current way of evaluating performance. Performance measurements and the perception of performance are today focused on cost, time, and quality, i.e. what is easily measurable and not necessarily what is important. The dimensions of value creation and learning are missing. Moreover, measurements tend to be result oriented, rather than process oriented, making it difficult to integrate these measurements in the management practices. Conclusion: Managers that are dissatisfied with their performance measurement system and want to improve the current situation should not start by focusing on the current measurements directly; instead they should focus on how the organization perceives performance and how important performance criteria are being developed. By developing relevant performance criteria the first step in developing an effective performance measurement system is made. Moreover, it is concluded that manager's perception of performance is affected by the currently used measurements, hence limiting the scope of the performance criteria. Thus, a change in the way managers perceive performance is necessary before there can be any changes in the way performance is evaluated. 

National Category
Engineering and Technology
Identifiers
urn:nbn:se:mdh:diva-25109 (URN)10.1016/j.infsof.2013.11.006 (DOI)000335545000006 ()2-s2.0-84895922650 (Scopus ID)
Available from: 2014-06-05 Created: 2014-06-05 Last updated: 2017-12-05Bibliographically approved
Hallmans, D., Jägemar, M., Larsson, S. & Nolte, T. (2014). Identifying Evolution Problems for Large Long Term Industrial Evolution Systems. In: 38TH ANNUAL IEEE INTERNATIONAL COMPUTER SOFTWARE AND APPLICATIONS CONFERENCE WORKSHOPS (COMPSACW 2014): . Paper presented at 38th Annual IEEE International Computer Software and Applications Conference (COMPSAC), 21-25 Jul 2014, Västerås, Sweden (pp. 384-389). (6th)
Open this publication in new window or tab >>Identifying Evolution Problems for Large Long Term Industrial Evolution Systems
2014 (English)In: 38TH ANNUAL IEEE INTERNATIONAL COMPUTER SOFTWARE AND APPLICATIONS CONFERENCE WORKSHOPS (COMPSACW 2014), 2014, no 6th, p. 384-389Conference paper, Published paper (Refereed)
Abstract [en]

Large infrastructure systems with a life time of more than 30 years, such as telecommunication or power transmission systems, are difficult to maintain since they suffer from the end-of-life plague of software, hardware and knowledge. Large companies have traditionally tackled this problem successfully, but maybe not with complete efficiency in all cases. We find system evolution to be an increasingly interesting problem as infrastructure becomes more complicated. Our increasingly complex and advanced society demands more of the infrastructure making system evolution an interesting alternative to system replacement. From the point of view of the ISO/IEC 15288 development process we have identified life cycle issues connected to long life time scenarios and the different life cycle stages. In this paper we contribute with a modification of the utilisation and support stage in ISO/IEC 15288 into an evolution stage where a system is not only retired and replaced but rather evolved into the next generation. Using this approach changes the view of system development for this specific type of systems towards a way of incremental development, where new functions can be added at the same time as old legacy parts are replaced with functionally equivalent modules based on new hardware. We have based our solution on the experience from investigations of life cycle issues for two large infrastructure systems.

Keywords
Long Term Industrial Evolution Systems, System Evolution, System Development Stages, System Development Procedure
National Category
Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:mdh:diva-26423 (URN)10.1109/COMPSACW.2014.66 (DOI)000352787700065 ()2-s2.0-84931051211 (Scopus ID)978-1-4799-3578-9 (ISBN)
Conference
38th Annual IEEE International Computer Software and Applications Conference (COMPSAC), 21-25 Jul 2014, Västerås, Sweden
Projects
ITS-EASY Post Graduate School for Embedded Software and Systems
Available from: 2014-11-02 Created: 2014-10-31 Last updated: 2018-04-30Bibliographically approved
Fröberg, J., Larsson, S. & Nordlander, P.-A. -. (2013). A method for analyzing architectural drivers when engineering a system architecture. In: SysCon 2013 - 7th Annual IEEE International Systems Conference, Proceedings: . Paper presented at 7th Annual IEEE International Systems Conference, SysCon 2013, 15 April 2013 through 18 April 2013, Orlando, FL (pp. 711-717).
Open this publication in new window or tab >>A method for analyzing architectural drivers when engineering a system architecture
2013 (English)In: SysCon 2013 - 7th Annual IEEE International Systems Conference, Proceedings, 2013, p. 711-717Conference paper, Published paper (Refereed)
Abstract [en]

A very important task in systems architecting is to understand the needs of the system and identify which ones have architectural ramifications, i.e., architectural drivers. The understanding of architectural drivers enables the later engineering tasks including evaluation of architectural alternatives. Systems engineering guidelines provide models and advice for what information entities to consider, but only limited proposals of how to proceed. In this paper, we device and present a method to perform analysis of architectural drivers and we apply it to an industrial case of developing a hybrid electric drive system for heavy automotive applications. We present data on what practitioners expect from such a method, we present the method and rationale, and preliminary results from applying the method to the case. We note that the process and information model are fairly general and could be considered useful for any developer of a complex system. We believe the proposed method closes some of the gap between the general models described in the system engineering guidelines and an industrially applicable method.

Keywords
architectural requirements, architecture analysis, automotive systems, system architecture
National Category
Engineering and Technology
Identifiers
urn:nbn:se:mdh:diva-21264 (URN)10.1109/SysCon.2013.6549961 (DOI)000326754400108 ()2-s2.0-84883017565 (Scopus ID)9781467331067 (ISBN)
Conference
7th Annual IEEE International Systems Conference, SysCon 2013, 15 April 2013 through 18 April 2013, Orlando, FL
Projects
xpresProDrive
Funder
XPRES - Initiative for excellence in production research
Available from: 2013-09-06 Created: 2013-09-06 Last updated: 2018-08-07Bibliographically approved
Hallmans, D., Nolte, T. & Larsson, S. (2013). A Method for Handling Evolvability in a Complex Embedded System. In: : . Paper presented at 18th IEEE Conference on Emerging Technologies and Factory Automation (ETFA 2013), Cagliari, Italy, 10-13 September 2013 (pp. Article number 6648016).
Open this publication in new window or tab >>A Method for Handling Evolvability in a Complex Embedded System
2013 (English)Conference paper, Published paper (Refereed)
Abstract [en]

Handling of obsolete software and/or hardware components together with management of function updates in a complex embedded system with an expected life time of more than 30 years can be a very difficult to almost impossible task. This types of challenges can be found in a large number of companies in, for example, the power transmission industry, power plants, aviation etc. In this paper we present the basic steps in a proposed method for handling evolvability in such embedded systems with long expected life cycles. The key elements of the proposed method are the definition of function dependencies, release planning, and test requirements.

National Category
Engineering and Technology
Identifiers
urn:nbn:se:mdh:diva-21390 (URN)10.1109/ETFA.2013.6648016 (DOI)2-s2.0-84890691384 (Scopus ID)9781479908622 (ISBN)
Conference
18th IEEE Conference on Emerging Technologies and Factory Automation (ETFA 2013), Cagliari, Italy, 10-13 September 2013
Projects
ITS-EASY Post Graduate School for Embedded Software and SystemsPREMISE - Predictable Multicore Systems
Available from: 2013-09-17 Created: 2013-09-11 Last updated: 2018-04-30Bibliographically approved
Hallmans, D., Nolte, T. & Larsson, S. (2013). Industrial Requirements on Evolution of an Embedded System Architecture. In: : . Paper presented at IEESD 2013: The 5th International IEEE Workshop on Industrial Experience in Embedded Systems Design Held in conjunction with COMPSAC, the IEEE Signature Conference on Computers, Software & Applications - July 22-26, 2013 - Kyoto, Japan. Kyoto, Japan
Open this publication in new window or tab >>Industrial Requirements on Evolution of an Embedded System Architecture
2013 (English)Conference paper, Published paper (Refereed)
Abstract [en]

Management of obsolete software- and hardware-components along with the addition of new components and functionalities in existing embedded systems can be a very difficult or almost impossible task. If there at the same time is a requirement put on the system that it should be in operation for more than 30 years, then the evolution of the embedded system architecture over such a long duration of time will be an even more challenging problem to solve. A large number of different industries, for example the process and power transmission industries, are faced with this type of challenges on a daily basis. The contribution of our research presented in this paper is a set of questions and answers on how it is possible to replace and update an old control system, with examples inherent in process and power transmission applications. We also look at different methods that can be used during the development of new systems such that they will provide a natural support for evolvability, targeting future control system applications.

Place, publisher, year, edition, pages
Kyoto, Japan: , 2013
National Category
Engineering and Technology
Identifiers
urn:nbn:se:mdh:diva-21373 (URN)000331223100114 ()
Conference
IEESD 2013: The 5th International IEEE Workshop on Industrial Experience in Embedded Systems Design Held in conjunction with COMPSAC, the IEEE Signature Conference on Computers, Software & Applications - July 22-26, 2013 - Kyoto, Japan
Projects
ITS-EASY Post Graduate School for Embedded Software and Systems
Available from: 2013-09-17 Created: 2013-09-11 Last updated: 2018-08-01Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-0921-0878

Search in DiVA

Show all publications