https://www.mdu.se/

mdu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Choosing a Test Automation Framework for Programmable Logic Controllers in CODESYS Development Environment
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems.
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems.ORCID iD: 0000-0003-2416-4205
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems.ORCID iD: 0000-0003-0611-2655
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems.ORCID iD: 0000-0003-2870-2680
2022 (English)In: Proceedings - 2022 IEEE 14th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2022, Institute of Electrical and Electronics Engineers Inc. , 2022, p. 277-284Conference paper, Published paper (Refereed)
Abstract [en]

Programmable Logic Controllers are computer devices often used in industrial control systems as primary components that provide operational control and monitoring. The software running on these controllers is usually programmed in an Integrated Development Environment using a graphical or textual language defined in the IEC 61131-3 standard. Although traditionally, engineers have tested programmable logic controllers' software manually, test automation is being adopted during development in various compliant development environments. However, recent studies indicate that choosing a suitable test automation framework is not trivial and hinders industrial applicability. In this paper, we tackle the problem of choosing a test automation framework for testing programmable logic controllers, by focusing on the COntroller DEvelopment SYStem (CODESYS) development environment. CODESYS is deemed popular for device-independent programming according to IEC 61131-3. We explore the CODESYS-supported test automation frameworks through a grey literature review and identify the essential criteria for choosing such a test automation framework. We validate these criteria with an industry practitioner and compare the resulting test automation frameworks in an industrial case study. Next, we summarize the steps for selecting a test automation framework and the identification of 29 different criteria for test automation framework evaluation. This study shows that CODESYS Test Manager and CoUnit are mentioned the most in the grey literature review results. The industrial case study aims to increase the know-how in automated testing of programmable logic controllers and help other researchers and practitioners identify the right framework for test automation in an industrial context.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers Inc. , 2022. p. 277-284
Keywords [en]
Automation framework Comparison, CODESYS, Grey Literature Review, PLC, test automation framework, Automation, Computer circuits, Computer control systems, Controllers, Programmed control systems, Software testing, Technology transfer, Controller development, Controller development system, Development systems, Framework comparisons, Gray literature review, Grey literature, Literature reviews, Test automation frameworks, Programmable logic controllers
National Category
Mechanical Engineering
Identifiers
URN: urn:nbn:se:mdh:diva-59583DOI: 10.1109/ICSTW55395.2022.00055ISI: 000861805200042Scopus ID: 2-s2.0-85133222470ISBN: 9781665496285 (print)OAI: oai:DiVA.org:mdh-59583DiVA, id: diva2:1683054
Conference
14th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2022, 4 April 2022 through 13 April 2022
Available from: 2022-07-13 Created: 2022-07-13 Last updated: 2024-04-02Bibliographically approved
In thesis
1. Enabling Test Automation for Industrial PLC Programs
Open this publication in new window or tab >>Enabling Test Automation for Industrial PLC Programs
2024 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Testing safety-critical systems, particularly those controlled by Programmable Logic Controllers (PLC), is crucial for ensuring the safe and reliable operation of industrial processes. This thesis addresses the critical need for automated testing of safety-critical PLC systems used in various industrial settings. Despite the significance of testing, current practices rely heavily on manual methods, leading to challenges in scalability and reliability. This work investigates enabling test automation for PLCs to facilitate and assist the current manual testing procedures in the industry. The thesis proposes and evaluates test automation techniques and tools tailored to PLCs, focusing on Function Block Diagram and Structured Text languages commonly used in industry. We systematically compare test automation tools for PLC programs, after which we propose a PLC to Python translation framework called PyLC to facilitate automated test generation. The experiment employing the EARS requirement engineering pattern reveals that while engineers use semi-formal notations in varied ways to create requirements, leading to completeness issues, it confirms the viability of employing EARS requirements for PLC system testing. Subsequently, the proposed automation approaches are fully implemented and evaluated using real-world PLC case studies, comparing their efficiency against manual testing procedures. The findings highlight the feasibility and benefits of automating PLC testing, offering insights into improving development and testing processes through carefully selected automation tools for the CODESYS IDE, a well-known PLC development environment. Additionally, we show that leveraging Python-based automated testing techniques and mutation analysis enhances testing effectiveness. Furthermore, incorporating best practices in requirement engineering, as demonstrated by the EARS approach, contributes to further enhancing testing efficiency and effectiveness in PLC development.

Place, publisher, year, edition, pages
Mälardalens universitet, 2024. p. 249
Series
Mälardalen University Press Licentiate Theses, ISSN 1651-9256 ; 358
Keywords
PLC, PLC Testing, Automated Testing, PyLC, EARS Syntax, FBD, ST
National Category
Computer Systems
Research subject
Computer Science
Identifiers
urn:nbn:se:mdh:diva-66351 (URN)978-91-7485-643-9 (ISBN)
Presentation
2024-04-07, Gamma, Mälardalens universitet, Västerås, 09:15 (English)
Opponent
Supervisors
Projects
VeriDevOps, SmartDelta
Available from: 2024-04-03 Created: 2024-04-02 Last updated: 2024-04-16Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Salari, Mikael EbrahimiEnoiu, Eduard PaulAfzal, WasifSeceleanu, Cristina

Search in DiVA

By author/editor
Salari, Mikael EbrahimiEnoiu, Eduard PaulAfzal, WasifSeceleanu, Cristina
By organisation
Embedded Systems
Mechanical Engineering

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 115 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf