Classifying Ambiguous Requirements: An Explainable Approach in Railway Industry
2024 (English) In: Proc. - IEEE Int. Requir. Eng. Conf. Workshops, REW, Institute of Electrical and Electronics Engineers Inc. , 2024, p. 12-21Conference paper, Published paper (Refereed)
Abstract [en]
A clear understanding of customers' requirements is fundamental towards developing products that behave as intended. Customers commonly use natural language (NL) to specify their requirements. As NL is innately ambiguous and an industrial project could contain thousands of specifications., requirement analysis becomes a highly demanding and time-consuming task. One of the goals in industry is, therefore., to minimise the amount of time spent manually analysing requirements. This article presents a natural language processing (NLP) approach to automatically classify rail domain requirements based on the presence of ambiguity., and to provide textual explanations regarding the reason behind the classification. Traditional machine learning (ML) classification models are trained using lexical features from requirements and experts' comments concerning ambiguity on annotated real-world data. 10-fold cross-validation results show an F-score up to 0.87., with a recall up to 0.88. Furthermore., a validation of the model with 100 additional requirements achieved an accuracy of 0.78., with 76% match between the model's and expert's classification. The provided explanations are important for the expert in understanding the key decision terms involved in the classification., as well as provided insights on the presence of ambiguities in requirements. Ours is among the first works that uses explainability to tackle ambiguity in textual requirements., employing NLP and ML.
Place, publisher, year, edition, pages Institute of Electrical and Electronics Engineers Inc. , 2024. p. 12-21
Keywords [en]
ambiguity, explainability, natural language processing, requirements analysis, Requirements engineering, Customer requirements, Developing product, Industrial programs, Language processing, Natural languages, Railway industry, Requirement analysis, Natural language processing systems
National Category
Computer and Information Sciences
Identifiers URN: urn:nbn:se:mdh:diva-68414 DOI: 10.1109/REW61692.2024.00007 ISI: 001304537500003 Scopus ID: 2-s2.0-85203106701 ISBN: 9798350395518 (print) OAI: oai:DiVA.org:mdh-68414 DiVA, id: diva2:1896797
Conference 32nd IEEE International Requirements Engineering Conference Workshops, REW 2024. Reykjavik24 June 2024 through 28 June 2024. Code 201933
2024-09-112024-09-112024-11-06 Bibliographically approved