mdh.sePublications
Change search
Link to record
Permanent link

Direct link
BETA
Publications (10 of 13) Show all publications
Wallmyr, M., Sitompul, T. A. & Chuang, L. L. (2019). 1st Workshop on User Interfaces for Heavy Vehicles: Let’s Get to Work. In: Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings: . Paper presented at 11th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications, 21 September 2019 through 25 September 2019 (pp. 1-6). New York
Open this publication in new window or tab >>1st Workshop on User Interfaces for Heavy Vehicles: Let’s Get to Work
2019 (English)In: Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings, New York, 2019, p. 1-6Conference paper, Published paper (Other academic)
Abstract [en]

There are more types of vehicles than the automobile. Many are used for purposes other than transporting passengers or goods. They are often dedicated to enable the user in performing specific manual tasks, in parallel to driving. Such heavy vehicles range from construction vehicles, such as excavators and articulated haulers, to agriculture vehicles, such as tractors and harvesters. They also include speciality vehicles such as lifts and cranes. Recent advances in information technology radically increases their productivity and safety. Moreover, heavy vehicles are increasingly sensor and software-driven, as well as connected and integrated with information systems. This development creates new interaction challenges and research areas. The aim of this workshop is to gather practitioners, researchers, and professionals who wish to explore the potential opportunities, identify research challenges, and innovate in the domain of heavy vehicles.

Place, publisher, year, edition, pages
New York: , 2019
Keywords
Automotive interaction, Heavy vehicle interaction, Notifications, Situation awareness
National Category
Electrical Engineering, Electronic Engineering, Information Engineering
Research subject
Computer Science
Identifiers
urn:nbn:se:mdh:diva-45882 (URN)10.1145/3349263.3350757 (DOI)2-s2.0-85073627112 (Scopus ID)9781450369206 (ISBN)
Conference
11th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications, 21 September 2019 through 25 September 2019
Projects
Immersive Visual Technologies for Safety-critical Applications (ImmerSAFE)ITS-EASY Post Graduate School for Embedded Software and Systems
Funder
EU, Horizon 2020, 764951
Available from: 2019-10-31 Created: 2019-10-31 Last updated: 2019-11-22Bibliographically approved
Sitompul, T. A. & Wallmyr, M. (2019). Analyzing Online Videos: A Complement to Field Studies in Remote Locations. In: 17th IFIP TC 13 International Conference, Paphos, Cyprus, September 2–6, 2019, Proceedings, Part III: . Paper presented at 17th IFIP TC13 International Conference on Human-Computer Interaction, INTERACT 2019; Paphos; Cyprus; 2 September 2019 through 6 September 2019 (pp. 371-389). Cham, 117438
Open this publication in new window or tab >>Analyzing Online Videos: A Complement to Field Studies in Remote Locations
2019 (English)In: 17th IFIP TC 13 International Conference, Paphos, Cyprus, September 2–6, 2019, Proceedings, Part III, Cham, 2019, Vol. 117438, p. 371-389Conference paper, Published paper (Refereed)
Abstract [en]

The paper presents a complementary method, called online video study, to conducting field studies in remote locations, by using available videos on YouTube. There are two driving factors for the online video study. Firstly, there are some occasions where conducting field studies are difficult, for example, due to the remoteness of the location where the research subject is located. Secondly, there is a growing interest among researchers to use available data on the internet as their research data source. To give a context, the study specifically investigates how operators of forest harvesters work in their natural settings. The online video study was started by collecting suitable videos on YouTube using certain criteria. We found 26 videos that meet our criteria, which also provide diverse samples of forest harvesters, operators, and working situations. We used five prior field studies, which investigated forest harvesters-related issues, to evaluate the feasibility of our approach. The results of the online video study method are promising, since we are able to find answers for research questions that we have predefined. The paper does not only contribute to the understanding of how operators of forest harvesters work in natural settings, but also the feasibility of conducting the online video study, which can be utilized when the research subject is located in remote locations.

Place, publisher, year, edition, pages
Cham: , 2019
Series
Lecture Notes in Computer Science, ISSN 0302-9743
Keywords
Field studies, Forest harvesters, Online videos, YouTube
National Category
Computer Systems
Research subject
Computer Science
Identifiers
urn:nbn:se:mdh:diva-45582 (URN)10.1007/978-3-030-29387-1_21 (DOI)2-s2.0-85072868444 (Scopus ID)
Conference
17th IFIP TC13 International Conference on Human-Computer Interaction, INTERACT 2019; Paphos; Cyprus; 2 September 2019 through 6 September 2019
Projects
Immersive Visual Technologies for Safety-critical Applications (ImmerSAFE)ITS-EASY Post Graduate School for Embedded Software and Systems
Funder
EU, Horizon 2020, 764951
Available from: 2019-10-17 Created: 2019-10-17 Last updated: 2019-11-22Bibliographically approved
Wallmyr, M., Sitompul, T. A., Holstein, T. & Lindell, R. (2019). Evaluating Mixed Reality Notifications to Support Excavator Operator Awareness. In: 17th IFIP TC 13 International Conference, Paphos, Cyprus, September 2–6, 2019, Proceedings, Part I: . Paper presented at 17th IFIP TC13 International Conference on Human-Computer Interaction, INTERACT 2019; Paphos; Cyprus; 2 September 2019 through 6 September 2019 (pp. 743-762). Cham: Springer, 11746
Open this publication in new window or tab >>Evaluating Mixed Reality Notifications to Support Excavator Operator Awareness
2019 (English)In: 17th IFIP TC 13 International Conference, Paphos, Cyprus, September 2–6, 2019, Proceedings, Part I, Cham: Springer, 2019, Vol. 11746, p. 743-762Conference paper, Published paper (Refereed)
Abstract [en]

Operating heavy vehicles, for instance an excavator, requires a high level of attention to the operation done using the vehicle and awareness of the surroundings. Digital transformation in heavy vehicles aims to improve productivity and user experience, but it can also increase the operators mental load because of a higher demand of attention to instrumentation and controls, subsequently leading to reduced situation awareness. One way to mitigate this, is to display information within the operators’ field of view, which enhances information detectability through quick glances, using mixed reality interfaces. This work explores two types of mixed reality visualizations and compares them to a traditional display setup in a simulated excavator environment. We have utilized eye-tracking glasses to study users’ attention to the task, surrounding awareness, and interfaces, followed by a NASA-RTLX questionnaire to evaluate the users’ reported mental workload. The results indicate benefits for the mixed reality approaches, with lower workload ratings together with an improved rate in detection of presented information.

Place, publisher, year, edition, pages
Cham: Springer, 2019
Series
Lecture Notes in Computer Science, ISSN 0302-9743 ; 11746
Keywords
Excavator, Head-up display, Heavy-vehicles, Human-vehicle interaction, Mixed reality, Situational awareness
National Category
Computer Systems
Research subject
Computer Science
Identifiers
urn:nbn:se:mdh:diva-45583 (URN)10.1007/978-3-030-29381-9_44 (DOI)2-s2.0-85072870944 (Scopus ID)
Conference
17th IFIP TC13 International Conference on Human-Computer Interaction, INTERACT 2019; Paphos; Cyprus; 2 September 2019 through 6 September 2019
Projects
Immersive Visual Technologies for Safety-critical Applications (ImmerSAFE)ITS-EASY Post Graduate School for Embedded Software and Systems
Funder
EU, Horizon 2020, 764951
Available from: 2019-10-17 Created: 2019-10-17 Last updated: 2019-11-18Bibliographically approved
Sitompul, T. A. & Wallmyr, M. (2019). Using Augmented Reality to Improve Productivity and Safety for Heavy Machinery Operators: State of the Art. In: Proceedings of the 17th International Conference on Virtual-Reality Continuum and its Applications in Industry: . Paper presented at 17th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry (pp. 8:1-8:9). , Article ID 8.
Open this publication in new window or tab >>Using Augmented Reality to Improve Productivity and Safety for Heavy Machinery Operators: State of the Art
2019 (English)In: Proceedings of the 17th International Conference on Virtual-Reality Continuum and its Applications in Industry, 2019, p. 8:1-8:9, article id 8Conference paper, Published paper (Refereed)
Abstract [en]

The machinery used in industrial applications, such as in agriculture, construction, and forestry, are increasingly equipped with digital tools that aim to aid the operator in task completion, improved productivity, and enhanced safety. In addition, as machines are increasingly connected, there are even more opportunities to integrate external information sources. This situation provides a challenge in mediating the information to the operator. One approach that could be used to address this challenge is the use of augmented reality. This enables the system-generated information to be combined with the user’s perception of the environment. It has the potential to enhance the operators’ awareness of the machine, the surroundings, and the operation that needs to be performed. In this paper, we review the current literature to present the state of the art, discuss the possible benefits, and the use of augmented reality in heavy machinery.

Keywords
augmented reality, mixed reality, see-through interfaces, heavy machinery, heavy vehicle
National Category
Engineering and Technology Computer Systems
Research subject
Computer Science
Identifiers
urn:nbn:se:mdh:diva-46209 (URN)10.1145/3359997.3365689 (DOI)2-s2.0-85077121298 (Scopus ID)
Conference
17th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry
Projects
ImmerSafe - Immersive Visual Technologies for Safety-critical ApplicationsITS-EASY Post Graduate School for Embedded Software and Systems
Funder
EU, Horizon 2020, 764951
Available from: 2019-12-01 Created: 2019-12-01 Last updated: 2020-01-09Bibliographically approved
Wallmyr, M., Kade, D. & Holstein, T. (2018). 360 Degree Mixed Reality Environment to Evaluate Interaction Design for Industrial Vehicles Including Head-Up and Head-Down Displays. In: Lecture Notes in Computer Science , Volume 10910: . Paper presented at 10th International Conference on Virtual, Augmented and Mixed Reality, VAMR 2018 Held as Part of HCI International 2018; Las Vegas; United States; 15 July 2018 through 20 July 2018; (pp. 377-391).
Open this publication in new window or tab >>360 Degree Mixed Reality Environment to Evaluate Interaction Design for Industrial Vehicles Including Head-Up and Head-Down Displays
2018 (English)In: Lecture Notes in Computer Science , Volume 10910, 2018, p. 377-391Conference paper, Published paper (Refereed)
Abstract [en]

Designing and testing new information and safety features for industrial vehicles do not need to involve the realization of high-fidelity and expensive simulators. We propose a low-cost mixed reality environment which allows for rapid development and rearrangement of a virtual and physical setup of a simulator for industrial vehicles. Our mixed reality simulator allows for safe testing of controls, information, and safety features to support drivers of industrial vehicles. In this paper, we test the implications of showing extra digital information to excavator drivers through a virtual environment, an external head-up display as well as a head-down display. Through user tests we have seen first indications that projected information through our mixed reality system and content on a head-up display is perceived as more helpful and intuitive than using head-down displays, when controlling our industrial vehicle simulator. Moreover, we have seen that the fear of overseeing an obstacle or other important information is lower when using a head-up display, in comparison to other tested visualization options. © Springer International Publishing AG, part of Springer Nature 2018.

Series
Lecture Notes in Computer Science, ISSN 0302-9743 ; 10910
National Category
Human Computer Interaction
Identifiers
urn:nbn:se:mdh:diva-40373 (URN)10.1007/978-3-319-91584-5_30 (DOI)2-s2.0-85050487695 (Scopus ID)
Conference
10th International Conference on Virtual, Augmented and Mixed Reality, VAMR 2018 Held as Part of HCI International 2018; Las Vegas; United States; 15 July 2018 through 20 July 2018;
Available from: 2018-08-16 Created: 2018-08-16 Last updated: 2018-08-16Bibliographically approved
Sitompul, T. A. & Wallmyr, M. (2018). AUGMENTED REALITY FOR ENCOURAGING ENVIRONMENTALLY SUSTAINABLE BEHAVIORS: A SURVEY. In: : . Paper presented at Interaction Latin America, Rio de Janeiro, Brazil, 2018. Rio de Janeiro, Brazil
Open this publication in new window or tab >>AUGMENTED REALITY FOR ENCOURAGING ENVIRONMENTALLY SUSTAINABLE BEHAVIORS: A SURVEY
2018 (English)Conference paper, Published paper (Refereed)
Abstract [en]

Can virtual information be used to deal with unsustainable behaviors? This paper reviews possible uses of augmented reality with the purpose to encourage users towards environmentally sustainable behaviors. We find that, although the amount of examples is still limited, augmented reality is both directly and indirectly usable to encourage users towards behaviors that are environmentally sustainable.

Place, publisher, year, edition, pages
Rio de Janeiro, Brazil: , 2018
Keywords
augmented reality, environmental suistainability, visualization, survey
National Category
Computer Systems
Research subject
Computer Science
Identifiers
urn:nbn:se:mdh:diva-42992 (URN)10.17648/ila-2018-98087 (DOI)978-85-907174-4-7 (ISBN)
Conference
Interaction Latin America, Rio de Janeiro, Brazil, 2018
Projects
ImmerSAFE - Immersive Visual Technologies for Safety-critical Applications
Funder
EU, Horizon 2020, 764951
Available from: 2019-03-29 Created: 2019-03-29 Last updated: 2019-06-03Bibliographically approved
Wallmyr, M. (2017). Exploring Interaction Design Perspectives on Heavy Vehicles. (Licentiate dissertation). Västerås: Mälardalen University
Open this publication in new window or tab >>Exploring Interaction Design Perspectives on Heavy Vehicles
2017 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Interaction design is more crucial than ever as an ingredient in product development and digitalization. Its need is driven by a trend where software based functionality is becoming increasingly important in all types of product features, simultaneously as new technology moves the frontier where interaction between human and computer takes place. There is also a market demanding renewed experiences, more efficient, stimulating and fashionable, which enterprises seek to deliver to attract customers. Also[WM1] , as systems, for example vehicle systems, get increasingly information intense, the information exchange with the user becomes a factor for safe and successful operation, thus increasing the need for a proficient interaction design.

This research investigates how interaction technologies, interaction design principles, and machine information systems can be used to provide user experiences and efficient interaction between the operator and industrial mobile machines; for example, agricultural machines and construction machines. The research combines software engineering and interaction design together with an industrial perspective. It does so by studies, both in literature and through field studies of operators, by design exploration and prototype realization.

The thesis describes the design space for heavy vehicles through different perspectives. It outlines the principal dimensions of interaction design and the benefits of including design in product and services realization. It presents perspectives on the challenges for the different stakeholders involved, covering the operator of the machines, the software engineer and the designer. It depicts a method for gaining detailed insights into operator’s daily behavior, with minimal interference with their work. Furthermore, it introduces a tool for practitioners to explore interaction design using mixed reality and free head movements, and it investigates possible interfaces using augmented reality.

Abstract [sv]

Interaktionsdesign är mer avgörande i produktutveckling och digitalisering än någonsin. Utvecklingen här drivs av en trend där mjukvarubaserad funktionalitet blir allt viktigare i alla typer av produkter samtidigt som ny teknik ökar designrymden för var samspelet mellan människa och dator kan äga rum. Användare efterfrågar förnyade upplevelser, mer effektiva, stimulerande och moderiktiga. Företag söker möta denna efterfrågan för att locka kunder och genera affärer. Dessutom, genom att system, exempelvis fordonssystem, blir allt mer informationsintensiva, blir sättet som informationsutbytet sker med användaren en allt viktigare faktor för säkerhet och funktionalitet. Sammantaget ökar behovet av en skickligt utförd interaktionsdesign.

Den här avhandlingen undersöker hur interaktionstekniker, interaktionsdesignsprinciper och informationssystem kan användas för att leverera användarupplevelser och effektiv interaktion för operatörer av industriella mobila maskiner, exempelvis jordbruksmaskiner och anläggningsmaskiner. Forskningen kombinerar interaktionsdesign och mjukvaruutveckling i ett industriellt kontext. Forskningen har bedrivits genom studier, i litteratur och etnografiska studier av användare i fält, genom utforskande design och genom prototyprealisering.

Avhandlingen beskriver designrymden för industrifordon från flera perspektiv. Dels från perspektiven av de grundläggande elementen inom interaktionsdesign, processerna för att skapa och forska inom interaktionsdesign samt fördelarna med designdriven produkt- och tjänste-förverkligande. Vidare tar den upp perspektiv utifrån situationen och utmaningarna för inblandade aktörer, såsom operatören av maskinen, mjukvaruutvecklaren och designern. Avhandlingen bidrar också med praktiska perspektiv, dels en metod för att få detaljerad inblick i operatörens dagliga beteende med minimal störning i sitt arbete, och dels ett verktyg för interaktionsdesigners att undersöker möjliga designs med virtuell förstärkt verklighet med hjälp av blandad virtuell verklighet och fria huvudrörelser.

Place, publisher, year, edition, pages
Västerås: Mälardalen University, 2017
Series
Mälardalen University Press Licentiate Theses, ISSN 1651-9256 ; 254
National Category
Human Computer Interaction
Research subject
Computer Science
Identifiers
urn:nbn:se:mdh:diva-34906 (URN)978-91-7485-313-1 (ISBN)
Presentation
2017-03-31, Gamma, Mälardalens högskola, Västerås, 13:15 (English)
Opponent
Supervisors
Available from: 2017-02-17 Created: 2017-02-17 Last updated: 2018-01-13Bibliographically approved
Dodig-Crnkovic, G., Kade, D., Wallmyr, M., Holstein, T. & Almér, A. (2017). Transdisciplinarity seen through Information, Communication, Computation, (Inter-)Action and Cognition. In: Mark Burgin and Wolfgang Hofkirchner (Ed.), INFORMATION STUDIES AND THE QUEST FOR TRANSDISCIPLINARITY: (pp. 217-261). Sweden: World Scientific
Open this publication in new window or tab >>Transdisciplinarity seen through Information, Communication, Computation, (Inter-)Action and Cognition
Show others...
2017 (English)In: INFORMATION STUDIES AND THE QUEST FOR TRANSDISCIPLINARITY / [ed] Mark Burgin and Wolfgang Hofkirchner, Sweden: World Scientific , 2017, p. 217-261Chapter in book (Other academic)
Abstract [en]

This book is the second volume of a two-volume edition based on the International Society for Information Studies Summit Vienna 2015 on "The Information Society at the Crossroads. Response and Responsibility of the Sciences of Information" (see summit.is4is.org). The book gives an up-to-date multiaspect exposition of contemporary studies in the field of information and related areas. It presents most recent achievements, ideas and opinions of leading researchers in this domain reflecting their quest for advancing information science and technology. With the goal of building a better society, in which social and technological innovations help make information key to the flourishing of humanity, we dispense with the bleak view of the dark side of information society. It is aimed at readers that conduct research into any aspect of information, information society and information technology, who develop or implement social or technological applications. It is also for those who have an interest in participating in setting the goals for the sciences of information and the social applications of technological achievements and the scientific results.

Place, publisher, year, edition, pages
Sweden: World Scientific, 2017
Keywords
Transdisciplinarity, interdisciplinarity, research methods, the study of information
National Category
Other Engineering and Technologies
Identifiers
urn:nbn:se:mdh:diva-37491 (URN)10.1142/9789813109001_0007 (DOI)978-981-3108-99-8 (ISBN)
Projects
PICO - Philosophy of Information and ComputingITS-EASY Post Graduate School for Embedded Software and Systems
Available from: 2017-12-19 Created: 2017-12-19 Last updated: 2017-12-19Bibliographically approved
Kade, D., Wallmyr, M., Holstein, T., Lindell, R., Ürey, H. & Özcan, O. (2016). Low-cost mixed reality simulator for industrial vehicle environments. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Volume 9740: . Paper presented at 8th International Conference on Virtual, Augmented and Mixed Reality, VAMR 2016 and Held as Part of 18th International Conference on Human-Computer Interaction, HCI International 2016; Toronto; Canada; 17 July 2016 through 22 July 2016 (pp. 597-608).
Open this publication in new window or tab >>Low-cost mixed reality simulator for industrial vehicle environments
Show others...
2016 (English)In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Volume 9740, 2016, p. 597-608Conference paper, Published paper (Refereed)
Abstract [en]

High-end industrial vehicle simulators are generally expensive and aim at providing a high level of realism. The access to such simulators is often a limited resource to researchers and developers who find themselves using a PC-based simulator instead. We challenge this approach by introducing a low-cost mixed reality simulator for industrial vehicles that allows to test new vehicle control concepts and design ideas in a rapid prototyping manner. Our simulator prototype consists of a head-mounted projection display, a CAVE-like room covered with a retro-reflective cloth and a rotatable chair with controls to steer an industrial vehicle. The created digital environment represents an obstacle course for an excavator and can be controlled by a joystick, a keyboard and can be explored by natural head movements. Performed user tests with 21 participants showed that the mixed reality simulator is perceived as more realistic, natural to use and provides a more immersive experience than a PC-based simulator with the same environment and controls.

Series
Lecture Notes in Computer Science, ISSN 0302-9743 ; 9740
National Category
Human Computer Interaction Other Computer and Information Science
Identifiers
urn:nbn:se:mdh:diva-31723 (URN)10.1007/978-3-319-39907-2_57 (DOI)2-s2.0-84978890790 (Scopus ID)9783319399065 (ISBN)
Conference
8th International Conference on Virtual, Augmented and Mixed Reality, VAMR 2016 and Held as Part of 18th International Conference on Human-Computer Interaction, HCI International 2016; Toronto; Canada; 17 July 2016 through 22 July 2016
Available from: 2016-06-06 Created: 2016-06-06 Last updated: 2018-01-10Bibliographically approved
Holstein, T., Wallmyr, M., Wietzke, J. & Land, R. (2015). Current challenges in compositing heterogeneous user interfaces for automotive purposes. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics): . Paper presented at 2 August 2015 through 7 August 2015 (pp. 531-542). Springer, 9170
Open this publication in new window or tab >>Current challenges in compositing heterogeneous user interfaces for automotive purposes
2015 (English)In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Springer, 2015, Vol. 9170, p. 531-542Conference paper, Published paper (Refereed)
Abstract [en]

Composition (i.e. merging distinct parts to form a new whole) of user interfaces from different providers or devices is popular in many areas. Current trends in the automotive area show, that there is a high interest in compositing interfaces from mobile devices into automotive user interfaces. “Apple CarPlay” and “Android Auto” are concrete examples of such compositions. However composition is addressed with challenges, especially if the parts are originally designed for different purposes. This paper presents the problem statement of compositing heterogeneous devices. Furthermore, it presents a layer model showing architectural levels, where compositions can take place and for each of these layers challenges have been identified.

Place, publisher, year, edition, pages
Springer, 2015
Keywords
Composition, Design, Heterogeneous, Human factors, Hypervisor, Platforms, Ubiquitous interoperability, User interface, Virtualization, Chemical analysis, Human computer interaction, Human engineering, Mobile devices, Architectural levels, Heterogeneous devices, Heterogeneous users, Problem statement, Virtualizations, User interfaces
National Category
Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:mdh:diva-29378 (URN)10.1007/978-3-319-20916-6_49 (DOI)2-s2.0-84944213227 (Scopus ID)9783319209159 (ISBN)
Conference
2 August 2015 through 7 August 2015
Available from: 2015-10-23 Created: 2015-10-23 Last updated: 2018-01-03Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0001-7134-9574

Search in DiVA

Show all publications