Differentiating Workload using Pilot's Stick Input in a Virtual Reality Flight Task

Evy van Weelden; Carl W. E. van Beek; Maryam Alimardani; Travis J. Wiltshire; Wietse D. Ledegang; Eric L. Groen; Max M. Louwerse

arXiv · 2309.09619

Differentiating Workload using Pilot's Stick Input in a Virtual Reality Flight Task

Evy van Weelden·Carl W. E. van Beek·Maryam Alimardani·Travis J. Wiltshire·Wietse D. Ledegang·Eric L. Groen·Max M. Louwerse

View original source ↗Read source document ↗Export metadata ↓

Abstract

High-risk operational tasks such as those in aviation require training environments that are realistic and capable of inducing high levels of workload. Virtual Reality (VR) offers a simulated 3D environment for immersive, safe and valid training of pilots. An added advantage of such training environments is that they can be personalized to enhance learning, e.g., by adapting the simulation to the user's workload in real-time. The question remains how to reliably and robustly measure a pilot's workload during the training. In this study, six novice military pilots (average of 34.33 flight hours) conducted a speed change maneuver in a VR flight simulator. In half of the runs an auditory 2-back task was added as a secondary task. This led to trials of low and high workload which we compared using the pilot's control input in longitudinal (i.e., pitch) and lateral (i.e., roll) directions. We extracted Pilot Inceptor Workload (PIW) from the stick data and conducted a binary logistic regression to determine whether PIW is predictive of task-induced workload. The results show that inputs on the stick along its longitudinal direction were predictive of workload (low vs. high) when performing a speed change maneuver. Given that PIW may be a task-specific measure, future work may consider (neuro)physiological predictors. Nonetheless, the current paper provides evidence that measuring PIW in a VR flight simulator yields real-time and non-invasive means to determine workload.

Explore related subjects

cs.HC

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Evy van Weelden, Carl W. E. van Beek, Maryam Alimardani, Travis J. Wiltshire, Wietse D. Ledegang, Eric L. Groen, Max M. Louwerse. 2023-09-19. Differentiating Workload using Pilot's Stick Input in a Virtual Reality Flight Task. https://arxiv.org/abs/2309.09619

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

TrialCompass: Visual Analytics for Enhancing the Eligibility Criteria Design of Clinical Trials

Eligibility criteria play a critical role in clinical trials by determining the target patient population, which significantly influences the outcomes of medical interventions. However, current approaches for designing eligibility criteria have limitations to support interactive exploration of the large space of eligibility criteria. They also ignore incorporating detailed characteristics from the original electronic health record (EHR) data for criteria refinement. To address these limitations, we proposed TrialCompass, a visual analytics system integrating a novel workflow, which can empower clinicians to iteratively explore the vast space of eligibility criteria through knowledge-driven and outcome-driven approaches. TrialCompass supports history-tracking to help clinicians trace the evolution of their adjustments and decisions when exploring various forms of data (i.e., eligibility criteria, outcome metrics, and detailed characteristics of original EHR data) through these two approaches. This feature can help clinicians comprehend the impact of eligibility criteria on outcome metrics and patient characteristics, which facilitates systematic refinement of eligibility criteria. Using a real-world dataset, we demonstrated the effectiveness of TrialCompass in providing insights into designing eligibility criteria for septic shock and sepsis-associated acute kidney injury. We also discussed the research prospects of applying visual analytics to clinical trials.

cs.HC↗

arXiv2026

PRIMMDebug: Teaching Secondary School Students a Reflective Approach to Debugging

Debugging is a challenging and infuriating experience for many secondary school students learning their first text-based programming language. One frequent problem is the lack of reflection in students' debugging strategies, which makes error resolution unlikely and teacher reliance common. Tools that encourage more reflective and teacher-independent debugging may foster more success with fixing errors, but are lacking. This paper presents PRIMMDebug, an approach for teaching the debugging process to secondary school students. PRIMMDebug consists of an online tool that takes students through the steps of a pedagogical process based on PRIMM, a framework for teaching programming. The tool encourages written articulation throughout the debugging process and limits students' ability to run and edit code at certain stages. A classroom study with PRIMMDebug found a general reluctance among students to engage with the reflection it promotes, despite teachers appreciating this emphasis on reflection. We end by suggesting three considerations for future pedagogical debugging research and tooling: balance structure and flexibility, teach shorter debugging heuristics, and use tooling early on in students' programming journey.

cs.HC↗

arXiv2026

Mirror Skin: In Situ Visualization of Robot Touch Intent on Robotic Skin

Effective communication of robot touch intent is essential for safe and predictable physical human-robot interaction. While intent communication has been widely studied, existing approaches lack the spatial specificity and semantic depth necessary to efficiently convey robot touch intent. We present Mirror Skin, a cephalopod inspired concept that mirrors in-situ visual representations of a human's body parts onto the corresponding robot's touch region to communicate who shall initiate touch, where it will occur, and when it is imminent. We informed the design of Mirror Skin through a structured design exploration with experts and demonstrate the real-world feasibility of Mirror Skin with a proof-of-concept prototype. User studies in VR and with the physical prototype showed that Mirror Skin significantly improves accuracy and response times for interpreting touch intent and improves the user experience during physical human-robot interactions.

cs.HC↗