Analysing Human Interaction with Electronic Displays in Microgravity

2026-04-19

AI Summary

This study addresses the lack of systematic research on human-computer interaction efficiency and cognitive states in microgravity, a gap that hinders optimal spacecraft interface design. Conducting the first real microgravity experiment aboard the International Space Station, the project compared astronauts’ pointing and selection performance using finger versus stylus input, while assessing cognitive load and psychological well-being through a spatial 2-back task, subjective rating scales, and statistical analysis. Results indicate that finger-based interaction is significantly faster than stylus use, and no significant differences were observed between astronauts in orbit and ground-based participants in either interaction performance or psychological state. The findings establish a predictive relationship between graphical user interface layout and operation time, providing empirical foundations and practical guidelines for optimizing future spacecraft cockpit human–computer interfaces.

Technology Category

• Humans and AI: Intelligent User Interfaces
• Cognitive Modeling & Cognitive Systems: Simulating Human Behavior
• Intelligent Robots: Human-Robot Interaction

Application Category

• User Modeling, Personalization and Recommendation: Practical large-scale studies of user experience
• Responsible Web: Machine-in-the-loop, human agency and autonomy
• Systems and Infrastructure for Web, Mobile and WoT: Web performance, measurement, and characterization

Abstract

Human Space Flight missions often require interaction with touchscreen displays. This paper presents a study of investigating human machine interaction with touchscreen using both finger and stylus in the International Space Station. The study also reports cognitive state of astronauts in the form of spatial 2-back test and mental well-being through self-reported scales. We presented a series of results comparing pointing and selection performance among ISS crews, ground crews and university students, finger-based touching and stylus-based touching in microgravity and mental well-being scores. We reported that finger-based pointing is statistically significantly faster than stylus-based pointing in microgravity based on analysis of 420 pointing tasks in ISS from 2 astronauts. We also did not find any significant difference among pointing performance and mental state of astronauts and students on ground. Results from the study can be used to predict pointing and selection time from dimension and position of GUI (Graphical User Interface) elements for cockpits of spacecraft.

Problem

• microgravity
• human-computer interaction
• touchscreen
• pointing performance
• cognitive state

Innovation

• microgravity
• touchscreen interaction
• pointing performance
• human-machine interface
• spacecraft GUI