A Multimodal Label Forecasting Method for Aperiodic Visuo-Motor Time Series

📅 2026-09-07
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文针对非周期性视觉-运动时间序列预测问题,提出了一种新的深度学习架构,利用内生和外生变量,并严格实施独立同分布训练样本抽样方法。
📝 Abstract
Deep learning models have been increasingly applied to Time Series Forecasting (TSF) in recent years. Transformer-based and MLP-based models have both been used effectively on many real-world TSF regression benchmarks, and there is ongoing debate as to which family of methods is best. While these benchmarks have drawn much attention, it is also worth noting that many current datasets and methods assume approximate periodicity in the time series. In this work, we focus on a new TSF task without periodicity: anticipating falls during humanoid locomotion, on the basis of egocentric vision and proprioception. When the locomotion trajectories are sufficiently diverse, periodicity is violated. We contribute two new benchmark datasets (one from simulation, one from real hardware), showing that periodicity is violated and recent deep TSF methods struggle on these benchmarks. We also propose a novel deep learning architecture that exploits both endogenous and exogenous variables and a training process that rigorously enforces i.i.d sampling of training examples. Our results show statistically significant improvement over prior art in multiple experimental conditions, by 12.73% or more on the real data and 10.40% or more on the simulation data. Code and datasets will be available upon acceptance.
Problem

Research questions and friction points this paper is trying to address.

Time Series Forecasting
aperiodic
fall anticipation
humanoid locomotion
egocentric vision
Innovation

Methods, ideas, or system contributions that make the work stand out.

Non-periodic Time Series
Deep Learning Architecture
Egocentric Vision and Proprioception
i.i.d. Sampling
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
B
Borui He
EECS Department, Syracuse University, Syracuse NY 13244, USA
G
Garrett E Katz
EECS Department, Syracuse University, Syracuse NY 13244, USA