Implicit Q-learning-bootstrapped ant colony optimization for maritime moving-target observation scheduling with agile satellites

2026-08-25

AI Summary

论文提出了一种基于隐式Q学习引导的蚁群优化方法IQACO，用于解决敏捷卫星海上移动目标观测调度问题，通过自适应调整信息素因子等参数来优化任务选择与调度。

Abstract

Maritime moving-target observation scheduling with agile Earth observation satellites is a dynamic, sequence-dependent combinatorial optimization problem. Sea-surface targets move continuously, causing feasible observation windows to vary with target motion and satellite orbital geometry. The scheduler must jointly determine task selection, satellite assignment, observation-window selection, and observation ordering under time-window, attitude-maneuvering, onboard-resource, and cloud-affected availability constraints. This paper proposes an implicit Q-learning-bootstrapped ant colony optimization method, termed IQACO, for multi-satellite maritime moving-target observation scheduling. Rather than directly learning a task-selection policy, IQACO embeds an offline implicit Q-learning module into constructive ant colony optimization to adaptively adjust the pheromone factor, heuristic factor, and evaporation rate. A compact search-state representation captures pheromone distribution, current and historical-best solution quality, and iteration progress. During online scheduling, ant colony optimization constructs feasible observation sequences, while the learned policy regulates exploration and exploitation according to the current search state. Experiments on 14 scenarios with different scales and satellite configurations show that IQACO obtains the highest mean observation benefit in every scenario, improves the result of conventional ant colony optimization by 3.40\%--9.40\%, accelerates convergence, and remains stable under different objective-weight settings. These results demonstrate that offline value learning provides an effective adaptive search-control mechanism for constrained maritime moving-target observation scheduling.

Problem

• maritime moving-target observation
• agile satellites
• combinatorial optimization
• dynamic scheduling
• constraint satisfaction

Innovation

• implicit Q-learning
• ant colony optimization
• adaptive search control
• maritime moving-target observation scheduling
• multi-satellite