Motion-Aware Reinforcement Learning For Object Localization
This work addresses the challenges of overshooting and instability in bounding box refinement for object detection, particularly the lack of motion consistency in temporal scenarios. To this end, the authors propose MARLNet, a proximal policy optimization (PPO)-based reinforcement learning framework for refinement. MARLNet incorporates a constant-velocity motion prior into its state representation and introduces an action smoothness penalty in the reward function, effectively decoupling the conventional IoU-based reward from physical deviation penalties to prevent reward collapse. The study also reveals an inherent representational ceiling in refinement strategies relying on cropped features. Experimental results demonstrate that MARLNet improves detection success rates by 0.011 and 0.007 (at IoU ≥ 0.5) on Pascal VOC 2012 and VisDrone 2019, respectively, while achieving stable training and significantly suppressing overshoot artifacts.