Accelerated Decoding of Centroid Positional Encoding for Instance Segmentation

2026-09-15

AI Summary

本文针对实例分割中正弦质心编码解码阶段的高计算成本问题，提出了一种优化的CUDA实现方法，显著降低了解码开销并提升了端到端推理速度。

Abstract

Beyond model inference, the decoding stage, which converts raw network outputs into task-level representations, constitutes a significant portion of the execution cost. Despite its practical impact, prediction decoding has received comparatively little attention and is often implemented using generic CPU routines or inefficient GPU kernels, limiting the benefits of advances in model efficiency. In this work, we investigate the decoding overhead associated with a recent sinusoidal centroid encoding for Instance Segmentation, in which each pixel regresses a positional embedding of its instance centroid. This approach allows flexible segmentation without predefined proposals, but extracting instance masks from dense embeddings incurs a high computational cost. We present an optimized CUDA-based implementation of the decoding algorithm tailored to this encoding, explicitly addressing challenges related to parallelization, synchronization, and memory access on modern GPUs. Our solution significantly reduces decoding overhead and improves End-to-End inference latency, outperforming both CPU-based approaches and naive GPU implementations. The results demonstrate that efficient decoding is essential to fully exploit the advantages of advanced output representations and highlight the importance of jointly designing encoding schemes and their decoding algorithms for real-time computer vision systems.

Problem

• Instance Segmentation
• Centroid Positional Encoding
• Decoding Overhead
• GPU Optimization
• Efficient Decoding

Innovation

• Accelerated Decoding
• Centroid Positional Encoding
• CUDA Implementation
• Instance Segmentation