ConRTF: Edge-Constrained Boundary Distribution Refinement for Realtime TransFormer Table Structure Recognition
This work addresses the challenge of inaccurate row/column boundary localization in table structure recognition, which often leads to erroneous cell assignments. Existing methods typically overlook the inherent geometric asymmetry between rows and columns. To remedy this, the authors propose an Edge-constrained Fine-grained Localization (EFL) loss that incorporates geometric priors during training—emphasizing horizontal boundaries for rows and vertical boundaries for columns—and integrates a Distribution-aware Boundary Refinement module (D-FINE) to enhance localization accuracy without increasing inference overhead. This approach is the first to explicitly model row-column asymmetry as part of the training objective, enabling efficient, structure-aware boundary optimization. Evaluated within a Transformer-based real-time detection framework, the method outperforms RT-DETRv2 and YOLOv10–11 on PubTables-1M and two private datasets, achieving up to a 1.6-point gain in GriTS scores while maintaining robust performance with only 2k–3k annotated samples.