bounding box postprocessing

Techniques for turning raw detector outputs into reliable localized bounding boxes by applying geometric refinements, filtering (e.g., IoU thresholds, NMS), box regression adjustments, and model-specific heuristics to reduce false positives and improve localization in cluttered, multi-object scenes.

boundingboxpostprocessing

Recent Skill Trend

Momentum and market value over time
Trending
Score
No comparison yet
-0.26
Aug 01, 2026Aug 01, 2026
Career
Value
No comparison yet
$200K/year
Aug 01, 2026Aug 01, 2026

Recommended Survey Paper

Quick overview of the field
View more

Must-Read Papers

Most classic and influential ideas
View more

Existing IoU-based bounding box regression losses suffer from gradient vanishing in non-overlapping cases and rely on handcrafted geometric penalty terms, leading to suboptimal small-object optimization and anomalous box expansion. To address these issues, we propose InterpIoU, which replaces conventional geometric penalties with a differentiable interpolated-box IoU—resolving gradient discontinuity and misalignment at the source. We further introduce Dynamic InterpIoU, which adaptively adjusts the interpolation coefficient based on object scale and spatial distribution. Our method requires no additional hyperparameters and is plug-and-play compatible with mainstream detectors. Extensive experiments on COCO, VisDrone, and PASCAL VOC demonstrate consistent superiority over state-of-the-art IoU-based losses: notably, small-object AP improves by +2.1–3.4 points, validating both effectiveness and generalizability across diverse detection scenarios.

Addresses non-differentiability and misalignment in IoU-based lossesEnhances small object detection with dynamic interpolationImproves bounding box regression for object detection

Confidence-driven Bounding Box Localization for Small Object Detection

Mar 03, 2023
HS
Huixin Sun
🏛️ Beihang University

Small-object detection suffers from significant performance degradation due to inaccurate localization and unstable gradients. This paper identifies that conventional regression-based bounding box localization induces distorted gradients for small objects. To address this, we reformulate bounding box localization as a grid-based classification task—the first such approach—and propose a confidence-driven localization framework. Our method employs two-hot label encoding, confidence distribution prediction, cross-entropy localization loss, and an entropy-based uncertainty loss to jointly correct gradient flow and suppress localization uncertainty. Evaluated on mainstream detectors—including YOLOv8 and RT-DETR—and across three major benchmarks (COCO, VisDrone, and AI-TOD), our approach achieves state-of-the-art performance, notably improving AP for small objects. Moreover, it demonstrates strong generalization across diverse annotation protocols and high-resolution imagery.

Addresses gradient instability in small object localizationImproves small object detection performance gapProposes uncertainty-aware framework for stable gradients

This work addresses the limitation of existing IoU-based loss functions, which employ fixed geometric penalty terms and thus struggle to adapt to the dynamic optimization requirements of bounding box regression across different training stages. To overcome this, the authors propose MoEIoU, the first IoU loss grounded in a Mixture-of-Experts (MoE) mechanism, formulating regression as a mixture-of-experts problem. MoEIoU leverages the log-sum-exp function to smoothly and adaptively aggregate errors in overlap, center alignment, and aspect ratio, while integrating a curriculum learning strategy to dynamically adjust the weights of these error components during training. Extensive experiments on PASCAL VOC, HRIPCB, and MS COCO demonstrate that MoEIoU consistently outperforms current state-of-the-art losses, yielding faster convergence, improved localization accuracy, and notable performance gains across multiple YOLO architectures.

bounding-box regressiongeometric penaltiesIoU-based loss

Improved Convex Decomposition with Ensembling and Boolean Primitives

May 29, 2024
VV
Vaibhav Vavilala
🏛️ UIUC | Leibniz Universität Hannover

This paper addresses the challenging fitting problem in constructive solid geometry (CSG) modeling for scene geometric parsing—characterized by unknown numbers of primitives, strong coupling between positive and negative primitives, and highly non-convex optimization. We propose a multi-regression ensemble framework integrating learned initialization, gradient-based geometric optimization, and Boolean composition modeling. Crucially, we introduce explicit representation of *negative convex primitives* to model voids and occlusions—a first in CSG-based reconstruction. Furthermore, we design a “refine-then-select” ensemble strategy that breaks from conventional paradigms. On standard benchmarks, our method significantly reduces depth and surface normal prediction errors; over 70% of images benefit from negative primitive modeling. The ensemble strategy substantially outperforms baselines, empirically confirming the problem’s severe non-convexity and validating the effectiveness of our approach.

Enhancing CSG representations with negative primitives for better geometry encodingImproving scene decomposition using geometric primitives and ensemblingOptimizing primitive count and interaction for accurate depth and segmentation

Verification for Object Detection - IBP IoU

Jan 30, 2024
NC
Noémie Cohen
🏛️ Airbus | ONERA

This work addresses the challenge of formally verifying the robustness of object detection models against input perturbations. We propose the first abstract interpretation framework specifically designed for IoU-based robustness certification, extending Interval Bound Propagation (IBP) to rigorously reason about IoU—a non-differentiable, geometric metric—under input uncertainty. Our method precisely models the interval propagation of bounding box coordinates through the IoU computation graph, enabling tighter and more stable bounds than existing IBP-based baselines. Experiments on runway detection and handwritten digit recognition demonstrate both empirical effectiveness and strong generalization across diverse detection tasks. The framework is implemented as open-source code, fully compatible with mainstream abstract interpretation verification toolkits.

Enhancing security in landing runway and digit detectionFormally verifying object detection models' robustness to perturbationsImproving accuracy and stability of Intersection over Union metric

Latest Papers

What's happening recently
View more

This work addresses the limitations of existing oriented bounding box regression methods, which rely solely on geometric information while neglecting semantic cues and suffer from unstable gradients during orientation optimization, leading to convergence oscillations. To overcome these issues, the authors propose Fractional-order Semantic IoU loss (FrSIoU), which, for the first time, integrates semantic similarity into IoU-based optimization. By leveraging fractional-order calculus to accumulate historical IoU states, FrSIoU establishes an adaptive gradient gating mechanism that unifies semantic and geometric modeling. Extensive experiments demonstrate consistent performance gains across diverse bounding box representations and visual detection tasks, effectively mitigating gradient oscillations and validating the method’s efficacy and generalization capability.

box regressiongradient instabilityIoU-based loss

Existing image manipulation localization methods rely primarily on 2D cues and suffer significant performance degradation when tampered regions are seamlessly blended with the background. This work proposes a geometry-aware localization framework that, for the first time, incorporates 3D geometric cues—such as depth and surface normals derived from monocular reconstruction—into the task. By assessing the reliability of these 3D cues, the method employs a multi-scale fusion mechanism to selectively integrate them with RGB features. The proposed approach achieves notably improved localization accuracy with minimal additional computational overhead, demonstrating that trustworthy 3D geometric information effectively complements conventional 2D forensic cues.

2D forensic cues3D geometryappearance-consistent manipulation

This work addresses the limitation of existing object detection calibration methods, which rely solely on overall bounding box localization accuracy and thus fail to accurately characterize the confidence of individual coordinate predictions. To overcome this, the paper proposes ReDC, a coordinate-level calibration framework that introduces coordinate alignment and directional bias modeling for the first time. By recoding coordinate-wise confidence, estimating offset directions, and aggregating these into a box-level representation, ReDC enables fine-grained assessment of localization confidence. The method remains compatible with conventional calibration formulations and consistently outperforms current approaches in both in-domain and out-of-domain experiments, significantly improving the accuracy of localization uncertainty estimation.

confidence scorecoordinate-leveldetection calibration

This work addresses the limitations of existing oriented bounding box (OBB) to horizontal bounding box (HBB) conversion methods in remote sensing ship detection, which often introduce excessive background clutter or lose critical target details, thereby degrading detection accuracy. To mitigate this issue, the study proposes a shape-aware HBB generation strategy that, for the first time, incorporates geometric characteristics of ships—including contour shape, fill ratio, and OBB orientation—into the conversion process to produce tighter, more target-aligned axis-aligned bounding boxes. Experimental results demonstrate that the proposed method significantly improves bounding box compactness and detection robustness compared to baseline approaches such as Outer HBB, Area Equivalent HBB, and GBB Marginalized HBB, effectively preserving essential target regions.

bounding box conversionHorizontal Bounding Boxobject detection

This work addresses the challenge of robustly lifting 2D object detections to metric 3D bounding boxes in open-world scenarios where dense depth maps and 3D annotations are scarce. To this end, we propose BoxerNet, a Transformer-based architecture that integrates open-vocabulary 2D detectors (e.g., OWLv2, DETiC), multi-view geometric constraints, and optional depth cues—either sparse or dense. A median-depth block enables effective handling of sparse depth inputs, while aleatoric uncertainty modeling enhances regression robustness. By combining geometric filtering with multi-view fusion, BoxerNet produces globally consistent, de-duplicated 3D boxes. Trained on over 1.2 million unique 3D bounding boxes, our model significantly reduces reliance on costly 3D annotations, achieving an mAP of 0.532 in ego-centric settings without dense depth—substantially outperforming CuTR (0.010)—and 0.412 on CA-1M, surpassing CuTR’s 0.250.

2D-to-3D lifting3D object localizationbounding box

Hot Scholars

LH

Le Hui

Northwestern Polytechnical University
point cloud
M

Mausam

Professor of Computer Science & Engineering, Indian Institute of Technology Delhi
Artificial IntelligenceNeuro-Symbolic AIInformation ExtractionKnowledge Graph