AutoFormBench: Benchmark Dataset for Automating Form Understanding

📅 2026-03-31
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
This study addresses the challenge of automating the processing of structured documents—such as government forms, medical records, and corporate invoices—in real-world scenarios where form layouts exhibit high variability. To this end, the authors introduce a multi-domain benchmark dataset comprising 407 real-world forms and present the first systematic evaluation of both traditional OpenCV-based methods and a suite of YOLO models—including YOLOv8, YOLOv11, YOLOv26-s, and YOLOv26-l—for the task of detecting fillable elements. Experimental results demonstrate that YOLOv11 consistently achieves the highest F1 scores and Jaccard accuracy across all element categories and tolerance levels, confirming its superiority in form understanding tasks. The released dataset and comprehensive performance comparison establish a valuable benchmark for future research in document intelligence.

Technology Category

Application Category

📝 Abstract
Automated processing of structured documents such as government forms, healthcare records, and enterprise invoices remains a persistent challenge due to the high degree of layout variability encountered in real-world settings. This paper introduces AutoFormBench, a benchmark dataset of 407 annotated real-world forms spanning government, healthcare, and enterprise domains, designed to train and evaluate form element detection models. We present a systematic comparison of classical OpenCV approaches and four YOLO architectures (YOLOv8, YOLOv11, YOLOv26-s, and YOLOv26-l) for localizing and classifying fillable form elements. specifically checkboxes, input lines, and text boxes across diverse PDF document types. YOLOv11 demonstrates consistently superior performance in both F1 score and Jaccard accuracy across all element classes and tolerance levels.
Problem

Research questions and friction points this paper is trying to address.

form understanding
document layout variability
structured document processing
fillable form elements
automated form processing
Innovation

Methods, ideas, or system contributions that make the work stand out.

AutoFormBench
form understanding
YOLOv11
document layout analysis
fillable element detection
🔎 Similar Papers
2024-05-16ACM Transactions on Software Engineering and MethodologyCitations: 4
💼 Related Jobs
No related jobs found.
G
Gaurab Baral
School of Computing and Analytics, Northern Kentucky University
J
Junxiu Zhou
School of Computing and Analytics, Northern Kentucky University