Dashboard2Code: Evaluating Multimodal Models on Reconstructing Interactive Dashboards

πŸ“… 2026-07-06
πŸ“ˆ Citations: 0
✨ Influential: 0
πŸ“„ PDF
πŸ€– AI Summary
Existing approaches struggle to reconstruct interactive data dashboards that support functionalities such as clicking and filtering. This work introduces Dashboard2Code, a novel task requiring models to actively explore interactive dashboards and integrate user interaction feedback to generate code that faithfully reproduces the target dashboard. To facilitate research in this direction, we present DashboardMimic, the first benchmark dataset built on Plotly+Dash, along with an automated evaluation framework that combines semantic analysis and dynamic interaction testing. Experimental results on 180 high-quality dashboard–code pairs demonstrate that current models exhibit limited performance on highly complex dashboards, with closed-source models significantly outperforming their open-source counterparts.
πŸ“ Abstract
Automatic data visualization generation has advanced rapidly with multi-modal large language models, yet existing efforts largely focus on static charts and overlook the interactive dashboards commonly used for real-world data exploration. We introduce Dashboard2Code, a novel task that requires a model to proactively explore an interactive dashboard, acquire and integrate feedback from its own interactions (e.g., clicking and filtering), and generate code that reproduces the target dashboard. To support comprehensive evaluation, we present DashboardMimic, the first Plotly+Dash benchmark for Dashboard2Code, comprising 180 carefully designed and manually verified dashboard-code pairs spanning three difficulty levels and covering eight common real-world interaction patterns. We further propose an automated evaluation framework tailored to dashboards that combines code semantic analysis with dynamic interaction-based testing to assess visual and interaction consistency, showing strong agreement with human judgments. Experiments across a range of open- and closed-source multi-modal models reveal that even the strongest systems struggle on high-complexity dashboards and that a substantial performance gap remains between open-source and closed-source models on the Dashboard2Code task.
Problem

Research questions and friction points this paper is trying to address.

interactive dashboards
data visualization
multimodal models
code generation
evaluation benchmark
Innovation

Methods, ideas, or system contributions that make the work stand out.

Dashboard2Code
interactive dashboards
multimodal models
code generation
automated evaluation
T
Tianhao Niu
Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology, China
Z
Ziyu Han
Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology, China
Qiguang Chen
Qiguang Chen
Harbin Institute of Technology
Chain-of-ThoughtReasoningMultilingual LLMMulti-modal LLM
S
Shiqi Zhou
Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology, China
B
Baocai Shan
Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology, China
H
Hengjie Fang
Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology, China
Qingfu Zhu
Qingfu Zhu
Harbin Institute of Technology
NLPCode LLM
Wanxiang Che
Wanxiang Che
Professor of Harbin Institute of Technology
Natural Language Processing