Flowco: Rethinking Data Analysis in the Age of LLMs

2025-04-18

AI Summary

In data science practice, while large language models (LLMs) can automatically generate analytical code, they lack support for fine-grained control, intermediate result validation, and iterative optimization—compromising analysis controllability, verifiability, and reproducibility. To address this, we propose Flowco: a hybrid, proactive visual dataflow programming framework that uniquely embeds LLMs throughout the entire analytical workflow—spanning code generation, debugging, validation, and iteration. Flowco integrates visual dataflow modeling, LLM-augmented collaborative reasoning, and traceable execution graphs. A user study demonstrates that Flowco significantly improves novices’ efficiency in constructing, debugging, and optimizing analytical tasks, while preserving usability and simultaneously ensuring controllability, verifiability, and reproducibility. By unifying human-in-the-loop interaction with LLM intelligence in a structured, auditable environment, Flowco establishes a novel paradigm for democratizing data science in the LLM era.

Technology Category

• Machine Learning: Large Multimodal Models (LMMs)
• Natural Language Processing: Code Generation / Program Synthesis from Natural Language
• Data Mining & Knowledge Management: Data Visualization & Summarization

Application Category

• Semantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactions
• Economics, Online Markets and Human Computation: Humans versus LLMs for data annotation and labeling
• Graph Algorithms and Modeling for the Web: Foundation models and LLMs for Web-related graphs

Abstract

Conducting data analysis typically involves authoring code to transform, visualize, analyze, and interpret data. Large language models (LLMs) are now capable of generating such code for simple, routine analyses. LLMs promise to democratize data science by enabling those with limited programming expertise to conduct data analyses, including in scientific research, business, and policymaking. However, analysts in many real-world settings must often exercise fine-grained control over specific analysis steps, verify intermediate results explicitly, and iteratively refine their analytical approaches. Such tasks present barriers to building robust and reproducible analyses using LLMs alone or even in conjunction with existing authoring tools (e.g., computational notebooks). This paper introduces Flowco, a new mixed-initiative system to address these challenges. Flowco leverages a visual dataflow programming model and integrates LLMs into every phase of the authoring process. A user study suggests that Flowco supports analysts, particularly those with less programming experience, in quickly authoring, debugging, and refining data analyses.

Problem

• Enabling non-experts to conduct data analyses using LLMs
• Providing fine-grained control and verification in analysis steps
• Supporting iterative refinement of data analysis workflows

Innovation

• Visual dataflow programming model integration
• LLMs embedded in all authoring phases
• Supports debugging and refining analyses