SmartIterator: Visual Analytics Workflows for Supervising Unsupervised Data Grouping

2026-05-27

AI Summary

This study addresses the lack of systematic guidance in parameter selection and result evaluation for unsupervised data grouping methods by proposing SmartIterator, an exploratory framework grounded in a six-stage visual analytics pipeline. The approach uniquely treats the complete sequence of groupings generated through parameter sweeps as the primary analytical object, integrating quality metrics, stability assessments, member confidence scores, and domain context to deliver method-specific, actionable workflows for tasks such as clustering and topic modeling. Implemented via the IteraScope visualization system—which features semantic color encoding, group embeddings, Sankey transition flows, violin plots, and repeated prototype detection using HDBSCAN—the framework demonstrates its efficacy across three diverse datasets: social media, regional statistics, and academic publications, enabling analysts to comprehensively interpret data structures and make informed decisions.

Abstract

Unsupervised learning methods -- topic modeling, partition-based and density-based clustering -- produce data groupings without human guidance, yet choosing and evaluating those groupings should not itself be unsupervised. We present \emph{SmartIterator}~(SI), a visual analytics approach that treats the full sequence of grouping results across a parameter sweep as a first-class analytical object. For each method family, SI provides a structured six-phase workflow that guides the analyst through systematic exploration of grouping results -- from quality-metric overview through transition-stability assessment, membership-confidence evaluation, content and context inspection, and recurrent-archetype verification to an informed decision -- building cumulative understanding of data structure along the way. The workflows are operationalized through \emph{IteraScope}~(IS), a coordinated visual display combining quality-metric charts with semantic color encoding, a 1D group embedding with Sankey-style transition flows and violin plots of membership confidence, a 2D group embedding with HDBSCAN-detected recurrent archetypes that highlights iterations capturing all persistent patterns, and domain-specific linked views for contextualized interpretation. We demonstrate the three workflows on: (1)~simulated social-media messages from the VAST Challenge 2011 (density-based clustering, validated against ground truth), (2)~EU population statistics across ${\sim}1\,500$ NUTS-3 regions (partition-based clustering), and (3)~30 years of IEEE VIS papers (NMF topic modeling). The workflows constitute the main contribution: they provide actionable, method-specific guidance for navigating parameter spaces, studying how data structure evolves across configurations, and grounding analytical understanding in domain context -- yielding knowledge about the data that no single ``best'' result can provide.

Problem

• unsupervised learning
• data grouping
• visual analytics
• parameter sweep
• clustering evaluation

Innovation

• visual analytics
• unsupervised learning
• parameter sweep
• grouping stability
• IteraScope