SVLAT: Scientific Visualization Literacy Assessment Test

2026-03-19

AI Summary

This study addresses the current lack of standardized instruments for assessing public scientific visualization literacy by developing and validating the Scientific Visualization Literacy Assessment Test (SVLAT), the first psychometrically grounded measure of its kind. The SVLAT encompasses eight visualization types and eleven cognitive tasks, resulting in a 49-item instrument refined through a multi-stage development process. Item selection and scale optimization were guided by content validity ratio (CVR) analyses, classical test theory (CTT), and item response theory (IRT). Evaluated on a sample of 485 participants, the SVLAT demonstrated strong reliability (McDonald’s ωₜ = 0.82; Cronbach’s α = 0.81). The assessment materials have been publicly released to support research and practice in public science communication and education.

Technology Category

• Computer Vision: Language and Vision
• Data Mining & Knowledge Management: Data Visualization & Summarization
• Knowledge Representation and Reasoning: Geometric, Spatial, and Temporal Reasoning

Application Category

• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics
• Web Mining and Content Analysis: Web data visualization
• Security and Privacy: Large-scale security measurements

Abstract

Scientific visualization (SciVis) has become an essential means for exploring, understanding, and communicating complex scientific phenomena. However, the field still lacks a validated instrument assessing how well people read, understand, and interpret them. We present a scientific visualization literacy assessment test (SVLAT) that measures the general public's SciVis literacy. Covering a range of visualization forms and interpretation demands, SVLAT comprises 49 items grounded in 18 scientific visualizations and illustrations spanning eight visualization techniques and 11 tasks. Instrument development followed a staged, psychometrically grounded pipeline. We defined the construct and blueprint, followed by item generation, and expert review with five SciVis experts using the content validity ratio (mean CVR = 0.79). We subsequently administered a pilot test (30 participants) and a large-scale test tryout (485 participants) to evaluate the instrument's psychometric properties. For validation, we performed item analysis and refinement using both classical test theory (CTT) and item response theory (IRT) to examine item functioning and overall test quality. SVLAT demonstrates high reliability in the tryout sample (McDonald's omega_t = 0.82, Cronbach's alpha = 0.81). The assessment materials are available at https://osf.io/hr3nw/.

Problem

• scientific visualization
• visualization literacy
• assessment instrument
• psychometric validation

Innovation

• scientific visualization literacy
• assessment instrument
• psychometric validation
• item response theory
• visualization comprehension