Transition Network Analysis: A Novel Framework for Modeling, Visualizing, and Identifying the Temporal Patterns of Learners and Learning Processes

2024-11-23

arXiv.org

AI Summary

This paper addresses three key challenges in modeling collaborative learning: difficulty in capturing temporal behavioral patterns, weak visualization capabilities, and low robustness in identifying critical events. To tackle these, we propose the Transition Network Analysis (TNA) framework—a novel probabilistic graphical model that unifies relational structure and temporal dynamics. TNA integrates stochastic process mining with multilayer network analysis, enabling centrality computation, community detection, and temporal clustering. A key innovation is the introduction of a Bootstrap-based transition significance test, which effectively filters spurious transitions. Evaluated on real-world collaborative learning data from 191 students, TNA successfully characterizes the dynamic evolution of regulatory processes, accurately identifies critical learning events and behavior clusters, and significantly enhances both the reliability and interpretability of temporal pattern analysis.

Technology Category

• Reasoning under Uncertainty: Relational Probabilistic Models
• Data Mining & Knowledge Management: Graph Mining, Social Network Analysis & Community
• Machine Learning: Causal Learning

Application Category

• Graph Algorithms and Modeling for the Web: Algorithms and analysis for heterogeneous, signed, attributed, multi-relational, temporal, higher-order, and annotated Web-related graphs
• Web Mining and Content Analysis: Models for Web evolution
• Semantics and Knowledge: Methods to enhance, augment, integrate or synergize semantic models such as knowledge graphs and LLMs

Abstract

This paper presents a novel learning analytics method: Transition Network Analysis (TNA), a method that integrates Stochastic Process Mining and probabilistic graph representation to model, visualize, and identify transition patterns in the learning process data. Combining the relational and temporal aspects into a single lens offers capabilities beyond either framework, including centralities to capture important learning events, community detection to identify behavior patterns, and clustering to reveal temporal patterns. Furthermore, TNA introduces several significance tests that go beyond either method and add rigor to the analysis. Here, we introduce the theoretical and mathematical foundations of TNA and we demonstrate the functionalities of TNA with a case study where students (n=191) engaged in small-group collaboration to map patterns of group dynamics using the theories of co-regulation and socially-shared regulated learning. The analysis revealed that TNA can map the regulatory processes as well as identify important events, patterns, and clusters. Bootstrap validation established the significant transitions and eliminated spurious transitions. As such, TNA can capture learning dynamics and provide a robust framework for investigating the temporal evolution of learning processes. Future directions include -- inter alia -- expanding estimation methods, reliability assessment, and building longitudinal TNA.

Problem

• Modeling temporal patterns in learning processes
• Visualizing student and learning dynamics
• Identifying significant learning events and clusters

Innovation

• Stochastic Process Mining integration
• Probabilistic graph representation
• Bootstrap validation significance