Automated Sentiment Classification and Topic Discovery in Large-Scale Social Media Streams

2025-05-03

AI Summary

To address the challenge of analyzing sentiment and thematic dynamics in large-scale Twitter streams during geopolitical conflicts, this paper proposes a sentiment–metadata joint-partitioning topic modeling framework. Our method integrates ensemble sentiment labeling from multiple pretrained models and metadata-aware LDA modeling—grouped along temporal, geographic, and sentiment dimensions—and implements an interactive spatiotemporal visualization system powered by D3.js. The key innovation lies in explicitly incorporating predicted sentiment labels into the prior structure of topic modeling, thereby strengthening interpretable associations between sentiment and topics. Evaluated on real-world conflict-related Twitter data, our approach achieves sentiment classification F1-scores ≥ 0.89, successfully identifies temporally evolving topic clusters, and enables cross-regional analysis of sentiment–topic co-dynamics. This significantly enhances both the depth and interpretability of social舆情 understanding under dynamic contextual conditions.

Technology Category

• Natural Language Processing: Sentiment Analysis, Stylistic Analysis, and Argument Mining
• Knowledge Representation and Reasoning: Geometric, Spatial, and Temporal Reasoning
• Data Mining & Knowledge Management: Mining of Spatial, Temporal or Spatio-Temporal Data

Application Category

• Web Mining and Content Analysis: Sentiment analysis and opinion mining
• Search and Retrieval-Augmented AI: Web query analysis, representation and understanding
• Graph Algorithms and Modeling for the Web: Algorithms and analysis for heterogeneous, signed, attributed, multi-relational, temporal, higher-order, and annotated Web-related graphs

Abstract

We present a framework for large-scale sentiment and topic analysis of Twitter discourse. Our pipeline begins with targeted data collection using conflict-specific keywords, followed by automated sentiment labeling via multiple pre-trained models to improve annotation robustness. We examine the relationship between sentiment and contextual features such as timestamp, geolocation, and lexical content. To identify latent themes, we apply Latent Dirichlet Allocation (LDA) on partitioned subsets grouped by sentiment and metadata attributes. Finally, we develop an interactive visualization interface to support exploration of sentiment trends and topic distributions across time and regions. This work contributes a scalable methodology for social media analysis in dynamic geopolitical contexts.

Problem

• Large-scale sentiment analysis of Twitter discourse
• Topic discovery using Latent Dirichlet Allocation (LDA)
• Interactive visualization of sentiment trends and topics

Innovation

• Targeted data collection using conflict-specific keywords
• Automated sentiment labeling via multiple pre-trained models
• Latent Dirichlet Allocation (LDA) for latent theme identification