Dynamic Adaptive Optimization for Effective Sentiment Analysis Fine-Tuning on Large Language Models

📅 2024-08-15
🏛️ arXiv.org
📈 Citations: 2
Influential: 0
📄 PDF

career value

179K/year
🤖 AI Summary
To address performance limitations in fine-tuning large language models (LLMs) for sentiment analysis—arising from heterogeneous task complexity and static multi-task weighting—this paper proposes a dynamic adaptive optimization framework. The core method introduces a novel task-aware dynamic weighting loss mechanism that automatically adjusts multi-task learning weights in real time based on input data characteristics and task importance. Designed modularly, the framework supports plug-and-play integration. Experiments on both standard and custom financial text datasets demonstrate significant improvements over baseline methods: mean squared error (MSE) decreases by 15.58%, and classification accuracy increases by 1.24%. These results validate the framework’s superior domain adaptability and generalization capability, particularly in complex, heterogeneous sentiment analysis scenarios.

Technology Category

Application Category

📝 Abstract
Sentiment analysis plays a crucial role in various domains, such as business intelligence and financial forecasting. Large language models (LLMs) have become a popular paradigm for sentiment analysis, leveraging multi-task learning to address specific tasks concurrently. However, LLMs with fine-tuning for sentiment analysis often underperforms due to the inherent challenges in managing diverse task complexities. Moreover, constant-weight approaches in multi-task learning struggle to adapt to variations in data characteristics, further complicating model effectiveness. To address these issues, we propose a novel multi-task learning framework with a dynamic adaptive optimization (DAO) module. This module is designed as a plug-and-play component that can be seamlessly integrated into existing models, providing an effective and flexible solution for multi-task learning. The key component of the DAO module is dynamic adaptive loss, which dynamically adjusts the weights assigned to different tasks based on their relative importance and data characteristics during training. Sentiment analyses on a standard and customized financial text dataset demonstrate that the proposed framework achieves superior performance. Specifically, this work improves the Mean Squared Error (MSE) and Accuracy (ACC) by 15.58% and 1.24% respectively, compared with previous work.
Problem

Research questions and friction points this paper is trying to address.

Optimizing sentiment analysis fine-tuning on large language models
Addressing challenges in multi-task learning for diverse tasks
Improving model performance with dynamic adaptive optimization
Innovation

Methods, ideas, or system contributions that make the work stand out.

Dynamic adaptive optimization for multi-task learning
Plug-and-play DAO module for existing models
Dynamic adaptive loss adjusts task weights
🔎 Similar Papers
No similar papers found.
H
Hongcheng Ding
INTI International University, Malaysia
X
Xuanze Zhao
Zhejiang University of Finance and Economics Dongfang College, China
S
Shamsul Nahar Abdullah
INTI International University, Malaysia
D
Deshinta Arova Dewi
INTI International University, Malaysia
Z
Zixiao Jiang
Chinese Academy of Medical Sciences and Peking Union Medical College, China