Target-Language Generation in Multilingual Models: Activation Steering and Optimal Control

2026-09-15

AI Summary

本文针对多语言模型生成特定目标语言连贯文本的问题，提出了一种最优控制方法，并开发了评估生成文本质量的框架。

Abstract

Ensuring that multilingual language models generate coherent text in a specific target language is a major issue in multilingual language modeling. We develop an optimal control method for target-language text generation as well as a framework for evaluating the quality of generated text in terms of language adherence, linguistic coherence, and semantic coherence. We find that the proposed method performs at least as well as the prominent difference-in-means activation steering method for the majority of models tested, with substantially less hyperparameter tuning required.

Problem

• multilingual language models
• target-language text generation
• language adherence
• linguistic coherence
• semantic coherence

Innovation

• optimal control
• target-language generation
• multilingual models
• activation steering