Problem
Research questions and friction points this paper is trying to address.
AI-generated text detection
Indic languages
robustness
domain shift
adversarial perturbation
IndicDetect: Evaluating Cross-Lingual LLM-Generated Text Detection for Hindi, Telugu, and Tamil
🤖 AI Summary
本文针对印地语、泰卢固语和泰米尔语中AI生成文本检测的鲁棒性问题，提出IndicDetect基准，通过统计和神经检测器评估其在不同分布、生成器及对抗扰动下的表现。
📝 Abstract
The rapid proliferation of LLMs has further heightened the need to develop dependable AI-generated text detection, especially beyond English. Nevertheless, current benchmarks pay little attention to Indic languages and test detectors in idealized settings that do not represent the real world. We present a generalized benchmark for AI-generated text detection in Hindi, Telugu, and Tamil, which we call IndicDetect, designed to assess the robustness of detectors under realistic distribution shifts. IndicDetect comprises highly curated human-written texts matched with LLM-generated counterparts across various domains and generators, and systematically evaluates detectors in the presence of domain shift, generator shift, and adversarial perturbation. Using a single and repeatable evaluation scheme, we evaluate a wide range of statistical and neural detectors. We find substantial robustness failures: supervised neural detectors perform well in-distribution, while training-free methods degrade considerably under unseen generators and adversarial attacks. The severity of these failures varies across languages, with Hindi exhibiting the largest overall degradation under adversarial perturbations. These results highlight that the primary weakness of existing detectors in Indic settings lies in their robustness, not in their peak accuracy. IndicDetect provides standard data splits, an evaluation protocol, and baselines to establish a robust, language-aware foundation for AI-generated text detection in Indic scripts.
Innovation
Methods, ideas, or system contributions that make the work stand out.
Cross-Lingual LLM-Generated Text Detection
Robustness under Realistic Distribution Shifts
Indic Languages
🔎 Similar Papers
No similar papers found.
