CVSS-X: A Multilingual Speech-to-Speech Translation Corpus for 28 Languages

📅 2026-09-11
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
为解决多语言语音到语音翻译问题,本文通过反向翻译扩展CVSS,创建了包含28种目标语言的大型合成语料库CVSS-X。
📝 Abstract
We introduce CVSS-X, a large-scale synthetic speech-to-speech translation corpus that extends CVSS by reversing the translation direction. While CVSS translates from 21 languages into English, CVSS-X enables translation from English into 28 target languages spanning 12 language families. The corpus comprises approximately 240,000 parallel speech pairs per language, totaling over 16,000 hours, eight times larger than CVSS. We provide two variants: CVSS-X-C with two canonical voices per language, and CVSS-X-T with cross-lingual voice cloning, both fully generated. Evaluation shows comparable translation quality to CVSS with consistent performance across typologically diverse languages. Combined with CVSS, this enables research on bidirectional and multilingual speech-to-speech translation. The code is available at https://github.com/ErmisAI/XVSS-X and the dataset under CC-BY-NC 4.0 license at https://huggingface.co/datasets/lgris/XVSS-X.
Problem

Research questions and friction points this paper is trying to address.

speech-to-speech translation
multilingual
corpus
Innovation

Methods, ideas, or system contributions that make the work stand out.

multilingual speech-to-speech translation
cross-lingual voice cloning
large-scale corpus
💼 Related Jobs
No related jobs found.
L
Lucas Rafael Stefanel Gris
Federal University of Goiás, Goiânia, Brazil
Alef Iury Siqueira Ferreira
Alef Iury Siqueira Ferreira
Universidade Federal de Goiás
Machine LearningDeep LearningSpeech RecognitionBioacousticsNatural Language Processing
F
Frederico Santos de Oliveira
Federal University of Mato Grosso, Cuiabá, Brazil
A
Augusto Seben da Rosa
São Paulo State University, São Paulo, Brazil
A
Alexandre Costa Ferro Filho
Federal University of Goiás, Goiânia, Brazil
A
Arlindo Rodrigues Galvão Filho
Federal University of Goiás, Goiânia, Brazil
Anderson da Silva Soares
Anderson da Silva Soares
Deep Learning Brazil at Federal University of Goias.
Deep LearningPattern Recognition and Artificial Intelligence