Problem
Research questions and friction points this paper is trying to address.
synthesized dialogue dataset
full-duplex behaviors
expressive speech
sound events
DuplexDrama: A Synthesized Dialogue Dataset with Scenarios, Full-Duplex Behaviors, Expressive Speech, and Sound Events
🤖 AI Summary
为解决全双工对话模型数据不足的问题，通过构建包含情景、行为、情感和声音事件的DuplexDrama合成对话数据集来提供支持。
📝 Abstract
We present DuplexDrama, the first synthesized spoken dialogue dataset that simultaneously covers four dimensions: (i) complete persona and scenario settings; (ii) three full-duplex behaviors (interruption, backchannel, incomplete); (iii) expressive speech with persona-aligned emotion labels; and (iv) script-aware sound events. DuplexDrama is built via a 4-stage pipeline; quality validation on both scripts and synthesized audio confirms its quality. We have produced more than 2,000 hours audio data with a 64-voice timbre pool spanning 13 personas and 5 age buckets; 3.8% of all turns carry at least one full-duplex behavior. This data has been validated through internal full-duplex model training. We will release a curated subset of 6,400 bilingual dialogues (800 h, Chinese ~500 h + English ~300 h) to advance full-duplex spoken dialogue model research. Data samples are available at our demo page and LLM-judge evaluation prompts will be released with the dataset.
Innovation
Methods, ideas, or system contributions that make the work stand out.
full-duplex behaviors
expressive speech
script-aware sound events
🔎 Similar Papers
No similar papers found.
