A New Transformer-Based Approach for Audio-Based Kinship Verification and a New Uncontrolled Mandarin Kinship Speech Dataset

2026-09-12

AI Summary

本文提出了一种基于Transformer的新方法CONVTRAP-TN，用于音频亲属关系验证，并收集了一个新的普通话亲属语音数据集ARKIN，以解决现有数据集无法反映真实录音条件的问题。

Abstract

Kinship verification is a task involving determining whether two individuals share a first-order kin relation. To tackle this task, we propose CONVTRAP-TN, a new architecture for audio-based kinship verification, and conduct an ablation study on the proposed model. To the best of our knowledge, we are the first to apply the successful transformer architecture to the task of audio-based kinship verification. Furthermore, we also collect a custom speech dataset, ARKIN, which accurately reflects everyday recording conditions. We do this because only a few speech datasets with kinship labels currently exist, all of which either source extremely noisy in-the-wild data from the internet, or instruct speakers to record in specific environments. These settings fail to reflect real-world scenarios where users record on personal devices under unrestrained conditions. Additionally, we perform a series of preliminary baseline experiments on the collected dataset, including speaker verification and recognition, speech recognition, age estimation, and kinship verification, as well as cross-dataset kinship verification experiments to show that existing methods are not robust across datasets.

Problem

• audio-based kinship verification
• speech dataset
• real-world scenarios

Innovation

• Transformer
• audio-based kinship verification
• CONVTRAP-TN
• ARKIN dataset