Voting-based Pitch Estimation with Temporal and Frequential Alignment and Correlation Aware Selection

2026-02-02

AI Summary

This work addresses the limited robustness of fundamental frequency (F0) estimation and voicing detection in noisy environments by proposing an ensemble method based on multi-estimator voting fusion. The core innovations include a time–frequency alignment mechanism to correct temporal and spectral discrepancies across individual estimators, and a greedy subset selection strategy guided by error correlation to construct a compact yet complementary set of estimators. Theoretical justification for the voting mechanism is provided through Condorcet’s Jury Theorem. Experimental results demonstrate that the proposed approach consistently outperforms state-of-the-art single models across speech, singing, and music datasets, achieving higher F0 estimation accuracy under clean conditions while maintaining reliable voicing detection even in high-noise scenarios.

Technology Category

• Machine Learning: Ensemble Methods
• Intelligent Robots: State Estimation
• Natural Language Processing: Fact-Checking / Misinformation Detection (NLP Focus)

Application Category

• Web Mining and Content Analysis: Robustness and generalizability of Web mining methods
• User Modeling, Personalization and Recommendation: Attacks and countermeasures in recommendation systems
• Semantics and Knowledge: Methods to enhance, augment, integrate or synergize semantic models such as knowledge graphs and LLMs

Abstract

The voting method, an ensemble approach for fundamental frequency estimation, is empirically known for its robustness but lacks thorough investigation. This paper provides a principled analysis and improvement of this technique. First, we offer a theoretical basis for its effectiveness, explaining the error variance reduction for fundamental frequency estimation and invoking Condorcet's jury theorem for voiced/unvoiced detection accuracy. To address its practical limitations, we propose two key improvements: 1) a pre-voting alignment procedure to correct temporal and frequential biases among estimators, and 2) a greedy algorithm to select a compact yet effective subset of estimators based on error correlation. Experiments on a diverse dataset of speech, singing, and music show that our proposed method with alignment outperforms individual state-of-the-art estimators in clean conditions and maintains robust voiced/unvoiced detection in noisy environments.

Problem

• pitch estimation
• voting method
• fundamental frequency
• voiced/unvoiced detection
• error correlation

Innovation

• voting-based pitch estimation
• temporal and frequential alignment
• correlation-aware estimator selection
• fundamental frequency estimation
• voiced/unvoiced detection