Sensing Your Vocals: Exploring the Activity of Vocal Cord Muscles for Pitch Assessment Using Electromyography and Ultrasonography

2026-03-20

AI Summary

This study addresses the challenge in vocal training that laryngeal muscles governing pitch, resonance, and phonation are not directly observable, hindering learners’ precise perception and control. To overcome this, the research presents the first systematic integration of electromyography (EMG) and ultrasound imaging to visualize vocal fold muscle activity, establishing a novel physiology-based feedback mechanism for vocal pedagogy. A reference visualization system was developed using data from 16 singers and evaluated through audio analysis, user studies, and focus groups. The system’s efficacy was validated by 12 novice singers, while 15 experienced vocalists affirmed the significant potential of EMG-informed feedback to enhance skill acquisition and refine vocal instruction.

Technology Category

• Cognitive Modeling & Cognitive Systems: Affective Computing
• Natural Language Processing: Speech
• Intelligent Robots: Multimodal Perception & Sensor Fusion

Application Category

• User Modeling, Personalization and Recommendation: User modeling and simulation for interactive and conversational systems
• Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for ranking
• Responsible Web: Machine-in-the-loop, human agency and autonomy

Abstract

Vocal training is difficult because the muscles that control pitch, resonance, and phonation are internal and invisible to learners. This paper investigates how Electromyography (EMG) and ultrasonic imaging (UI) can make these muscles observable for training purposes. We report three studies. First, we analyze the EMG and UI data from 16 singers (beginners, experienced & professionals), revealing differences among three vocal groups of the muscle control proficiency. Second, we use the collected data to create a system that visualizes an expert's muscle activity as reference. This system is tested in a user study with 12 novices, showing that EMG highlighted muscle activation nuances, while UI provided insights into vocal cord length and dynamics. Third, to compare our approach to traditional methods (audio analysis and coach instructions), we conducted a focus group study with 15 experienced singers. Our results suggest that EMG is promising for improving vocal skill development and enhancing feedback systems. We conclude the paper with a detailed comparison of the analyzed modalities (EMG, UI and traditional methods), resulting in recommendations to improve vocal muscle training systems.

Problem

• vocal training
• pitch control
• muscle observation
• invisible muscles
• vocal cord muscles

Innovation

• Electromyography
• Ultrasonography
• Vocal training
• Muscle activity visualization
• Multimodal feedback