Discovering "Words" in Music: Unsupervised Learning of Compositional Sparse Code for Symbolic Music

2025-09-29

AI Summary

Unsupervised discovery of “music words”—reusable, structurally coherent musical fragments—in symbolic music remains challenging due to inherent semantic ambiguity. Method: We propose a sparse coding–based statistical modeling framework that formalizes music word discovery as an optimization problem minimizing total encoding length, thereby aligning with human perceptual coding principles and mitigating ambiguity. Our approach employs a two-stage EM algorithm integrating sparse representation learning with pattern dictionary learning, enabling interpretable decomposition and reconstruction of musical sequences. Contribution/Results: Evaluated on a multi-style dataset, the discovered music words achieve an IoU of 0.61 against expert annotations and demonstrate strong cross-style generalization. Beyond providing interpretable, structure-aware priors for music generation, classification, and style transfer, this work establishes the first information-compression–driven paradigm for structural analysis in computational musicology.

Technology Category

• Machine Learning: Representation Learning
• Cognitive Modeling & Cognitive Systems: Neural Spike Coding
• Natural Language Processing: Learning & Optimization for NLP

Application Category

• Graph Algorithms and Modeling for the Web: Representation, reconstruction, and subgraph or motif discovery in Web-related graphs
• Web Mining and Content Analysis: Robustness and generalizability of Web mining methods
• Semantics and Knowledge: Methods, algorithms and applications for the development of semantic models, knowledge graphs and other forms of structured data models with machine-interpretable semantics

Abstract

This paper presents an unsupervised machine learning algorithm that identifies recurring patterns -- referred to as ``music-words'' -- from symbolic music data. These patterns are fundamental to musical structure and reflect the cognitive processes involved in composition. However, extracting these patterns remains challenging because of the inherent semantic ambiguity in musical interpretation. We formulate the task of music-word discovery as a statistical optimization problem and propose a two-stage Expectation-Maximization (EM)-based learning framework: 1. Developing a music-word dictionary; 2. Reconstructing the music data. When evaluated against human expert annotations, the algorithm achieved an Intersection over Union (IoU) score of 0.61. Our findings indicate that minimizing code length effectively addresses semantic ambiguity, suggesting that human optimization of encoding systems shapes musical semantics. This approach enables computers to extract ``basic building blocks'' from music data, facilitating structural analysis and sparse encoding. The method has two primary applications. First, in AI music, it supports downstream tasks such as music generation, classification, style transfer, and improvisation. Second, in musicology, it provides a tool for analyzing compositional patterns and offers insights into the principle of minimal encoding across diverse musical styles and composers.

Problem

• Identifies recurring patterns in symbolic music data
• Addresses semantic ambiguity through statistical optimization
• Enables structural analysis and sparse encoding of music

Innovation

• Unsupervised learning algorithm identifies musical patterns
• Two-stage EM framework optimizes music-word discovery
• Minimizing code length resolves musical semantic ambiguity