Counting Without Numbers \& Finding Without Words

2026-03-25

AI Summary

This work addresses the critical limitation of existing pet-recovery systems, which rely solely on visual matching and neglect the biological reality that many animals primarily recognize conspecifics through vocal cues—resulting in a failure to recover up to 70% of lost pets. To bridge this gap, we propose the first multimodal recovery system that integrates visual and acoustic biometric features. Drawing on insights from animal cognitive science, our approach incorporates mechanisms of approximate number sense and voiceprint recognition, enabling species-adaptive acoustic processing across a broad frequency range (10 Hz–4 kHz). Additionally, we design a probabilistic visual matching algorithm robust to stress-induced appearance variations. By moving beyond the “silent” modeling paradigm of conventional computer vision for vocal species, our method significantly enhances recovery efficacy and offers a biologically grounded technological framework aligned with animals’ natural communication modalities.

Technology Category

• Computer Vision: Multi-modal Vision
• Machine Learning: Multimodal Learning
• Intelligent Robots: Multimodal Perception & Sensor Fusion

Application Category

• Search and Retrieval-Augmented AI: Multilingual and cross-lingual Web search
• Web Mining and Content Analysis: Mining multimedia, multimodal, multilingual, cross-lingual Web data
• Graph Algorithms and Modeling for the Web: Representation, reconstruction, and subgraph or motif discovery in Web-related graphs

Abstract

Every year, 10 million pets enter shelters, separated from their families. Despite desperate searches by both guardians and lost animals, 70% never reunite, not because matches do not exist, but because current systems look only at appearance, while animals recognize each other through sound. We ask, why does computer vision treat vocalizing species as silent visual objects? Drawing on five decades of cognitive science showing that animals perceive quantity approximately and communicate identity acoustically, we present the first multimodal reunification system integrating visual and acoustic biometrics. Our species-adaptive architecture processes vocalizations from 10Hz elephant rumbles to 4kHz puppy whines, paired with probabilistic visual matching that tolerates stress-induced appearance changes. This work demonstrates that AI grounded in biological communication principles can serve vulnerable populations that lack human language.

Problem

• animal reunification
• acoustic biometrics
• visual matching
• species communication
• lost pets

Innovation

• multimodal biometrics
• acoustic recognition
• species-adaptive AI
• probabilistic visual matching
• animal communication