🤖 AI Summary
Traditional wildlife morphometric analysis relies on controlled images or physical specimens, limiting its scalability to large populations. This work proposes a general-purpose framework that requires no species-specific training: given only a single standard reference image provided by the user, it leverages foundation model features for pose-aware retrieval, transfers anatomical landmark correspondences via dense patch matching, and estimates population-level body proportion distributions from vast collections of unconstrained web images through geometric consistency filtering and robust aggregation strategies. The method achieves, for the first time, cross-species morphometric estimation across diverse taxa—including birds, amphibians, insects, and even flowers—with median relative errors of 10–20% on three benchmark datasets, substantially enhancing scalability and applicability in ecological and evolutionary studies.
📝 Abstract
Population-level morphometric measurements underpin ecological and evolutionary studies but traditionally require controlled imaging or physical specimen handling, limiting scalability. We present WildProp, a training-free framework that estimates wildlife body proportion distributions directly from large-scale, unconstrained image repositories. We cast morphometric estimation as a retrieval-driven correspondence problem: given a single user-annotated canonical image, WildProp performs pose-aware retrieval using foundation model features, transfers part endpoints via dense patch-level matching, filters predictions using geometric consistency, and aggregates measurements across retrieved images to estimate population-level ratio distributions. Unlike supervised keypoint pipelines, our approach adapts to arbitrary species and user-defined parts without per-species training. Evaluations on three large morphometric datasets spanning birds and amphibians show median relative errors of 10-20%. We further highlight the broad applicability of our approach through a number of case studies measuring various proportions across diverse taxa, including birds, frogs, insects, and flowers. Ablations demonstrate that pose-aware retrieval is critical for stable estimation, while robust aggregation mitigates keypoint and pose noise. Our results indicate that carefully curated 2D correspondences over web-scale imagery can provide scalable morphometric proxies for comparative and subgroup analyses across taxa, geography, and seasonality.