Problem
Research questions and friction points this paper is trying to address.
Person Re-Identification
Multi-Camera Surveillance
Viewpoint Changes
Illumination Variations
Occlusion
A Generative AI Integrated Multimodal Framework for Low-Latency Multi-Camera Person Re-Identification
๐ค AI Summary
ๆฌๆๆๅบไธ็ง้ๆ็ๆAI็ๅคๆจกๆๆกๆถ๏ผ็จไบ่งฃๅณๅคๆๅๅคด่กไบบ้่ฏๅซไธญ็ไฝๅปถ่ฟ้ฎ้ข๏ผ้่ฟๆๆฌๆ็ฅ็ๆๅ้ๅบ็บง่ๆนๆณไผๅๅ็กฎๆงๅๅปถ่ฟใ
๐ Abstract
Person re-identification (ReID) is essential for multi-camera surveillance and tracking, yet remains difficult due to viewpoint and illumination changes, occlusion, background clutter, and low resolution imagery. We propose a generative AI integrated multimodal ReID framework designed explicitly for robustness under missing cues and low latency deployment. The key idea is a cost aware early-exit cascade that prioritizes inexpensive, high confidence evidence and only triggers expensive modalities for ambiguous cases.
Our system integrates (i) global visual embeddings from segmented person regions, (ii) automatically generated fine grained semantic attribute descriptions generated by vision-language models (VLMs), and (iii) optional facial embeddings when face observations are reliable. To optimize the balance between accuracy and latency, we use a cost aware early-exit cascade instead of fusing all modalities. Specifically, we first inspect the top-k retrieval results to determine whether the query is unambiguous. If the best match is clearly separated from the remaining candidates, we stop early and return the result to minimize latency; in ambiguous cases, we keep multiple hypotheses and invoke additional modalities (face/semantic) with adaptive reliability weighting to refine the decision.
We report person re-identification performance using mAP and Rank-1 accuracy on the Market-1501 and DukeMTMC-reID benchmarks. The proposed adaptive early-exit cascade resolves 60.7% of DukeMTMC-reID queries and 68.4% of Market-1501 queries without invoking semantic reasoning, reducing computational overhead while maintaining competitive retrieval performance.
Innovation
Methods, ideas, or system contributions that make the work stand out.
cost aware early-exit cascade
generative AI integrated multimodal framework
low-latency multi-camera person re-identification
๐ Similar Papers
No similar papers found.
