TopoRig: Topology-Agnostic Facial Rigging via Multi-Source Supervision

📅 2026-09-14
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文提出TopoRig,通过多源监督在保持原始拓扑结构的同时预测FACS条件下的变形,解决跨异构网格拓扑的自动面部装备问题。
📝 Abstract
Automatic facial rigging across heterogeneous mesh topologies remains challenging because high-quality expression supervision is often tied to canonical templates, while deformation transfer to arbitrary meshes can introduce geometric artifacts and correspondence errors. We present TopoRig, a topology-agnostic facial rigging framework that predicts FACS-conditioned deformations directly on input mesh vertices while preserving the original topology. Starting from the ICT FaceKit expression model, we construct complementary supervision from accurate but template-biased common-topology rigs, topology-diverse but noisier transferred rigs, and targeted image-based cues for controls poorly captured by geometric transfer. TopoRig combines local surface geometry, landmark-relative semantic features, global shape context, and FACS controls to predict per-vertex displacements. We train on 3,496 generated identities using 45 non-gaze expression controls from the 53-control ICT FaceKit vocabulary. On held-out identities and unseen mesh topologies, TopoRig more faithfully reproduces the reference expression space than prior neural facial-rigging methods, while qualitative results show consistent localized deformations across diverse character geometries. Ablations demonstrate that semantic landmark features and complementary supervision improve cross-identity and cross-topology generalization. Overall, TopoRig amortizes heterogeneous and imperfect expression supervision into a single topology-preserving deformation model.
Problem

Research questions and friction points this paper is trying to address.

facial rigging
heterogeneous mesh topologies
geometric artifacts
correspondence errors
Innovation

Methods, ideas, or system contributions that make the work stand out.

topology-agnostic
facial rigging
multi-source supervision
FACS-conditioned deformations
complementary supervision
🔎 Similar Papers
💼 Related Jobs
No related jobs found.
A
Andrew Fleet
Queen's University
S
Soroush Mehraban
Pickford AI, University of Toronto, Vector Institute
V
Vida Adeli
Pickford AI, University of Toronto, Vector Institute
C
Cole Clifford
Pickford AI
Babak Taati
Babak Taati
KITE Research Institute |Toronto Rehab - UHN & Department of Computer Science, University of Toronto
Computer VisionHealth MonitoringAmbient Intelligence