Cross-Sign Language Transfer Learning Using Domain Adaptation with Multi-scale Temporal Alignment
This study addresses the challenges of data scarcity and cross-lingual transfer in sign language recognition by proposing a multi-scale temporal relation alignment mechanism based on Temporal Relation Networks (TRN). Integrating TA3N domain adaptation with optical flow features, this approach effectively mitigates domain shift through multi-scale temporal modeling, thereby significantly enhancing RGB modality representations. Experimental results demonstrate that the proposed framework outperforms conventional transfer learning methods in American Sign Language (ASL) recognition tasks. These findings validate the efficacy of RGB-based approaches in low-resource scenarios and provide an efficient solution for cross-lingual sign language recognition, offering a robust pathway to overcome resource limitations in the field.