UltraArUco: A Lightweight Multilingual Library And Framework With Low-Latency Real-Time Marker-Based Tracking System For Mobile AR Interaction

2026-07-09

AI Summary

为解决移动AR交互中实时标记跟踪的低延迟问题，UltraArUco通过优化多语言库和分布式Wi-Fi架构，实现高精度、低延迟跟踪。

Abstract

UltraArUco - a lightweight multilingual library and framework for low-latency, real-time marker-based tracking in mobile augmented reality. Unlike standard OpenCV-based implementations, UltraArUco introduces an optimized multilingual wrapper that reduces per-frame latency by five times, while maintaining high accuracy. Distributed Wi-Fi architecture provides portability, connects a mobile device (camera input) with a PC-based visual application, enabling responsive interactions. The framework is validated through an interactive piano simulation, where static ArUco markers on keys enable occlusion-based note triggering, and hand-mounted markers provide spatial gesture recognition. UltraArUco's system requirements make it perfect for resource-constrained mobile AR applications, demonstrating a viable AR music application without specialized equipment.

Problem

• low-latency
• real-time tracking
• mobile AR
• marker-based

Innovation

• lightweight multilingual library
• low latency
• realtime marker-based tracking
• distributed Wi-Fi architecture
• mobile AR