Staff Software Engineer, Teleoperation

Agility Robotics
Salem / Pittsburgh / Fremont2026-04-16

About the job

As a Staff Software Engineer on the AI team, you will architect and build production-quality teleoperation systems that enable Digit to execute complex whole-body manipulation tasks in real-world environments. You will work closely with AI, controls, hardware, and operations teams to create a scalable platform for high-quality human demonstration data collection. Your work will directly enable our ability to scale up the world's first production humanoid robot fleet and revolutionize the labor market.

Responsibilities

Own the end-to-end architecture of the teleoperation system, from operator input through real-time robot execution, ensuring low latency, predictable behavior, and clear system boundaries

Integrate and optimize real-time control, streaming, and communication paths to meet measurable latency and bandwidth targets

Design and implement scalable teleoperation interfaces, including VR, motion capture, and other modalities, to enable high-quality manipulation and locomotion demonstrations

Develop comprehensive validation strategies in simulation and on hardware, including performance benchmarks, fault handling, and regression testing

Analyze teleoperation and demonstration data to improve operator efficiency, system responsiveness, and task success rates

Anticipate future robot hardware and sensor changes, and design systems that can adapt to new interfaces and capabilities with minimal architectural disruption

Qualifications

Minimum

8+ years of experience in robotics or real-time systems, with a demonstrated track record of delivering reliable, production-quality software

Deep understanding of real-time control systems, motion retargeting, and rigid body dynamics

Experience designing low-latency communication and streaming systems for real-time applications

Strong systems intuition with the ability to trace performance issues across software, networking, and hardware boundaries

Strong analytical and debugging skills, with a data-driven approach to performance validation and system reliability

Hands-on experience integrating human input systems such as VR, motion capture, wearable devices, or other operator interfaces

Excellent communication skills and the ability to collaborate effectively across AI, controls, hardware, and operations teams

Preferred

Experience building applications with real-time rendering or XR frameworks such as Unity, Unreal, Godot, SteamVR, or OpenXR

Experience with advanced 3D visualization techniques such as neural radiance fields, Gaussian splatting, or other scene reconstruction methods

Familiarity with large-scale data collection pipelines for learning from demonstration