Research Scientist, HCI-Multimodality - Interaction Perception, PICO

ByteDance
圣何塞2026-03-02研发

About the job

The team at PICO is dedicated to leverage technologies such as computer vision, deep learning, SLAM, 3D reconstruction, and multi-sensor fusion, we continuously expand the ways humans interact with the virtual world through handheld controllers, bare-hand tracking, eye-tracking, and XR interactive accessories, enhancing the overall interaction experience.

We focus on computer vision + NLP + LLM for next-generation VR intelligent interaction.

Responsibilities

- Develop computer vision-driven VR interaction algorithms centered on intelligent input method systems.

- Build LLM & NLP algorithms for prediction, error correction and completion.

- Research lightweight LLM/NLP and vision-language multimodal fusion for VR.

- Deliver technical innovations, patents and research translation.

- Provide technical leadership for the algorithm team.

Qualifications

Minimum

- Master’s/PhD in CS, AI or related field.

- 5+ years NLP/LLM R&D experience, 2+ years leading core algorithms.

- Expertise in Transformers, LLMs and sequence modeling.

- Proficiency in PyTorch/TensorFlow.

- Basic computer vision or multimodal background.

Preferred

- Experience in intelligent input methods, especially Chinese input methods.

- LLM fine-tuning and optimization for interactive systems.

- Vision-language multimodal fusion for VR.

- Lightweight model deployment on VR/edge devices.

- VR interaction and scenario understanding.