About the job
Alexa International is looking for a passionate, talented, and inventive Applied Scientist to help build industry-leading technology with Large Language Models (LLMs) and multimodal systems, requiring strong deep learning and generative models knowledge. You will contribute to developing novel solutions and deliver high-quality results that impact Alexa's international products and services.
Responsibilities
Analyze, understand, and model customer behavior and the customer experience based on large-scale data.
Build novel online & offline evaluation metrics and methodologies for multimodal personal digital assistants.
Fine-tune/post-train LLMs using techniques like SFT, DPO, RLHF, and RLAIF.
Set up experimentation frameworks for agile model analysis and A/B testing.
Collaborate with partner teams on LLM evaluation frameworks and post-training methodologies.
Contribute to end-to-end delivery of solutions from research to production, including reusable science components.
Communicate solutions clearly to partners and stakeholders.
Contribute to the scientific community through publications and community engagement.
Qualifications
Minimum
PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience
Experience programming in Java, C++, Python or related language
Experience in patents or publications at top-tier peer-reviewed conferences or journals
Preferred
Experience in professional software development