About the job
Amazon is seeking a Language Data Scientist to join the Alexa Artificial Intelligence (AI) team as domain expert. This role focuses on expanding analysis and evaluation of speech and interaction data deliverables. The Language Data Scientist is an expert in dialog evaluation processes, working closely with a team of skilled analysts and machine learning scientists and engineers, and is a key member in developing new conventions for relevant annotation workflows. The Language Data Scientist will be asked to handle unique data analysis and research requests that support the training and evaluation of machine learning models and the overall processing of a data collection.
Responsibilities
Own data analyses for customer-facing features, including launch go/no-go metrics for new features and accuracy metrics for existing features
Handle unique data analysis requests from a range of stakeholders, including quantitative and qualitative analyses to elevate customer experience with speech interfaces
Lead and evaluate changing dialog evaluation conventions, test tooling developments, and pilot processes to support expansion to new data areas
Continuously evaluate workflow tools and processes and offer solutions to ensure they are efficient, high quality, and scalable
Provide expert support for a large and growing team of data analysts
Provide support for ongoing and new data collection efforts as a subject matter expert on conventions and use of the data
Conduct research studies to understand speech and customer-Alexa interactions
Assist scientists, program and product managers, and other stakeholders in defining and validating customer experience metrics
Qualifications
Minimum
2+ years of data scientist experience
3+ years of data querying languages (e.g. SQL), scripting languages (e.g. Python) or statistical/mathematical software (e.g. R, SAS, Matlab, etc.) experience
3+ years of machine learning/statistical modeling data analysis tools and techniques, and parameters that affect their performance experience
1+ years of guiding and coaching a group of researchers experience
1+ years of working with or evaluating AI systems experience
1+ years of creating or contributing to mathematical textbooks, research papers, or educational content experience
Master's degree in Science, Technology, Engineering, or Mathematics (STEM), or experience working in Science, Technology, Engineering, or Mathematics (STEM)
Experience applying theoretical models in an applied environment
Preferred
Ph.D. in Science, Technology, Engineering, or Mathematics (STEM)
Knowledge of machine learning concepts and their application to reasoning and problem-solving
Experience in Python, Perl, or another scripting language
Experience in a ML or data scientist role with a large technology company
Experience in defining and creating benchmarks for assessing GenAI model performance
Experience working on multi-team, cross-disciplinary projects
Experience applying quantitative analysis to solve business problems and making data-driven business decisions
Experience effectively communicating complex concepts through written and verbal communication