Alexa is the Amazon cloud service that powers Echo, the groundbreaking new Amazon device designed around your voice. We believe voice is the most natural user interface for interacting with the web services and applications.
In this role you will be part of a new team that is tasked with designing and implementing new online and offline metrics, to model and measure satisfaction and dissatisfaction (SAT/DSAT) for user-Alexa interactions on different end-points and device form factors. You will also conduct research, and define and implement new SAT/DSAT metrics and algorithms.
You will be expected to: · Analyze, understand, and model user-behavior and the user-experience based on large scale data, to detect key factors causing satisfaction and dissatisfaction (SAT/DSAT). · Build and measure novel online & offline metrics for personal digital assistants and search engines, on diverse set of devices environments · Perform data quality analysis and build predictive models · Define ML based techniques for sampling, judgment monitoring, spam detection, A/B testing and efficient evaluations. · Work with the feature teams to define the online and offline end-to-end metrics for the product north star, and guide them to optimize their online experiments to achieve those goals · Provide guidance and tools to the partner teams to understand the metrics and identify areas of improvements in their features · Full understanding of the system stack, each component, dependencies and constraints
· Bachelor's, Master's, or PhD in Computer Science or equivalent · 3+ of experience in data analysis, statistical metrics, and measurements for search engines · Experience in working web-scale high-performance, highly-available and scalable distributed systems, particularly search engines · 2+ years experience as a senior-level Scientist or Engineer.
· 5+ years experience with state-of-the-art machine learning and statistical modeling techniques · 5+ years experience leading large-scale projects · Strong knowledge of statistics, data-mining, crowdsourcing, IR evaluation, dis/satisfaction modeling and prediction to develop web scale offline and online metrics for personal digital assistants and search engines. · Deep knowledge of the underlying ML techniques and algorithms development · Ability to work well with people and achieve stretch goals in a highly innovative and fast paced environment · Excellent communication, design and analytical skills Amazon is an Equal Opportunity-Affirmative Action Employer - Female/Minority/Disability/Veteran/Gender Identity/Sexual Orientation