Principal Applied Science Manager  - Outlook Science Team

Outlook Science is building the intelligence layer behind the next generation of AI-powered communication and productivity experiences. Our work spans quality, evaluation, post-training, personalization, and agentic AI, with a focus on turning frontier-model capabilities into reliable product experiences used on a global scale.  We are looking for a  Principal Applied Science Manager  to lead a team responsible for improving the quality of some of Outlook’s most important AI experiences. This role sits at the intersection of frontier models, product science, and large-scale AI systems, with the opportunity to shape how AI quality is measured and improved across Outlook.  The successful candidate will help answer some of the most important questions in applied AI today: How do we know an agent is actually getting better? How do we connect offline evaluation improvements to real user impact? How do we make AI systems understand user context, identify what matters, take the right actions, and earn user trust?  Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Lead and grow a team of applied scientists focused on AI quality, evaluation, post-training, and product improvement.  Define what “good” looks like for AI-powered communication, summarization, search, recommendation, and agentic experiences.  Build scalable evaluation systems combining human labels, LLM graders, telemetry, shadow experiments, online A/B testing, and root-cause analysis.  Drive improvements across critical quality dimensions, including recall, precision, grounding, freshness, ranking, personalization, actionability, hallucination reduction, and end-to-end task completion.  Diagnose complex production failures involving user context, long-running conversations, tool use, memory, retrieval, ranking, and evolving product state.  Translate user feedback, dissatisfaction signals, and production telemetry into actionable science and product insights.  Partner closely with PM and engineering leaders to turn evaluation findings into model, prompt, tool, data, and system improvements.  Develop post-training and adaptation strategies for frontier and open-source models where they can materially improve product quality.  Establish deep connections between offline quality metrics and online outcomes such as user satisfaction, engagement, retention, and successful task completion.  Provide technical leadership across teams and mentor senior scientists while maintaining a high bar for scientific rigor, product judgment, and execution.

Required Qualifications: Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 8+ years related experience (e.g., statistics, predictive analytics, research) OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research) OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 5+ years related experience (e.g., statistics, predictive analytics, research) OR equivalent experience. 3+ years of people management experience. Other Requirements: Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:   Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two