Senior Principal Data Scientist - Ads Measurement
A Little About Us
We are an industry-leading direct-to-consumer and ad tech solution for advertisers and publishers. Our innovative ad tech gives one-stop access to Yahoo, Inc.’s trusted data, high-quality inventory and demand, creative ad experiences, and industry-leading machine learning at global scale. The Consumer Monetization team’s charter is to Find, Evaluate, Build, and Scale new monetization products and internal campaign tools across all Yahoo brands. We are currently transitioning our monetization engine to an AI-first framework, where autonomous agents optimize for long-term user value and advertiser outcomes in real-time.
A Lot About You
As a Sr. Principal Data Scientist on the Consumer Monetization Platform Engineering team, you will be the foundational technical leader defining the functional strategy for how AI-augmented intelligence closes the loop between ad serving and advertiser business outcomes. You will architect the ML models, reinforcement learning systems, and feedback architectures that transform our platform into an autonomous learning ecosystem. You thrive at the intersection of rigorous research and production-scale engineering. You are a leader who views AI not just as a product feature, but as a core tool to augment your own research and engineering lifecycle—leveraging emerging tools to accelerate the path from hypothesis to production. You get excited about building systems that self-improve and want to shape the science strategy for a platform generating billions in revenue.
Responsibilities
Model Training & ML Strategy
Define the strategic technical roadmap for production-grade ML models, leveraging AI-augmented prototyping tools (e.g., SageMaker Jumpstart) to accelerate the deployment of transformer architectures and multi-task models.
Architect multi-objective learning models that jointly optimize for publisher yield and advertiser outcomes, implementing AI-driven validation frameworks to ensure model safety and robustness.
Establish organization-wide standards for model training pipelines, automated retraining, and AI-augmented model versioning.
Feature Generation & AI-Augmented Data Science
Oversee the design of real-time and batch feature generation pipelines, integrating AI-driven diagnostics (e.g., Vertex AI) to monitor feature health, drift detection, and automated quality monitoring at petabyte scale.
Implement AI-assisted tools to automate feature discovery from cross-channel signals—search intent, content engagement, and purchase behavior—to improve model predictive power.
Strategic Experimentation
Lead the organization’s experimentation strategy, utilizing AI-driven simulation environments to evaluate multi-armed bandit and causal inference designs before online deployment.
Develop AI-powered guardrail monitoring systems that autonomously adjust experiment parameters to protect revenue while maximizing learning velocity.
Autonomous Feedback Loops
Architect the next-generation closed-loop feedback architecture, where RL-based agents self-improve through automated reward shaping and credit assignment mechanisms.
Lead the implementation of AI-augmented offline policy evaluation (OPE) techniques to safely validate reinforcement learning policies in highly sparse and delayed reward environments.
Leadership & Organizational Influence
Contribute to the development of the organization’s broader functional strategy, ensuring monetization science aligns with Yahoo’s long-term business objectives.
Establish governance frameworks using tools like Weights & Biases to standardize ML experiment tracking and ensure reproducibility across multiple squads.
Mentor and provide technical guidance to senior and principal data scientists, elevating the technical bar for the entire monetization engineering organization.
Requirements
Ph.D. in Computer Science, Machine Learning, Statistics, or a related field with 8+ years of industry experience; or M.S. with 12+ years of relevant industry experience.
Proven experience leveraging AI productivity tools and LLMs to accelerate complex research workflows and code generation.
Proficiency in prompt engineering and structured interaction with AI models to optimize large-scale system diagnostics and research documentation.
Deep expertise in supervised learning, gradient-boosted trees, and reinforcement learning (RL/Bandits) applied to organizational-scale problems.
Strong proficiency in Python and SQL; experience with distributed computing (Spark) and cloud ML platforms (Vertex AI, SageMaker) for production-grade deployment.
Expertise in exercising judgment when to deploy AI-augmented solutions versus traditional manual research approaches.
Nice to Have
Experience in ad tech or auction design (yield management).
Experience with AI-native research practices, including the use of agentic AI for hypothesis generation or data synthesis.
Publications in top ML/AI venues (NeurIPS, ICML, KDD) or equivalent industry contributions.
The material job duties and responsibilities of this role include those listed above as well as adhering to Yahoo policies; exercising sound judgment; working effectively, safely and inclusively with others; exhibiting trustworthiness and meeting expectations; and safeguarding business operations and brand integrity.
At Yahoo, we offer flexible hybrid work options that our employees love! While most roles don’t require regular office attendance, you may occasionally be asked to attend in-person events or team sessions. You’ll always get notice to make arrangements. Your recruiter will let you know if a specific job requires regular attendance at a Yahoo office or facility. If you have any questions about how this applies to the role, just ask the recruiter!
Yahoo is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Yahoo will consider for employment qualified applicants with criminal histories in a manner consistent with applicable law. Yahoo is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form (www.yahooinc.com/careers/contact-us.html) or call +1.866.772.3182. Requests and calls received for non-disability related issues, such as following up on an application, will not receive a response.
We believe that a diverse and inclusive workplace strengthens Yahoo and deepens our relationships. When you support everyone to be their best selves, they spark discovery, innovation and creativity. Among other efforts, our 11 employee resource groups (ERGs) enhance a culture of belonging with programs, events and fellowship that help educate, support and create a workplace where all feel welcome.
The compensation for this position ranges from $160,965.00 - $349,885.00/yr and will vary depending on factors such as your location, skills and experience.The compensation package may also include incentive compensation opportunities in the form of discretionary annual bonus or commissions. Our comprehensive benefits include healthcare, a great 401k, backup childcare, education stipends and much (much) more.Currently work for Yahoo? Please apply on our internal career site.
