Senior Software Engineer, ML Infrastructure

Teamwork makes the stream work.

Roku is changing how the world watches TV

Roku is the #1 TV streaming platform in the U.S., Canada, and Mexico, and we've set our sights on powering every television in the world. Roku pioneered streaming to the TV. Our mission is to be the TV streaming platform that connects the entire TV ecosystem. We connect consumers to the content they love, enable content publishers to build and monetize large audiences, and provide advertisers unique capabilities to engage consumers.

From your first day at Roku, you'll make a valuable - and valued - contribution. We're a fast-growing public company where no one is a bystander. We offer you the opportunity to delight millions of TV streamers around the world while gaining meaningful experience across a variety of disciplines.

The Roku Entertainment Assistant team builds conversational AI experiences used across millions of Roku devices. The team works across fulfilment ranking, model delivery, offline and online evaluation, low-latency services, observability and product quality. Its published work includes shared model-serving and MLOps paths, automated evaluation and retraining, caching and telemetry, and agent-assisted release and operational workflows.

What is the role?

We are looking for a Senior Software Engineer with strong machine-learning infrastructure experience to help the Roku Entertainment Assistant team deliver reliable, high-quality conversational experiences at scale. You will own production systems across ranking, model delivery, evaluation and LLM-agent behaviour, working closely with machine-learning, product, data and platform partners.

This is a hands-on engineering role for someone who can move comfortably between software architecture, ML lifecycle decisions and production operations. You will improve the paths the team uses to train, evaluate, deploy and observe models, while helping us manage latency, quality and cost as the product grows.

How will I use AI at Roku?

At Roku, we don't just use AI, we work with it. AI agents and smart tools help power drafts, analysis, and repetitive workflows, while our people bring direction, judgment, and accountability. We're looking for curious, adaptable builders who can show how they've used AI or automation to move faster, raise the bar, and scale their impact.

We value your AI skills if you have built fluency across the agentic engineering toolchain — coding harnesses like Claude Code or Cursor, MCP servers, custom skills, or agent frameworks. And you can describe projects where you shipped real work with these tools. You know how to drive an agent, verify its output, and ramp on an unfamiliar codebase with an agent helping you.

What will you be doing?

• Own fulfilment-ranking pipelines from training orchestration and quality gates through deployment and online validation.

• Build and operate an offline-evaluation platform, combining LLM-as-judge harnesses with deterministic checks for answer quality.

• Develop the Roku Entertainment Assistant's LLM agent, including tool routing, retrieval, guardrails and answer caching.

• Design caching as an intentional latency and cost lever for high-volume services.

• Build observability for ML and LLM systems, including latency attribution, quality metrics, tracing and per-request cost.

• Improve the reliability and operability of distributed systems, and lead the diagnosis of difficult cross-service failures.

• Drive accountable AI-assisted engineering practices across the team, building on the agents already used in release workflows.

• Work across