yoinka

Senior Applied Scientist, LLM Code Agents, Kiro Science

Amazon

RemoteUS, CA, Santa ClaraFull TimeSenior
Sign in to applyVerified 2h ago
Location
US, CA, Santa Clara
Employment
Full Time
Work model
Hybrid
Level
Senior
Posted
Oct 28, 2025

Skills

AWSCI/CDGenAI

About this role

One of the key bottlenecks in training capable code agents today is the environment the model is trained on. You can't RL your way to a better coding agent if your training rollouts are running against environments that don't actually reflect how software gets built, have flaky rewards, are prone to reward hacking, or rely on unreliable verification methodology. We're building and improving ๐—ž๐—ถ๐—ฟ๐—ผ โ€” Amazon's next-gen AI coding agent โ€” and we're building ๐˜ƒ๐—ฒ๐—ฟ๐—ถ๐—ณ๐—ถ๐—ฒ๐—ฑ (๐—ฒ๐˜…๐—ฒ๐—ฐ๐˜‚๐˜๐—ถ๐—ผ๐—ป-๐—ฏ๐—ฎ๐˜€๐—ฒ๐—ฑ ๐—ผ๐—ฟ ๐—ป๐—ฒ๐˜‚๐—ฟ๐—ผ๐˜€๐˜†๐—บ๐—ฏ๐—ผ๐—น๐—ถ๐—ฐ) ๐—ฅ๐—Ÿ ๐—ฒ๐—ป๐˜ƒ๐—ถ๐—ฟ๐—ผ๐—ป๐—บ๐—ฒ๐—ป๐˜๐˜€ ๐—ฎ๐˜ ๐˜€๐—ฐ๐—ฎ๐—น๐—ฒ. We're looking for someone excited about the problem. The strongest candidates have depth in at least one of: ๐—ฃ๐—ฟ๐—ผ๐—ด๐—ฟ๐—ฎ๐—บ๐—บ๐—ถ๐—ป๐—ด ๐—Ÿ๐—ฎ๐—ป๐—ด๐˜‚๐—ฎ๐—ด๐—ฒ๐˜€ / ๐—ฆ๐—˜ โ€” type systems, compilers, build systems, dependency analysis, program analysis ๐—”๐—ฝ๐—ฝ๐—น๐—ถ๐—ฒ๐—ฑ ๐—Ÿ๐—Ÿ๐— ๐˜€ ๐—ฎ๐—ป๐—ฑ T๐—ฟ๐—ฎ๐—ถ๐—ป๐—ถ๐—ป๐—ด โ€” post-training, RLHF / RLVR / RLAIF, distillation, evaluation harnesses, agent scaffolds ๐—ฅ๐—Ÿ ๐—š๐˜†๐—บ ๐—ฑ๐—ฒ๐˜ƒ๐—ฒ๐—น๐—ผ๐—ฝ๐—บ๐—ฒ๐—ป๐˜ โ€” Gymnasium, custom verifiers, reward design, sandboxing ๐—ฆ๐—ผ๐—ณ๐˜๐˜„๐—ฎ๐—ฟ๐—ฒ ๐—˜๐—ป๐—ด๐—ถ๐—ป๐—ฒ๐—ฒ๐—ฟ๐—ถ๐—ป๐—ด ๐—ฎ๐˜ ๐˜€๐—ฐ๐—ฎ๐—น๐—ฒ โ€” containerization, deterministic execution, CI/CD systems, hermetic builds Key job responsibilities ๐—ช๐—ต๐—ฎ๐˜ ๐˜†๐—ผ๐˜‚'๐—น๐—น ๐˜„๐—ผ๐—ฟ๐—ธ ๐—ผ๐—ป: โ€ข Designing verified RL environments built from real codebases and post training with these environments โ€ข Reward functions that survive Goodhart's law on F2P / P2P / mutation tests โ€ข Scaling environment generation pipelines that stay fresh against contamination โ€ข Publishing at NeurIPS / ICML / ICLR / ICSE / OOPSLA / ACL About the team The AWS Developer Agents and Experiences (DAE) team is reimagining the builder experience through generative AI and foundation models. We're leveraging the latest advances in AI to transform how engineers work from IDE environments to web-based tools and services, empowering developers to tackle projects of any scale with unprecedented efficiency. Broadly, AWS Utility Computing (UC) provides product innovations โ€” from foundational services such as Amazonโ€™s Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWSโ€™s services and features apart in the industry. As a member of the UC organization, youโ€™ll support the development and management of Compute, Database, Storage, Internet of Things (Iot), Platform, and Productivity Apps services in AWS. Within AWS UC, Amazon Dedicated Cloud (ADC) roles engage with AWS customers who require specialized security solutions for their cloud services. Why AWS? Amazon Web Services (AWS) is the worldโ€™s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating โ€” thatโ€™s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Inclusive Team Culture Here at AWS, itโ€™s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon conferences, inspire us to never stop embracing our uniqueness. Mentorship & Career Growth Weโ€™re continuously raising our performance bar as we strive to become Earthโ€™s Best Employer. Thatโ€™s why youโ€™ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the

Senior Applied Scientist, LLM Code Agents, Kiro Science at Amazon, US, CA, Santa Clara | Yoinka