yoinka

Performance Engineer

AMD

San Francisco, CAFull TimeMid
Sign in to applyVerified
Location
San Francisco, CA
Employment
Full Time
Work model
On-Site
Level
Mid
Posted

Skills

JAXPyTorchPythonRust

About this role

ADVANCE YOUR CAREER. ADVANCE THE WORLD.  At AMD, we believe technology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future.    Whether you’re designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger — technology that moves the world forward. Join us and, together, we’ll advance your career.

THE ROLE

We are looking for a Performance Engineer to make World Labs’ models train and serve as fast as the hardware allows. Running large generative world models at scale is a novel systems problem. You will find the bottlenecks — in kernels, in the serving path, in the training loop, in how we use our GPUs — and eliminate them. Your ownership is technical and concrete: the throughput you unlock, the latency you cut, the utilization you win back, and the correctness you hold while doing it. You will work up and down the stack, from low-level tensor and kernel optimization to fleet-wide serving efficiency, in close partnership with the researchers whose models you are accelerating.   THE PERSON This is a hands-on, individual-contributor role. You will profile, design, build, and ship code directly.

KEY RESPONSIBILITIES

Optimize inference and serving end to end — latency, throughput, batching, caching, and scheduling — to serve our models efficiently at production scale. Write and tune GPU kernels (CUDA, Triton) for hot paths; drive kernel fusion, memory- and bandwidth-bound optimization, and low-precision (FP8/INT8) execution. Optimize training throughput and GPU utilization: parallelism strategies, communication/compute overlap, mixed precision, and eliminating pipeline stalls. Build performance models, profiling workflows, and observability that make throughput, latency, cost, utilization, and their tradeoffs legible across the stack. Own numerical correctness across precision, kernel, and hardware changes — treating correctness as part of performance, not separate from it. Partner with researchers to productionize models for serving and to make experiments run faster and more reliably. Where needed, work on the distributed systems that training and inference run on — but the core of the job is squeezing the most out of every GPU.

PREFERRED EXPERIENCE

You should excel at the fundamentals below — we index on inference, serving, GPU optimization, and training performance. Distributed-systems breadth is welcome, but secondary.   Strong performance-engineering foundations: profiling, roofline analysis, latency/throughput optimization, and disciplined root-cause investigation. Deep GPU programming and optimization experience (CUDA and/or Triton) — kernel-level tuning, memory hierarchy, and bandwidth optimization at scale. Hands-on experience optimizing inference and serving for large models: batching, KV/prompt caching, quantization, and low-latency, high-throughput sampling. Hands-on experience optimizing training performance: parallelism, distributed communication, mixed/low precision, and utilization. Working knowledge of ML framework internals (PyTorch and/or JAX; torch.compile, XLA, or similar compiler paths). Strong proficiency in Python, with the ability to drop into C++/CUDA (and Rust or Go) as the work demands. High-ownership mindset — you measure yourself by throughput shipped and latency cut, not tickets closed.   Additional Qualifications Experience at an AI lab or ML-native company, optimizing systems used directly by researchers and productionizing research code. Low-precision and numerics depth: FP8/INT8 quantization, mixed-precision, and detecting numerical regressions across hardware platforms. Distributed systems for large-scale training and inference — collective communication (NCCL), interconnects (NVLink),

Listing verified . Applications go through the company's official careers site.

← Back to Yoinka