Senior Software Engineer - MAIA System Infrastructure
- Location
- United States, Multiple Locations, Multiple Locations
- Work model
- On-Site
- Level
- Senior
- H-1B history
- 2,066 approvals (FY2023)
- Posted
Skills
About this role
Overview
We build the PCIe data path and host/device interface for Microsoft’s MAIA AI accelerators. As a Senior Software Engineer on the MAIA System Infrastructure team, you’ll work at the boundary between Linux drivers, device firmware, and silicon. Day to day, you’ll design the primitives that move data through the chip’s memory fabrics, integrate and manage the device as part of a host system, and build the tools engineers use to understand its behavior. The MAIA execution runtime builds on our interfaces, and model teams run their workloads through that runtime. When a workload exposes a limitation in our layer, you’ll partner with those teams to isolate the cause, improve the underlying interface, and verify the effect in the original scenario. You’ll work with the engineers who design the silicon and the engineers who build the runtime above it. When hardware behavior forces a tradeoff between bandwidth, latency, and recovery, you can help decide what the interface should guarantee, implement it, and test it on the chip. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond Responsibilities Own the PCIe data path and the host/device interface. Design and implement direct memory access (DMA) submission, completion, and error reporting across the host driver and device firmware. Specify what a completion guarantees and when a caller can safely reuse a buffer. Design memory and synchronization primitives around the chip’s addressing, ordering, and visibility guarantees. Measure bandwidth, latency, and contention across its memory fabrics to guide decisions about mappings, queue depths, and transfer sizes. Own system-level chip integration and management. Bring up device initialization and firmware loading, expose device health to the host, and implement reset and recovery paths that preserve isolation and account for in-flight work. Build observability and developer tools across the host/device boundary. Give engineers the counters, traces, and crash dumps to distinguish a backed-up host queue from a stalled device and determine where progress stopped. Lead interface reviews and mentor engineers as new capabilities move from bring-up to production. Verify interface guarantees in simulation and on silicon with stress tests, fault injection, and performance baselines. Work with runtime and model engineers when a particular workload exposes a bottleneck in the platform. For example, test whether batching DMA submissions closes idle gaps on the PCIe link, then verify that the change helps the workload that exposed them.
Qualifications
Required qualifications Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. Other Requirements Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred qualifications
Experience with PCIe, DMA, memory fabrics, memory-mapped I/O, or accelerator memory systems. Experience developing and shipping systems software in C, C++, or a comparable language for device drivers, firmware, operating systems, or high-performance I/O. Experience diagnosing a performance or correctness issue involving concurrency, memory behavior, or data movement, and validating a fix