Software Engineer, LiteRT / On-Device AI

Company: Qualcomm Semiconductor Limited Job Area: Engineering Group, Engineering Group > Machine Learning Engineering General Summary: About the Team and What You Will Build   Our team maintains the software that runs AI and LLM models on Qualcomm's NPU, working hand in hand with Google and other industry partners. You will contribute to the development of:   LiteRT — Google's on-device ML inference runtime (the successor to TensorFlow Lite), and its Qualcomm backend that makes models run efficiently on Qualcomm's NPU.   LiteRT -LM — the LLM-focused layer on top of LiteRT for running large language and generative models on-device, including the model bring-up and optimization work that makes them fast enough for real products.   QNN SDK — Qualcomm's AI Engine software stack that helps you build model files to run on various device processors across multiple operating systems.   QNN TFLite Delegate — the delegate extends the QNN SDK to support running TFLite models on the Qualcomm NPU.   You will work across this stack, from the model graph down to the runtime and the hardware, with a particular focus on bringing up and optimizing modern LLMs.

You will develop in the core runtime and backend libraries that execute AI and LLM workloads on the NPU — an AI model inferencing stack scalable across Qualcomm platforms — reasoning about how a model maps onto the hardware end to end, from the model graph down to the runtime, memory, and scheduling behavior on the device.   Enable, bring up, and optimize AI and LLM models running on the Qualcomm NPU, from graph-level transformations down to individual operations.   Design, implement, profile, and analyze the runtime, backend, and operation libraries that execute these models.   Diagnose accuracy and performance issues across the stack (model, runtime, backend, and hardware) and drive them to root cause.   Deliver high-quality code and collaborate with open-source software communities.   Work with key technical specialists across Qualcomm, our partners, and our customers to improve the libraries for commercial use cases and industrial benchmarks.   Build and maintain the tooling and test coverage that keep the runtime stable and its numerics correct across platforms.

(New College Graduate / Junior)   Master's degree or above in Computer Science, Electrical Engineering, or a related field.   Proficiency in programming languages such as C, C++, or Python.   Strong knowledge of object-oriented programming, data structures, algorithms, operating systems, and computer architecture.   Understanding of machine learning and deep learning fundamentals, including the structure of modern neural networks and the transformer / LLM architecture (attention, KV cache, tokenization, prefill vs. decode).   Self-motivated and capable of working independently with minimal oversight.   Ability to communicate technical concepts effectively and to work collaboratively within cross-functional teams.

(Experienced / Senior)   Master's degree or above in Computer Science, Electrical Engineering, or a related field, and relevant software engineering experience.   Strong proficiency in modern C++ and Python for building and optimizing performance-critical software.   Solid grounding in computer architecture, and an understanding of NPU / DSP / GPU architectures and parallel programming concepts.   Solid operating-system fundamentals, including how the OS manages and schedules compute and memory resources, and how that affects on-device inference (threading, memory allocation, buffer / cache management, contention, and power / performance trade-offs).   Familiarity with embedded systems and the constraints of edge devices.   Experience with low-level programming for efficient hardware utilization , and with analyzing and optimizing performance bottlenecks.   Proficiency with version control and