yoinka

Research Intern - AI Serving Systems and Hardware - Microsoft Research

Microsoft (Eightfold Apply)

Vancouver, CanadaInternshipIntern
Sign in to applyVerified
Location
Vancouver, Canada
Employment
Internship
Work model
On-Site
Level
Intern
Posted

Skills

LLMMachine LearningPython

About this role

Overview

Research Internships at Microsoft provide a dynamic environment for research careers with a network of world-class research labs led by globally-recognized scientists and engineers, who pursue innovation in a range of scientific and technical disciplines to help solve complex challenges in diverse fields, including computing, healthcare, economics, and the environment.     We are seeking Research Interns to work where AI serving workloads meet the systems and hardware that run them. Large-model inference is limited by that hardware and by how well the serving stack uses it. Our team works across this boundary, from serving software and graphics processing unit (GPU) communication, through GPU clusters and their interconnects, down to chip architecture, to make AI serving faster, more reliable, and cheaper to build and run. Open problems range from keeping a large serving system running at predictable performance when GPUs, links, or software components fail to designing chips that keep pace with rapidly evolving workloads.      Research Interns will take on a research project in this space, shaped around their background and interests. Expected deliverables include working prototypes or simulators validated on real hardware, measurement studies, and paper submissions to top-tier venues.

Responsibilities

Research Interns put inquiry and theory into practice. Alongside fellow doctoral candidates and some of the world’s best researchers, Research Interns learn, collaborate, and network for life. Research Interns not only advance their own careers, but they also contribute to exciting research and development strides. During the 12-week internship, Research Interns are paired with mentors and expected to collaborate with other Research Interns and researchers, present findings, and contribute to the vibrant life of the community. Research internships are available in all areas of research, and are offered year-round, though they typically begin in the summer.       Additional Responsibilities Measure and characterize large language model (LLM) inference workloads on state-of-the-art GPU hardware, including how they behave when parts of the system fail or degrade.  Build prototypes, simulators, or models that test new ideas in serving systems, fault tolerance, GPU communication, or AI hardware.  Compare new approaches against existing methods.  Document findings and prepare results for publication at top-tier venues.  Present the work to technical audiences, both internally and externally.

Qualifications

Required Qualifications Currently enrolled in a Doctorate Degree program in Computer Science, Artificial Intelligence, Machine Learning, or a related STEM field.     Other Requirements Research Interns are expected to be physically located in their manager’s Microsoft worksite location for the duration of their internship. In addition to the qualifications below, you’ll need to submit a minimum of two reference letters for this position as well as a cover letter and any relevant work or research samples. After you submit your application, a request for letters may be sent to your list of references on your behalf. Note that reference letters cannot be requested until after you have submitted your application, and furthermore, that they might not be automatically requested for all candidates. You may wish to alert your letter writers in advance, so they will be ready to submit your letter.

Preferred Qualifications

Research experience in computer systems, distributed systems, networking, or computer architecture and hardware design.  Proficient programming skills in C/C++ and Python.  Working knowledge of ML/AI/LLM concepts.  Experience designing experiments and writing research papers.    Candidates should have depth of expertise in one or two of the following areas:  Experience with GPU microarchitecture, performance modeling, or architectural simulators.  Experience with CUDA,

Listing verified . Applications go through the company's official careers site.

← Back to Yoinka