SOFTWARE ENGINEER II - Core AI

Do you want to help define how developers build and run the next generation of AI applications and agents? CoreAI is building the AI-first application stack at the center of Microsoft's AI platform strategy, bringing together models, agents, tools, data, evaluation, security, governance, and developer experiences.   Microsoft Foundry Service is a unified, production-ready platform that enables developers and enterprises to build, deploy, evaluate, publish, and operate AI applications and agents at scale. Foundry Agent Service provides managed runtimes for prompt agents and hosted agents, integrates models and reusable tools, and delivers enterprise capabilities such as Microsoft Entra identity, role-based access control, private networking, content safety, tracing, monitoring, evaluation, and lifecycle management. The platform supports both low-code and code-first development, allowing customers to use managed experiences or bring their own agent code and frameworks.   Making agent development simple creates challenging engineering opportunities across distributed systems, secure execution, session and state management, workload scheduling, scalability, reliability, observability, networking, identity, governance, and cost efficiency. Our services must provide a consistent developer experience while supporting diverse agent frameworks, tools, models, and compute environments for enterprise workloads.   The rapid evolution of generative AI and agentic applications is reshaping how software is built and operated. Come join CoreAI and help build Microsoft Foundry Service—the platform that enables every developer to create secure, reliable, and scalable AI applications and agents.

We are looking for strong engineers who are passionate about building new AI platform capabilities while operating a globally distributed service. The ideal candidate can independently produce high-quality solutions and contribute to a collaborative and diverse team environment across organizations and geographies. You should be comfortable working in a fast-moving space, learning quickly, handling ambiguity, and changing direction as customer needs and AI technologies evolve.   In this role, you will design, build, and deliver services, features, and developer tools for Microsoft Foundry Service, with a focus on Foundry Agent Service and Hosted Agents. You may work on managed agent runtimes, secure and isolated execution, agent session lifecycle, workload scheduling and autoscaling, identity and networking integration, tools and model connectivity, observability, evaluation, publishing, and support for customer-managed compute such as Azure Kubernetes Service. You will work across open-source and Microsoft platform components written in multiple programming languages.   This is a unique opportunity to work on large-scale distributed AI systems and deliver foundational capabilities that are central to Microsoft's strategy for enterprise AI applications and agents.

Qualifications 5+ years of professional experience designing, developing, and shipping software using any of C#, C++, Java, Python, JavaScript/TypeScript, Rust, or Go. Bachelor’s Degree in Computer Science or equivalent experience.

Hands-on experience with distributed systems, cloud services, containers, orchestration platforms, or production AI infrastructure. Proven ability to diagnose complex technical issues and improve the reliability, scalability, performance, security, and cost efficiency of online services. Excellent   written   and oral communication skills.  Experience in technical leadership in driving engineering roadmaps, leading v-teams, mentoring and helping others grow technically is a plus.  Experience building AI applications or agents using models, tools, retrieval, agent frameworks, evaluation, tracing, or observability is a plus. Experience with Linux, Docker, Kubernetes, Azure