yoinka

Engineer, Platform Engineering - AI

Intercontinental Exchange

Atlanta / JacksonvilleFull TimeMid
Sign in to applyVerified
Location
Atlanta / Jacksonville
Employment
Full Time
Work model
On-Site
Level
Mid
Posted

Skills

AnsibleGitGitHub ActionsKubernetesLLMLinuxPyTorchPythonTensorFlow

About this role

Job Purpose We are on a mission as a team.  We are problem solvers and partners, always starting with our customers to solve their challenges and create opportunities.  Our start-up roots keep us nimble, flexible, and moving fast.  We take ownership and make decisions. We all work for one company and work together to drive growth across the business.  We engage in robust debates to find the best path, and then we move forward as one team.  We take pride in what we do, acting with integrity and passion, so that our customers can perform better.  We are experts and enthusiasts - combining ever-expanding knowledge with leading technology to consistently deliver results, solutions and opportunities for our customers and stakeholders.   Every day we work toward transforming global markets.   The AI Platform Engineer is responsible for the technical implementation, maintenance, and optimization of AI/ML infrastructure. This hands-on role focuses on GPU cluster deployment, container image management, platform tooling development, and deep technical troubleshooting. In addition, the engineer deploys and maintains AI-enabled workflow automation tools across LLM, MCP, and agentic capabilities, ensuring these systems operate efficiently and securely within a containerized architecture. This includes deploying and maintaining vector store infrastructure, implementing end-to-end RAG workflows, tuning agent memory systems, and hosting and managing MCP servers. The engineer also deploys and operates Agentic AI systems, including multi-agent orchestration frameworks and tool-use pipelines. The engineer serves as a core technical contributor on the AI Platform Operations team, translating architectural decisions into working infrastructure and enabling advanced, automated workflows across the platform.

Responsibilities

Deploy, configure, and maintain GPU clusters and associated infrastructure Designing, building, and maintaining the workflow automation platform that uses AI capabilities (LLM/MCP/Agentic capabilities) Manage NVIDIA driver versions, CUDA toolkits, and container runtimes Build and maintain approved container images with ML frameworks (PyTorch, TensorFlow, etc.) Implement monitoring, alerting, and observability for GPU infrastructure Deploy and maintain vector store infrastructure for RAG pipelines, agent memory, and semantic search Implement and maintain end-to-end RAG workflows, including document ingestion, chunking, embedding generation, and retrieval optimization Maintain and tune agent memory systems, including short-term context windows, long-term persistent memory stores, and episodic memory retrieval patterns Deploy, operate, and maintain Agentic AI systems, including multi-agent orchestration frameworks and tool-use pipelines Deploy, host, and maintain MCP servers within the containerized platform infrastructure Manage MCP server configurations, versioning, access controls, and integration with agentic workflows Monitor MCP server health, performance, and availability; respond to incidents and perform root cause analysis Develop automation and tooling to improve platform reliability and efficiency Provide L2/L3 technical support and vendor escalation for complex issues Implement security controls including network policies, RBAC, and secrets management Execute change requests and maintain technical documentation Respond to and assist in production operations in a 24/7 environment Provide technical analysis, resolve problems, and propose solutions Provide support to, and coordinate with, developers, operations staff, release engineers, and end-users Educate and mentor team members and operations staff Participate in a weekly on-call rotation for after-hours support   Knowledge and Experience Bachelor's degree preferred. 3+ years in infrastructure engineering, systems administration, or DevOps 3+ years in scripting and automation skills (Python, Ansible, GitOps) 3+ years hands-on experience with Kubernetes in

Listing verified . Applications go through the company's official careers site.

← Back to Yoinka