Principal DevOps Engineer
- Location
- Austin / San Jose
- Employment
- Full Time
- Work model
- On-Site
- Level
- Principal
- Salary
- $200k/yr
- H-1B history
- 4 approvals (FY2023)
- Posted
Skills
About this role
SambaNova is a leader in next-generation AI infrastructure, delivering a full-stack inference platform for customers worldwide. At the core of SambaNova's technology is the RDU (Reconfigurable Dataflow Unit) — a chip built on a dataflow architecture rather than the traditional GPU model. Its decode performance is especially strong for agentic workloads like multi-turn agents, code generation, and long-running applications. RDUs are packaged into SambaRack, rack-scale hardware that lets customers deploy state-of-the-art models with better performance, greater energy efficiency, and faster time to value.
About the Role
SambaNova is hiring a DevOps Engineer for SambaNova’s SambaSuite platform.
We are helping enterprises and service providers build their AI inference platforms for end users, powered by our state-of-the-art RDU (Reconfigurable Dataflow Unit) hardware architecture. Our cloud-agnostic, enterprise-grade MLOps platform abstracts infrastructure complexity and enables seamless deployment, management, and scaling of foundation model workloads at production scale.
As a DevOps Engineer, you will take ownership of our CICD pipelines and help build a robust and scalable release infrastructure across our components.
This is a high-impact, high-visibility role working at the intersection of AI infrastructure, enterprise software, and developer experience.
Responsibilities
• Design, build, and maintain scalable infrastructure and deployment pipelines for enterprise AI platforms
• Architect and implement robust CI/CD pipelines using tools such as CircleCI, GitHubActions etc ensuring stability, scalability, and performance
• Optimize CICD workflows, including configuration management and integration with build systems
• Drive SRE practices including monitoring, observability, alerting, incident response, and post-mortems
• Deploy and manage Kubernetes clusters and maintain Helm charts for application deployments
• Design and implement infrastructure solutions using GCP services.
• Establish and enforce infrastructure-as-code standards using tools like Terraform, etc.
• Collaborate with development teams to optimize build, test, and deployment processes
• Lead capacity planning, disaster recovery and SecOps workflows
• Automate operational workflows and reduce toil through intelligent tooling and process improvements
Required Qualifications
• 5+ years of experience in DevOps, SRE, or Infrastructure Engineering roles.
• Proven track record of designing, building, and maintaining large-scale infrastructure in production environments
• Advanced proficiency in Linux/Unix systems administration, shell scripting, and automation
• Deep experience with modern CI/CD practices and tools such as CircleCI, Jenkins, GitLab CI/CD, or similar platforms
• Extensive experience with large monorepos or build systems such as Bazel
• Strong expertise in containerization (Docker) and orchestration (Kubernetes), including production deployments
• Expert knowledge of infrastructure-as-code tools such as Terraform, Ansible, or CloudFormation
• Extensive experience with cloud platforms (GCP preferred; AWS or Azure experience also valuable)
• Hands-on experience with monitoring and observability tools such as Grafana, Prometheus, OpenSearch, or ElasticSearch
• Experience with incident management practices and tools like OpsGenie, PagerDuty, Jira, or ServiceNow
• Strong understanding of networking protocols,