STAFF SOFTWARE ENGINEER, Frontier Security Team
Snowflake
- Location
- US-CA-Menlo Park
- Employment
- Full Time
- Work model
- On-Site
- Level
- Staff
- H-1B history
- 110 approvals (FY2023)
- Posted
- 1h ago
Skills
About this role
At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. At Snowflake, we are powering the era of the agentic enterprise. We seek AI-native engineers who are curious about emerging capabilities, rigorous about measured results, and motivated to redefine how software is built and operated. Snowflake’s Frontier Security AI teams develop production-grade LLM applications, intelligent agents, AI infrastructure, and evaluation systems for enterprise customers. Our products must meet a high bar for quality, security, reliability, and efficiency while operating over sensitive data at large scale.
ABOUT THE ROLE
We are looking for a Staff Software Engineer to lead the design and development of our Agentic Harness and agent evaluation platform. The Agentic Harness provides the runtime, tools, context, state, policies, and observability required to build and operate production AI agents. The evaluation platform measures how well those agents complete real customer tasks and detects regressions before they reach production. This is a hands-on technical leadership role. You will build production systems, establish architecture across team boundaries, and define the metrics and engineering practices used to improve agent quality. You will work with product, infrastructure, applied AI, security, and modeling teams to take new AI capabilities from prototype to dependable customer value. WHAT YOU WILL DO IN THIS ROLE • Architect and build the Agentic Harness that executes complex, multi-step AI workflows across models, tools, data, and services. • Design stable interfaces for tool execution, context construction, state management, memory, permissions, retries, fallbacks, and human review. • Own agent quality end to end by building evaluation harnesses, representative datasets, automated graders, experiment pipelines, and release gates. • Convert ambiguous reports such as “the agent feels worse” into measurable failure modes, reproducible tests, and durable fixes. • Analyze production agent trajectories to identify failures in reasoning, retrieval, tool use, context, orchestration, and application code. • Close the loop between production incidents, root-cause analysis, evaluation coverage, and regression prevention. • Develop offline and online measurements for task completion, correctness, groundedness, safety, latency, reliability, and cost. • Build simulation and replay infrastructure for golden-set tests, adversarial scenarios, model comparisons, and large-scale experiments. • Improve agent efficiency through model routing, prompt and semantic caching, context compaction, tool-result management, and token optimization. • Productionize new model capabilities as secure, observable, multi-tenant services with clear operational controls. • Establish standards for evaluation design, including sampling, ground-truth quality, grader calibration, leakage prevention, and statistical significance. • Define technical direction across multiple teams and lead projects whose scope extends beyond a single service. • Mentor engineers, raise the quality of architecture reviews, and remain directly involved in implementation and debugging. REQUIREMENTS • 9+ years of software engineering experience, including technical leadership of complex production systems. • Direct experience