Executive Director, Product Director – GenAI Gateway & Orchestration
- Location
- Palo Alto, CA
- Employment
- Full Time
- Work model
- On-Site
- Level
- Staff
- H-1B history
- 1,524 approvals (FY2023)
- Posted
Skills
About this role
Job Description
Ignite your passion for product innovation by leading customer-centric development, inspiring solutions, and shaping the future with your strategic vision and influence. Step into a role where you define how the firm builds and runs the next generation of AI applications, turning a powerful runtime platform into a true point of leverage for the teams you serve. You will remove friction, accelerate the path from idea to production, and set the standard for how secure, resilient infrastructure is delivered at scale. As a Product Director in the Model & Serving team, you lead innovation through the development of products and features that delight customers. As a leader on the team, you leverage your advanced capabilities to challenge traditional approaches, remove barriers to success, and foster a culture of continuous innovation that helps inspire cross-functional teams create groundbreaking solutions that address customer needs. You shape how enterprise teams access models through a runtime layer with routing, guardrails, observability, telemetry, evaluation, and cost management built in by default. Partnering across Engineering, Architecture, Cybersecurity, Risk, Finance, and the business, you deliver a secure, resilient platform that dramatically shortens the time from idea to production. This role calls for a senior product leader with deep expertise in AI infrastructure, distributed systems, and model serving who can set a clear vision and lead execution at enterprise scale. You balance speed and simplicity for application teams with enterprise requirements for security, compliance, multi-tenancy, and cost control, ensuring the platform scales reliably as demand grows.
Job responsibilities
Oversees the product roadmap, vision, development, execution, risk management, and business growth targets Leads the entire product life cycle through planning, execution, and future development by continuously adapting, developing new products and methodologies, managing risks, and achieving business targets like cost, features, reusability, and reliability to support growth Coaches and mentors the product team on best practices, such as solution generation, market research, storyboarding, mind-mapping, prototyping methods, product adoption strategies, and product delivery, enabling them to effectively deliver on objectives Owns product performance and is accountable for investing in enhancements to achieve business objectives Monitors market trends, conducts competitive analysis, and identifies opportunities for product differentiation Serves as the accountable product leader for the generative AI Gateway across both federated and managed deployment models, driving adoption and platform outcomes Defines the target-state gateway architecture with Engineering and Architecture partners, including data, multi-cloud, and multi-region deployment strategies and consistent capabilities across federated and managed models Leads token management and intelligent model routing across policy, cost, and latency to support multi-model and agentic workloads Drives traffic management and resiliency capabilities so the platform scales reliably with demand, partnering with Engineering to optimize inference performance and cost Makes security and governance default capabilities applied to every model call, and owns guardrails, observability, and telemetry that give teams full visibility into production behavior Communicates strategy, delivery progress, risks, dependencies, and recommendations to senior leadership and governance forums Required qualifications, capabilities, and skills 8+ years of experience or equivalent expertise delivering products, projects, or technology applications Extensive knowledge of the product development life cycle, technical design, and data analytics Proven ability to influence the adoption of key product life cycle activities including discovery, ideation, strategic development, requirements definition, and