Senior AI Engineer

We are seeking a Senior AI Engineer to join our Engineering team. In this role, you'll design retrieval architectures, build AI-powered agents, and own production deployments that serve health insurance plans covering over 15 million people. You'll partner closely with product, data science, and clinical teams to build the foundation that transforms how clinical intelligence is delivered at scale - from hands-on code to HIPAA-compliant systems that directly improve healthcare outcomes. This is an opportunity to work at the intersection of cutting-edge AI and real-world impact, in a fast-paced, collaborative environment.

This is a remote-first role that may require travel to Boston, MA for new hire onboarding and occasional in-person team meetings and company events.

• Agent Development: Participate in the development, evaluation, and deployment of Cohere’s AI-powered agents and applications.

• Data & Retrieval Architecture: Design data and retrieval architectures that give AI agents the right context, across diverse healthcare sources.

• Hands-On Engineering: Design, review, and own high-quality agentic code — leading releases, production deployments and on-call support.

• Cross-Functional Collaboration: Work closely with ML/DS teams, product teams, and architects to understand requirements and ensure systems meet business needs.

• Security & Compliance: Ensure all agentic components comply with healthcare security and privacy regulations (e.g., HIPAA) and adhere to industry best practices for security.

• Agile Development: Contribute to sprint planning, execution, and retrospectives, driving efficiency and velocity within the engineering team and collaborating closely with stakeholders to align with product goals and business priorities.

• 5+ years of experience in the software development lifecycle, with demonstrated experience working with popular agent frameworks and language models.

• Expertise in one or more modern languages for development.

• Experience with any cloud platform, CI/CD pipelines, and Infrastructure as Code (IaC) tools.

• Experience with AI architectures, Multi-agent systems, RAG, and Evaluation frameworks.

• Experience shaping engineering standards, frameworks, or libraries used across multiple teams.

• Familiarity with human-in-the-loop system design and AI safety considerations in production is a plus.

• Experience with graph-based or multi-modal data retrieval in the context of AI reasoning is a plus.

• Bachelor's degree in Computer Science, Software Engineering, or a related field

💻 Fully remote opportunity with about 5% travel

🩺 Medical, dental, vision, life, disability insurance, and Employee Assistance Program

📈 401K retirement plan with company match; flexible spending and health savings account

🏝️ Flex Time Off + company holidays

👶 Up to 14 weeks of paid parental leave

🐶 Pet insurance

The salary range for this position is $135,000 to $170,000 annually; as part of a total benefits package which includes health insurance, 401k and bonus. In accordance with state applicable laws, Cohere is required to provide a reasonable estimate of the compensation range for this role. Individual pay decisions are ultimately based on a number of factors, including but not limited to qualifications for the role, experience level, skillset, and internal alignment.

• Connect with Talent Acquisition for a Preliminary Phone Screening

• Meet your Hiring Manager!

• Feature Design