Associated Director of CE Data Engineering

At Lilly, the work is demanding because patients are waiting. We unite caring with discovery to help make life better for people around the world, knowing that every decision, every detail, and every day matters. Headquartered in Indianapolis, Indiana, our over 50,000 employees around the globe take on complex challenges to discover and deliver life-changing medicines, strengthen how health is understood and managed, and support the communities we serve. This is hard, urgent, selfless work—but it’s work worth doing. If you’re driven by purpose and ready to bring your best to work that truly matters for patients, we invite you to join us.  Organization Overview Lilly CIA powers the enterprise with governed, AI-ready data products, a converged semantic layer, and the identity and policy infrastructure behind Lilly's digital experiences. Within CIA, the LillyDirect Covered Entity (CE) Pharmacy pod builds and operates the data platform that sits inside the pharmacy's covered-entity trust boundary — handling identified PHI under HIPAA with strict isolation from parent-side systems. This role leads the engineering team that builds and operates that platform.

Summary The Associate Director of CE Data Engineering owns engineering delivery and standards for the CE Pharmacy data platform on Databricks. This position leads a team of data engineers implementing the medallion pipelines, data contracts, and isolation controls that the CE Data Architect designs — translating architectural intent into a reliable, tested, production engineering practice. The role sets the CE engineering strategy (tooling, automation, quality standards, CI/CD), develops the team, and partners with the CE Data Architect (design) and DataHub Product Owner (product) to ship governed, PHI-compliant data products at scale.

Lead the CE Data Engineering strategy: drive excellence in engineering practices, set standards for pipeline design, testing, and code quality, and ensure the team's work aligns to the CE Data Architect's canonical models and isolation boundary. Own the end-to-end engineering delivery lifecycle for CE data products — from requirements and prototyping through production deployment and maintenance — across the team's portfolio of pipelines. Evaluate and standardize on Databricks capabilities and integration patterns (Unity Catalog, Delta Lake, Workflows, serverless compute, Lakebase) across the team, balancing performance, cost, and scalability. Establish and enforce data quality, testing, and validation methodology (pytest, DLT/Great Expectations) across all CE pipelines; own monitoring and alerting standards so issues are caught proactively, not in production incidents. Own the CE CI/CD strategy — GitHub Actions-based, Git-based promotion dev → test → prod — for data, contract, policy, and agent artifacts, ensuring the team ships safely and repeatably. Advocate and enforce standard processes across the CE data asset lifecycle, working closely with the CE Data Architect, DataHub Product Owner, and Policy-as-Code Engineer. Partner across governance and platform — HIPAA governance, Privacy, Legal/DLO, and platform owners (EPH) — to keep engineering practice compliant and defensible, advancing architecture or policy blockers rather than working around them. Advise collaborators and partner teams on proper use of CE data, and communicate delivery status, risk, and tradeoffs to both technical and non-technical collaborators. Lead special projects and multi-functional initiatives for the CE Pharmacy platform as needed.

Bachelor's in Computer Science, Engineering, Information Technology, Information Management, or similar degree. 8+ years of experience in data engineering 3+ years leading data engineering teams. Expertise in SQL, Python, and Databricks / Unity Catalog (Delta Lake, Workflows, notebooks, catalog/schema/grants) at production scale. Qualified applicants