Sr Data Engineer

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, and data they need to feel their best. Here, you will find a culture guided by diversity and inclusion, talented peers, comprehensive benefits, and career development opportunities. Come make an impact on the communities we serve as you help us advance health equity on a global scale. Join us to start Caring. Connecting. Growing together. As a Senior Data Engineer on the UHC Core Data KTLO team, you will join our dynamic technology organization in Eden Prairie, MN, dedicated to building and optimizing robust data pipelines and systems that power critical healthcare platforms. In this role, you will design and deliver modern data and AI-powered solutions, platforms, and automations for enterprise scale. You will work with state-of-the-art technologies such as Python, Spark, Scala, and Kafka to build scalable, high-performance data processing pipelines and apply data warehousing and modeling best practices. You will play a key role in driving innovation by identifying opportunities to streamline workflows, automate tasks, and leverage advanced tools to address complex business challenges. Focus on KTLO activities, including vulnerability remediation, tool and version upgrades, data security, and platform stability. Additionally, support Azure Data Factory pipelines, Databricks workloads, and cloud components such as Blob Storage and AzCopy. You'll enjoy the flexibility to telecommute* from anywhere within the U.S. as you take on some tough challenges.

Design, develop, and deploy AI-powered solutions to address complex business challenges with emphasis on responsible use of AI Evaluate emerging trends to inform solution design and strategic innovation Use enterprise-approved AI tools to streamline workflows, automate tasks, and drive continuous improvement Build, optimize, and maintain robust, scalable data pipelines and processes using Python, Spark, and Scala Support and enhance real-time streaming data applications and messaging systems using Kafka Apply and promote data warehousing, data modeling, and database design best practices Collaborate with cross-functional teams to understand data requirements and translate them into high-performing technical solutions Identify and implement performance tuning and query optimization across large-scale datasets Design, develop, and deploy AI-powered solutions to address complex business challenges with emphasis on responsible use of AI You'll be rewarded and recognized for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed in your role as well as provide development for other roles you may be interested in.

5+ years of experience in data engineering, software engineering, or related field 3+ years of experience building and optimizing data processes and pipelines using Python, SQL,Spark, and Scala 3+ years of experience with data warehousing, dimensional data modeling, and database design 2+ years of experience supporting streaming data architectures and messaging platforms with Apache Kafka 2+ years of experience designing and deploying scalable automated solutions, platforms, or workflows (including integration of automation tools) 1+ years of experience with Apache Airflow for workflow orchestration, scheduling, and monitoring of data pipelines Preferred Qualifications: Bachelor's degree in Computer Science, Data Science, Information Technology, or a related field Experience working with cloud data platforms (e.g., AWS, Azure, or Snowflake) Experience with CI/CD pipelines, containerization (e.g., Docker, Kubernetes), and version control (Git) Experience evaluating emerging technology trends and applying modern automation tools to