Senior Data Engineer

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all.

The opportunity    Role: Senior Data Engineer     Your key responsibilities

Developing large and complex data architecture, composed of models, policies, rules or standards that govern which data is collected and how it is stored, arranged, integrated and put to use in data systems, including the design, build and management of data infrastructure to address business requirements Developing relationships across the business to understand data requirements, applies deep technical knowledge of data management to solve business problems in areas where solutions may not currently exist, necessitating new solutions/ways of working/technologies and proactively articulating these to the business Collaborating and providing innovative and practical designs for the design and integration of new data architecture for the enterprise, applying sophisticated technical capabilities Creating, maintaining and supervising on-premise or cloud infrastructure, such as the design of end-to-end data platforms, development and operations of cloud management and design of distributed systems, handling structured and unstructured data Working across multidisciplinary teams and with the business to define and delivering analytics solutions that will deliver business value Contributing to data management standards to promote optimization and consistency

Required Skills (MUST HAVE)   Python Development

Strong Python programming skills with the ability to design, develop, test, and deploy end-to-end applications and data processing solutions. Proficiency in object-oriented programming, data structures, design patterns, and asynchronous programming. Strong understanding of Python language features including classes, inheritance, collections, decorators, context managers, generators, exception handling, package management, and virtual environments. Experience developing scalable, maintainable, and production-grade applications following coding standards and best practices.

Data Processing & Analytics

Hands-on experience with data processing frameworks such as Pandas and Polars . Ability to perform medium to complex data transformations, data cleansing, aggregation, enrichment, and optimization of large datasets. Strong understanding of memory-efficient data processing techniques and performance tuning.

Azure Data Engineering

Experience designing and implementing data engineering solutions on Azure platforms including Azure Databricks, Azure Data Factory (ADF), Azure Synapse Analytics, Azure Data Lake Storage (ADLS), Azure Service Bus, and Azure Event Hub . Ability to translate business requirements into scalable end-to-end ETL/ELT pipelines. Experience processing batch and streaming data using Kafka, Azure Event Hub, or similar messaging platforms. Understanding of data orchestration, monitoring, and operationalization of data pipelines.

Spark & Database Technologies

Strong foundational knowledge of Apache Spark (PySpark) and SQL , including query optimization and performance tuning. Experience working with relational databases such as Azure SQL, Oracle, DB2, Teradata, PostgreSQL, and SQL Server . Understanding of data modeling, partitioning strategies, indexing, and distributed data processing concepts.

Additional Skills (GOOD TO HAVE)

Experience in metadata management and data governance with Unity Catalog or Microsoft Purview.   Experience working with NoSQL databases such as MongoDB, Cassandra, HBase, Couchbase, and Neo4j . Graph Databases: Should have extensive experience designing and modelling enterprise solutions on the Neo4j