IN_Senior Associate_AWS Data Engineer_D&A_Advisory_Bangalore

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In data analysis at PwC, you will focus on utilising advanced analytical techniques to extract insights from large datasets and drive data-driven decision-making. You will leverage skills in data manipulation, visualisation, and statistical modelling to support clients in solving complex business problems. * Why   PWC At  PwC , you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities. This purpose-led and values-driven work, powered by technology in an environment that drives innovation, will enable you to make a tangible impact in the real world. We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life. Together, we grow, learn, care, collaborate, and create a future of infinite experiences for each other. Learn more  about us . At  PwC , we believe in providing equal employment opportunities, without any discrimination on the grounds of gender, ethnic background, age, disability, marital status, sexual orientation, pregnancy, gender identity or expression, religion or other beliefs, perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm’s growth. To enable this, we have zero tolerance for any discrimination and harassment based on the above considerations. " Job Description & Summary: A Career with in .........................

Role Overview  We are looking for an experienced   AWS Data Engineer   with 4–8 years of hands-on experience in designing, developing, and maintaining scalable data pipelines and cloud-based data platforms.   The ideal candidate will have strong expertise in   AWS, Snowflake, Apache Airflow, Python,   PySpark, and SQL , with a solid understanding of data warehousing, ETL/ELT, data modeling, and performance optimization.   The candidate will work closely with data architects, analysts, application teams, and business stakeholders to build reliable and scalable data solutions.

Design, develop, and maintain scalable   data pipelines and ETL/ELT workflows   using AWS services.   Build and orchestrate data pipelines using   Apache Airflow , including DAG development, scheduling, monitoring, retries, dependencies, and error handling.   Develop data processing and transformation solutions using   Python and   PySpark .   Design and implement data warehouse solutions using   Snowflake .   Develop complex   SQL queries, stored procedures, views, CTEs, and data transformations .   Work with AWS services such as   S3, Glue, Lambda, EMR, Athena, Redshift, and IAM .   Build batch and, where required, near-real-time data ingestion pipelines.   Implement data ingestion from APIs, databases, files, and other source systems into AWS/Snowflake.   Perform   Snowflake performance and cost optimization , including warehouse sizing, query optimization, clustering, partitioning, and efficient data loading.   Implement Snowflake features such as   Snowpipe, Streams, Tasks, stages, file formats, and secure data sharing .   Develop scalable Spark/ PySpark   jobs and optimize transformations,   joins, partitioning, caching, and resource utilization.   Implement data quality checks, validation, reconciliation, and monitoring mechanisms.   Troubleshoot   pipeline failures, data issues, performance bottlenecks, and production