Senior Data Engineer
- Location
- Pune, India
- Employment
- Full Time
- Work model
- On-Site
- Level
- Senior
- Posted
Skills
About this role
The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.
Responsibilities
Develop data warehouse, develop data as a product, lead architect and solution, development, maintenance of scalable and secure data architecture to support downstream and reporting application and data integration, and simplify complex data processes utilizing best engineering practices and data lifecycle management · Develop data models, taxonomies, metadata, data mappings, data standards, versioning, and semantic layers for domains and data products and support data consumption, AI and regulatory requirements. · Build automated data integration solutions and data pipelines including reference data to meet business and reporting requirements Exhibit strong leadership qualities, fostering a positive and collaborative work environment, providing guidance and mentorship to team members, and promoting a culture of continuous learning. · Implement data governance and management, quality standards and data controls to ensure data accuracy and security so downstream applications can consume data confidently. Manage and maintain data process documentation · Define Contribute to technical direction and enhancement as a technical expert in data development and implementation phases, providing in-depth and sophisticated analyses to define problems and develop innovative solutions Work closely with business users, stakeholders, BAs, product managers and other development teams to understand problem space, brainstorm ideas, approaches, and solutions. Contribute to CI/CD implementation using DevOps best practices and ensure robust testing framework is utilized for functional and nonfunctional testing for the release cycles based on industry and Citi standards and work to implement them. Work closely with business users, stakeholders, BAs, product managers and other development teams to understand problem space, brainstorm ideas, approaches, and solutions. · Contribute to technical direction and strategic decisions as a technical expert in all development and implementation phases, providing in-depth and sophisticated analyses to define problems and develop innovative solutions Demonstrate a data-driven approach to problem-solving and decision-making, utilizing metrics, and performance indicators to assess team efficiency and identify improvement opportunities. Manage and maintain data processes and jobs. Partner with Support team to ensure stability of production environment with proactive monitoring and health checks. Partner with other Citi development teams to build APIs, integrations and share components that are critical to our platform’s success.
Qualifications
Strong experience in designing and building best in class enterprise data engineering excellence in a highly matrixed, complex organization Strong experience in architecting complex end-to-end data pipelines in a highly available, distributed systems of data extraction, ingestion, processing of large data sets. Strong hands-on in advanced development experience in large database, complex data models, procedures, error handling, performance tuning/profiling, data security, database optimization and configurations. Solid experience in complex data integration Strong experience in large complex physical and logical data model design and development for data warehouse, reporting and reference and master data. Hands-on experience with complex data integration and developing scalable, high-volume data pipelines using APIs, Python, Airflow, and Spark Experience in data mesh technologies Trino/Starburst, S3, distributed stream