Lead Data Engineer, Technology Consulting- London, Leeds, Manchester or Newcastle

Agency: Credera Job Function: Consulting Job Subfunction: Technology Consulting Job Description: Would you like to be part of a fast-growing technology and engineering organisation that nurtures an open, collaborative learning environment? Are you passionate about technology, people and developing your coding skills? If this describes you, we’re trying to create the best engineering consultancy in the UK and would love for you to be part of the journey. We draw on our reputation for outstanding delivery to allow our engineers to do the right thing for our clients, and not necessarily the easy thing. Innovation is in our DNA, and we encourage our engineers and consultants to work together to rethink conventional wisdom on how problems should be solved. Our engineers take a holistic approach that addresses technology, process, and structure to make a lasting impact. At Credera, you will work on diverse client projects, such as building modern, AI-enabled data platforms on AWS using DevOps and MLOps practices, including large, distributed workloads, batch and streaming pipelines, and the data foundations that power machine learning, Generative AI and Large Language Model solutions. Working with architects, technology consultants and public sector client stakeholders, you will help customers make use of the data available to them while gaining exposure to regulated environments, networks and the latest AI technologies. Based out of any of our UK offices, this is a permanent role within our Data Function. At Credera, we operate a flexible hybrid working model. This requires 3 days per week working onsite - either at client site (as required) or in your local Credera office (London, Manchester, Leeds or Newcastle). We value collaboration and client impact, so our hybrid model is designed to strike a balance between flexibility, in-person connection, and delivering exceptional outcomes for our clients.

As a Lead Engineer at Credera, you will spend most of your time on client work, with the remainder of your time spent working on internal projects as well as training and development. Consultancy to us is about customer delivery first, carried out by technically excellent people. Our aim is not to pigeon-hole but rather upskill our engineers so they can learn and expand their expertise, as well as deliver on a variety of business-critical client projects. You are perceptive, personable, culturally sensitive and demonstrate a high degree of emotional intelligence. Being able to work collaboratively in a matrix organisation is essential, as is the ability to build data platforms using either cloud native products or commercial data analytics / data warehouse software. You will have: Accountable for leading multiple, complex areas of data engineering delivery to time, cost and quality with minimal direction Experience effectively and inclusively managing teams to deliver agreed scope, acting as the key point of escalation for decisions that impact your area of work Demonstrable experience of building data pipelines using Spark, Python or SQL Experience working with AWS and its data and AI/ML services such as SageMaker Experience of big data and lakehouse platforms on AWS (EMR, Databricks or Snowflake) Experience building data platforms such as Data Lakes, Lakehouses or Data Meshes that underpin analytics and AI workloads Understanding of Data Security, Data Governance and responsible AI principles The ability to partner with and influence senior stakeholders, building trust across the stakeholder landscape to drive the delivery of outcomes A track record of anticipating the risk landscape across a project and standing up multi-functional teams of SMEs to analyse and resolve issues Recognised as a subject matter expert who drives innovation and market-leading practices, bringing knowledge and experience from multiple clients and industries Have a drive for self-improvement and learning, including learning new programming