Data Engineering Lead

London (Hybrid) | Contract | Inside IR35 | Up to £600 per day

We are supporting a major financial services transformation programme and are seeking an experienced Data Engineering Lead to drive the delivery of a modern cloud-based data platform.

This role requires a senior data engineering professional who can provide technical leadership across engineering teams while remaining hands-on when required. You will play a key role in designing scalable data solutions, establishing engineering standards, and leading the delivery of critical data initiatives within a complex enterprise environment.

Working closely with Data Architects, Product Owners and business stakeholders, you will help shape and deliver a strategic data platform transformation.

\n
• Lead data engineering delivery across multiple workstreams.
\n
• Provide technical leadership and guidance to Data Engineers.
\n
• Define and implement engineering standards, best practices and governance.
\n
• Design and oversee scalable data pipelines and transformation frameworks.
\n
• Collaborate with Data Architects to deliver target-state platform architecture.
\n
• Drive the migration of data assets from legacy platforms to modern cloud technologies.
\n
• Ensure data platforms are robust, secure, scalable and operationally efficient.
\n
• Partner with Product Owners and business stakeholders to deliver value-driven solutions.
\n
• Support architecture reviews and technical governance forums.
\n
• Mentor engineering teams and drive continuous improvement initiatives.
\n

\n
• Proven experience leading Data Engineering teams within large enterprise environments.
\n
• Experience delivering complex data transformation programmes.
\n
• Strong stakeholder management and communication skills.
\n
• Experience working across cross-functional delivery teams.
\n

\n
• Databricks
\n
• Delta Lake
\n
• Unity Catalog
\n
• dbt
\n
• Spark / PySpark
\n
• Data pipeline development
\n
• Lakehouse and modern data platform architectures
\n

\n
• AWS\n
  \n
  • S3
  \n
  • Glue
  \n
  • Airflow
  \n
\n

\n
• Data Vault
\n
• Kimball
\n
• Data warehousing concepts and best practices
\n

Experience supporting migrations from technologies such as:

\n
• Teradata
\n
• Hadoop
\n
• Oracle
\n
• SAS
\n

\n
• Financial Services or Banking sector experience.
\n
• Experience working within regulated environments.
\n
• Large-scale cloud transformation programmes.
\n
• Agile delivery methodologies.
\n
• Experience working alongside Data Product Owners and Data Architects.
\n

\n
• Strong technical leadership capability.
\n
• Excellent communication and stakeholder engagement skills.
\n
• Ability to influence both technical and non-technical audiences.
\n
• Strong problem-solving and decision-making abilities.
\n
• Delivery-focused mindset with a commitment to quality.
\n
• Comfortable operating within fast-paced transformation programmes.
\n

\n
• Day Rate: Up to £600 per day
\n
• Contract Type: Inside IR35
\n
• Duration: Initial contract through to December, with potential for extension
\n
• Location: London (Hybrid, subject to confirmation)
\n
• Start Date: ASAP / Short notice preferred
\n

If you are an experienced Data Engineering Lead with expertise across Databricks, dbt and AWS, and a proven track record delivering enterprise-scale data transformation initiatives, please apply with your latest CV for immediate consideration.