Data Engineer
Job Description
Data Engineer - Data Migration Programme | London (Hybrid) | Contract - up to £500/d (outside IR35)
\nAre you a Data Engineer with hands-on experience delivering enterprise data migration solutions? Our client - a fast-scaling European digital infrastructure provider with 100+ sites across the continent - is looking for a Data Engineer to join a major transformation programme consolidating multiple operational systems into a single target platform.
\nYou'll be at the centre of the migration workstream: building the pipelines, transformation logic, and validation frameworks that move data from legacy systems into the new target operating platform - working closely with the Data Workstream Lead, business SMEs, and application teams.
\nWhat you'll be doing:
\n- \n
- Designing and building ETL/ingestion pipelines using Microsoft Fabric (Data Factory, Pipelines, Lakehouse, Notebooks) or equivalent Azure tooling \n
- Implementing source-to-target mappings and transformation logic for the migration \n
- Owning data validation, reconciliation, and defect resolution through migration test cycles \n
- Building reusable migration frameworks - ingestion pipelines, validation routines, error-handling \n
- Supporting CI/CD, Git-based release processes via Azure DevOps \n
What you'll bring:
\n- \n
- Extensive data engineering/integration/migration experience \n
- Hands-on Azure Data Factory, Fabric Data Factory, or Synapse Pipelines \n
- Strong SQL - profiling, transformation, validation, reconciliation \n
- PySpark/Spark SQL notebook experience (Databricks or Fabric) \n
- Proven experience on a data migration project end-to-end (extraction through reconciliation) \n
- Microsoft Fabric experience is a bonus, not a requirement - strong Azure Databricks/Synapse background welcomed \n
Nice to have: Microsoft Purview, Delta Lake/medallion architecture, Key Vault/Managed Identities, Azure DE Associate or Databricks certification.
