Data Engineer - #2111954
Oliver James
Data Engineer - Data Migration Programme | London (Hybrid) | Contract - up to £500/d (outside IR35)
Are you a Data Engineer with hands-on experience delivering enterprise data migration solutions? Our client - a fast-scaling European digital infrastructure provider with 100+ sites across the continent - is looking for a Data Engineer to join a major transformation programme consolidating multiple operational systems into a single target platform.
You'll be at the centre of the migration workstream: building the pipelines, transformation logic, and validation frameworks that move data from legacy systems into the new target operating platform - working closely with the Data Workstream Lead, business SMEs, and application teams.
What you'll be doing:
- Designing and building ETL/ingestion pipelines using Microsoft Fabric (Data Factory, Pipelines, Lakehouse, Notebooks) or equivalent Azure tooling
- Implementing source-to-target mappings and transformation logic for the migration
- Owning data validation, reconciliation, and defect resolution through migration test cycles
- Building reusable migration frameworks - ingestion pipelines, validation routines, error-handling
- Supporting CI/CD, Git-based release processes via Azure DevOps
What you'll bring:
- Extensive data engineering/integration/migration experience
- Hands-on Azure Data Factory, Fabric Data Factory, or Synapse Pipelines
- Strong SQL - profiling, transformation, validation, reconciliation
- PySpark/Spark SQL notebook experience (Databricks or Fabric)
- Proven experience on a data migration project end-to-end (extraction through reconciliation)
- Microsoft Fabric experience is a bonus, not a requirement - strong Azure Databricks/Synapse background welcomed
Nice to have: Microsoft Purview, Delta Lake/medallion architecture, Key Vault/Managed Identities, Azure DE Associate or Databricks certification.
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Corporate Tax Director (NFP and Social Purpose)
IT Infrastructure and Support Engineer
Bookkeeper