Lead Data Engineer - #2200768

Oliver James


Date: 7 hours ago
City: London
Salary: £550 - £600 / day
Contract type: Full time
Oliver James

Lead Data Engineer - Databricks
Contract: 12 months, renewable
Location: Hybrid, 1 day a week in the office (London or Brussels)
Rate: Competitive day rate, depending on experience

A major international travel business is looking for a Lead Data Engineer to run a team of 5-7 engineers building its Databricks data platform and data products.

The role is split evenly: half leading people, half leading the engineering. You'll stay hands-on in code, design and review while coaching the team and acting as the main technical contact for business areas such as Commercial, Operations and Customer.

What you'll do

  • Lead, coach and develop a team of data engineers, and work with the Engineering Manager, Scrum Master and product owners on priorities and delivery
  • Set and enforce coding, testing, review and CI/CD standards
  • Build reusable project templates (Databricks Asset Bundles), shared libraries and CI/CD pipelines that every new data product follows
  • Make data AI-ready: rich metadata, semantic definitions and curated Genie spaces
  • Set standards for, and review the work of, analytics engineers in the business

What you'll need

  • 7+ years in data engineering, including at least 2 years leading or mentoring engineers
  • Deep hands-on experience with Databricks and Spark (Unity Catalog, Delta Lake, Lakeflow / DLT), plus strong Python and SQL
  • Strong data modelling skills and experience building data as a product
  • A track record of building templates, libraries or CI/CD that other engineers adopted
  • Working knowledge of AI data agents such as Databricks Genie
  • Clear communication with both technical and business stakeholders

Nice to have: dbt, Azure, FinOps on Databricks, data contracts, AI agent architecture (LLM, RAG, MCP), and experience leading teams across the UK and Europe. French is an advantage but not required.


How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

C/C++ Software Engineer - Core Dev- Global Quant Firm

eFinancialCareers,
6 hours ago
Summary Leading global HFT firm is looking for a pragmatic C/C++ Engineer to join the Core Development team. Despite serving as the hub for managing the substantial operations across the UK, Europe and the Middle East, the London office retains...
eFinancialCareers

Private Client Tax Manager - OMB

Pro-Tax Recruitment,
£80,000 / year
7 hours ago
Private Client Tax Manager - OMB London | Hybrid Working £80,000 + Excellent Benefits An exciting opportunity has arisen for an experienced Private Client Tax professional to join a growing and ambitious accountancy practice with an established reputation for advising...
Pro-Tax Recruitment

Management Accountant

Robert Walters,
£35,000 - £40,000 / year
7 hours ago
A leading real estate business in the UK is seeking a Management Accountant to join their Finance team based in the City of London. This permanent, full-time position offers an exciting opportunity for a part-qualified accountant who is eager to...
Robert Walters