Senior Data Engineer Python, Databricks - CER Financial - #2120809

Senior Data Engineer (Python, Databricks)

London

Hybrid (3/2 split)

6-month contract

£500 - £900 per day (via Umbrella)

cer Financial are working alongside an international bank who are looking for an experienced Senior Data Engineer to join their team on an initial 6-month contract. This is a hybrid role, requiring 3 days per week in the office.

Responsibilities:

· Design, build and optimise scalable data pipelines using Python and Databricks.

· Develop ETL/ELT workflows with Spark and Delta Lake.

· Build and maintain Lakehouse data models and architectures.

· Ensure data quality, governance and platform reliability.

· Optimise large-scale data processing and support analytics and ML initiatives.

· Mentor junior engineers and promote engineering best practices.

What the candidate needs:

· 10+ years' experience in Data Engineering.

· Strong Python and Databricks expertise, including Spark/PySpark and Delta Lake.

· Experience building scalable ETL pipelines and working with SQL.

· Knowledge of cloud platforms (AWS, Azure or GCP).

· Experience with modern data warehouses such as Snowflake, Redshift or BigQuery.

· Familiarity with Airflow or Databricks Workflows.

· Databricks certifications and experience with Kafka, Docker, Kubernetes or CI/CD are advantageous.