Data Engineer - #2197891

confidential


Date: 14 hours ago
City: London
Contract type: Contractor
confidential

Data Engineer – Spark / PySpark

Technify Talent is recruiting an experienced Data Engineer to build data platforms that support research engineers and other technical specialists within a fast-paced startup.

We’re looking for someone fluent in Spark and PySpark who understands how to build reliable, usable data platforms for people tackling complex research and analytical problems. You’ll bring strong engineering foundations alongside regular use of AI coding agents.

What you’ll be doing

  • Building and developing data platforms and pipelines using Spark and PySpark.
  • Working closely with research engineers and specialist users to understand their data needs.
  • Making data accessible and dependable for research and analytical work.
  • Using AI coding agents to support development, while taking ownership of code quality and technical decisions.
  • Adapting the platform as requirements and priorities evolve.

What we’re looking for

  • Strong commercial data engineering experience and fluency in Spark/PySpark.
  • Experience building data platforms for research engineers, quants or similarly specialist users.
  • Solid engineering foundations developed before AI coding tools became commonplace.
  • Frequent, practical use of coding agents, with no preference for a particular tool or provider.
  • The ability to work independently and translate complex requirements into practical solutions.

Useful extras

  • Familiarity with the AWS data stack.
  • Experience working in a fast-moving startup with changing priorities.

For further details please contact Katie Collins

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

Senior AV Systems Engineer

Link Media Systems Projects Ltd,
£45,000 - £55,000 / year
13 hours ago
As a growing Systems Integration company we are currently looking for an Engineer with skills and experience in the following systems to join our team: Core AV Systems Audio: DSP programming, mic/speaker selection, gain structure, Dante Video: displays, projectors, LED...

Fusion Centre / SOC Design Consultant

confidential,
£750 - £830 / day
13 hours ago
Fusion Centre / SOC Design Consultant – SC Cleared Rate: Up to £830 per day – Inside IR35 Contract: December 2026 – 31st March 2027 (initially) Clearance: Active SC clearance required Client: Central Government Department We are seeking an experienced ...

Paralegal, Compliance

Carta,
13 hours ago
The Company You’ll Join Carta is the connected platform and AI-native ecosystem for private capital. Built to replace fragmented tools with a single system of record, Carta brings together the software, services, and legal infrastructure that founders use to manage...
Carta