Senior Data Platform Engineer

Trust In SODA Chiswick, England, United Kingdom (Hybrid)
SaveApply

Senior Data Platform Engineer | Contract | London (West London, Hybrid)

3 months+ | Start November

A consultancy client of ours is looking for a Senior Data Platform Engineer to take ownership of their Databricks on AWS platform.

The platform supports their data science team and client analytics work across healthcare. It was built at pace, and now it needs someone senior to review it, tighten it up and get it production-ready.

What you’ll be doing

Reviewing and hardening the Databricks platform on AWS
Tightening security, IAM and access control through Unity Catalog
Building out Terraform and CI/CD
Improving pipelines in Python, PySpark and SQL
Documenting the platform and helping a junior engineer get up to speed

What you’ll need

Strong hands-on Databricks on AWS
Terraform and CI/CD
Good grasp of platform security and access control
Python, PySpark and SQL

Nice to have

Healthcare or NHS data experience

The details

3 months initially, with a good chance of extending
Hybrid, 3 to 4 days a week in West London
Starting this month