Senior Data Platform Engineer

Job Description
Senior Data Platform Engineer
Up to £80,000
1 day a week in office (flexible)
Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps.
Responsibilities
Design and implement Data Pipelines for both structured and unstructured data.
Support and improve ML infrastructure – particularly Azure ML.
Data Engineering: Guarantee data access, Data quality, ETL, Data pipelines
Platform administration: Help set up accesses, infrastructure, create new storage, enforce best practices
Production: Help the preparation of the data science pipelines, interact with data scientists, re-shape code, support towards some ML Ops principles, make the ML platform easy for users
Requirements
An academic background in Statistics, Mathematics, or Computer Science (or similar)
A number of years of commercial work as a Senior Data Engineer (responsible for taking decisions, rather than just writing code)
An ability to write production quality Python code.
Strong SQL Skills
Experienced creating data pipelines in a cloud (preferably Azure) environment
TDD & CI/CD experience
Containerisation experience (Docker, Kubernetes, etc.)
Good understanding of software best practises
MongoDB (or NoSQL) experience
Terraform experience
Previous experience in managing the ML lifecycle with MLFlow
Unfortunately sponsorship isn't provided for this role
If you are interested please apply here or reach out to #####