Data Engineer

We are seeking a qualified Data Engineer to join our team, where your responsibilities will include:
Designing, optimizing, and maintaining scalable data pipelines and ETL processes using Spark, ensuring streamlined data processing and integration.
Collaborating cross-functionally to translate complex data requirements into actionable technical solutions that drive business objectives.
Leveraging Microsoft Azure and Databricks to architect robust data solutions, prioritizing performance optimization for enhanced operational efficiency.
Conducting data modeling, profiling, and quality assessments to uphold the integrity and reliability of our data assets.
Executing data governance, transformation, and integration initiatives to support advanced analytics and reporting requirements.
Integrating machine learning models seamlessly into data pipelines to facilitate predictive and prescriptive analytics.
Ensuring adherence to data security protocols and regulatory compliance standards, maintaining the highest levels of database integrity and operational excellence.
This position is available at either our London or locations around the Midlands.
Ideal Candidate Profile: We are seeking an individual who have the following attributes:
Proven expertise as a Data Engineer, demonstrating proficiency in Apache Spark and cloud-based technologies, particularly Microsoft Azure and Databricks. Strong programming skills, with a focus on Python, along with proficiency in ETL frameworks and data integration tools. In-depth knowledge of data governance and modeling principles, with a keen eye for data quality and accuracy. Versatility across database technologies, encompassing SQL and NoSQL, coupled with a steadfast commitment to data security and confidentiality. A problem-solving mindset, coupled with excellent communication skills and a collaborative approach to teamwork.