Senior Data Engineer
London, Birmingham, Remote
Salary up to £65,000 per annum

An exciting opportunity has arisen to join a global organisation within the Assurance space. As the new Senior Data Engineer you will play a pivotal role within the Data team of the Digital and Information Function, assuming a leadership position in ensuring the availability, integrity, quality, and accuracy of data.

Key responsibilities include:

• Ownership and delivery of the design, development and maintenance of highly scalable and robust data pipelines and workflows utilising Azure Data Factory and Databricks.
• Lead data transformation and integration efforts to augment data from diverse sources, ensuring data governance and regulatory compliance throughout the process.
• Establish and enforce data quality standards through the implementation of rigorous data validation processes, ensuring the utmost accuracy, completeness, and consistency of the data ecosystem.
• Serve as a key liaison between cross-functional teams, including data scientists, analysts, and business stakeholders, to comprehensively understand data requirements, conduct User Acceptance Testing (UAT), and deliver tailored solutions that align with business objectives.
• Proactively monitor pipeline performance, swiftly identifying and resolving any potential issues to uphold seamless data processing operations and minimize downtime.
• Drive comprehensive documentation of data pipelines, workflows, and procedures to foster knowledge sharing and ensure ongoing system maintainability and scalability.

Skills required:

• Hands-on advanced experience in designing, developing, and managing data pipelines using Azure Data Factory.
• Strong working knowledge of Databricks for data processing, analytics and Machine learning.
• Advanced experience with Datamodelling techniques and data warehousing concepts.
• Advanced proficiency in SQL for data querying and manipulation and good knowledge of Python.
• Ability to work effectively in a fast-paced, dynamic environment and manage multiple priorities, following the Agile way of working
• Ability to lead and analyse complex data problems and propose effective solutions.
• Excellent communication skills with the ability to collaborate effectively with cross-functional teams.

This represents an excellent opportunity for a Data Engineer with strong hands on experience within the Azure stack, who also has some leadership/mentorship experience. There is plenty of progression available for the right person.

If you are interested, please apply for full details.