Please answer the following questions in order to process your application.
Select your working status in the UK *
File Attachments:
(2MB file maximum. doc, docx, pdf, rtf or txt files only)
* denotes required field
Additional Information:
Availability/Notice
Salary Expectation GBP
Approximately how far are you willing to travel to work (in miles) ?
Key Privacy Information
When you apply for a job, JobNet will collect the information you provide in the application and disclose it to the advertiser of the job.
If the advertiser wishes to contact you they have agreed to use your information following data protection law.
JobNet will keep a copy of the application for 90 days.
More information about our Privacy Policy.
Job Details
Lead Data Engineer - SQL, Python, PySpark, Azure, Databricks, Lloyds, Insurance, Permanent (Permanent)
Location: London Country: UK Rate: £90k - 110k per annum
Lead Data Engineer - SQL, Python, PySpark, Azure, Databricks, Lloyds, Insurance, Permanent - LondonA fast-growing global Insurance broker situated in the City of London is searching for a Lead Data Engineer to join their newly formed Data & Analytics team and play a pivotal role in their data transformation. At present, they're looking to transition from a program-based structure into a balanced operation through embracing agile methodologies to augment efficiency.
The Lead Data Engineer will be tasked with creating a Lakehouse platform in Azure by owning, managing, and implementing data engineering pipelines within Azure Databricks to ingest both structured and unstructured data from the global business. Furthermore, you will be responsible for managing a small team of engineers to help grow their careers and enable them to succeed.
Skills Required
- It is imperative to have worked as a Principal or Lead Data Engineer in a previous business and can manage your own deliverables.
- Prior experience working with large datasets and a proficiency in SQL, Python and PySpark is required.
- Experience of managing a team of Engineers with varying degrees of experience.
- Experience of pipeline deployment within Azure Databricks in line with the medallion architecture framework.
- It would be highly beneficial to understand the London Insurance Market, with a particular preference given to Lloyds.
This is an excellent opportunity to join a well-respected fast-growing Insurance business as they look to double their size in the next three years.
Cornwallis Elt is an Employment Agency & Employment Business and has been listed 3 times in The Sunday Times Virgin Fast Track 100 of the UK`s fastest growing private companies, as well as in the Recruitment International Top 250, Top 50 in IT and the Recruiter Fast 50 & Hot 100 reports.
Posted Date: 09 May 2024
Reference: JSBHJOB6067_20533-1
Employment Agency: Cornwallis Elt Ltd
Contact: Patrick Jordan