Principal Azure Data Engineer (Databricks)

10 Days Old

UK - LondonLocation: London (Hybrid) | Practice Area: Technology & Engineering | Type: PermanentLead the architecture of data platforms driving the future of financial servicesThe RoleAs a Principal Azure Data Engineer (Databricks) at Capco, you'll architect and lead the delivery of enterprise-grade data solutions using the Databricks platform within the Azure ecosystem. You'll drive the design and implementation of streaming and batch data pipelines, helping our clients to modernise their data capabilities. Working with cross-functional teams, you’ll guide clients on best practices and technical strategy, ensuring quality and security standards are maintained across deployments.What You’ll DoLead the end-to-end delivery of Databricks-based solutions across Azure environmentsArchitect secure and scalable pipelines using DeltaLake, Spark Structured Streaming, and Unity CatalogDevelop and enforce engineering best practices across the data lifecycleEngage with clients to define solution strategies and data governance frameworksMentor engineering teams and contribute to internal capability development initiativesWhat We’re Looking ForProven experience with the Databricks platform, including Unity Catalog, DeltaLake, and orchestrationExpertise in Python, PySpark, and distributed data processing frameworksExtensive background in CI/CD pipeline development with tools like Azure DevOps, Jenkins, GitHub ActionsIn-depth understanding of data lakehouse principles, data modelling, and GDPR-compliant designExperience building robust, production-grade data pipelines from ingestion through to servingBonus Points ForStrong client-facing and commercial skills to support pre-sales and RFP engagementsBackground in coaching and mentoring engineering teamsDevelopment experience with Scala or JavaExposure to PII and sensitive data handling, and regulatory frameworks like GDPRActive contribution to Capco thought leadership and internal initiativesWhy Join CapcoDeliver high-impact technology solutions for Tier 1 financial institutionsWork in a collaborative, flat, and entrepreneurial consulting cultureAccess continuous learning, training, and industry certificationsBe part of a team shaping the future of digital financial servicesHelp shape the future of digital transformation across FS & Energy.We offer a competitive, people-first benefits package designed to support every aspect of your life:Core Benefits: Discretionary bonus, competitive pension, health insurance, life insurance and critical illness cover.Mental Health: Easy access to CareFirst, Unmind, Aviva consultations, and in-house first aiders.Family-Friendly: Maternity, adoption, shared parental leave, plus paid leave for sickness, pregnancy loss, fertility treatment, menopause, and bereavement.Family Care: 8 complimentary backup care sessions for emergency childcare or elder care.Holiday Flexibility: 5 weeks of annual leave with the option to buy or sell holiday days based on your needs.Continuous Learning: Your growth, your way - minimum 40 hours of training annually. Take your pick; workshops, certifications, e-learning. Also, Business Coach assigned from Day One: Get one-on-one guidance to fast-track your goals and accelerate your development.Extra Perks: Gympass(Wellhub), travel insurance, Tastecard, season ticket loans, Cycle to Work, and dental insurance.Inclusion at Capco We’re committed to making our recruitment process accessible and straightforward for everyone. If you need any adjustments at any stage, just let us know – we’ll be happy to help. We value each person’s unique perspective and contribution. At Capco, we believe that being yourself is your greatest strength. Our #BeYourselfAtWork culture encourages individuality and collaboration – a mindset that shapes how we work with clients and each other every day.Capco Job Candidate Privacy NoticeCapco does not discriminate on the basis of race, color, religion (creed), gender, gender expression, age, national origin (ancestry), disability, marital status, sexual orientation, or military status, in any of its activities or operations. In order to track the effectiveness of our recruiting efforts, please consider participating in the optional questionnaire.Select...I identify my ethnicity group as * Select...I identify my ethnicity sub group as * Select...By checking this box, I consent to Capco collecting, storing, and processing my responses to the demographic data surveys above. * #J-18808-Ljbffr
Location:
City Of London, England, United Kingdom
Job Type:
FullTime

We found some similar jobs based on your search