Overview

Senior Data Engineer role focused on designing, building and maintaining Azure-based data platforms to deliver end-to-end analytical solutions that are reliable, scalable, secure, and cost-effective. The role emphasizes automating data pipelines using Azure technologies and delivering high-quality data services that support strategic goals.

Responsibilities

• Design & Implement: Build and manage high-performance data pipelines for reporting, analytics, and data science.
• Champion Best Practices: Apply industry standards for development, testing, CI/CD, and documentation.
• Monitor & Maintain: Ensure data pipelines are consistently available and complete.
• Analyse & Improve: Identify performance insights and opportunities for optimisation.
• Collaborate & Mentor: Support and guide team members to ensure data usability and integrity.
• Engage Stakeholders: Understand and deliver on stakeholder requirements.
• Prioritise Security: Maintain robust information security practices.
• Stay Curious: Keep up with emerging cloud technologies and trends.
• Engage with the organization’s diversity, equity and inclusion efforts and support inclusive, customer-focused solutions.

Qualifications

• Education/Experience: Degree in a relevant field (e.g. Computer Science, Engineering, Mathematics) or equivalent practical experience.
• Technical Skills: Experience developing data pipelines for big data, relational databases, and data warehousing.
• Azure Expertise: Hands-on experience with Azure tools like Bicep, Data Factory, Functions/Durable, Synapse, Azure SQL DB, Event Hubs, and Databricks.
• Programming Knowledge: Proficiency in PySpark, Python, SQL, and streaming technologies.
• DevOps Familiarity: Experience with CI/CD and Azure DevOps.
• API Development: Ability to build scalable and efficient API data services.
• Problem Solving: Proactive approach to identifying and resolving issues.
• Bonus Skills: Experience with geospatial data, machine learning, or AI is a plus.
• Stakeholder Engagement: Strong relationship-building skills across all levels.

What You'll Bring

• A collaborative mindset and a passion for continuous learning.
• A proactive approach to problem-solving and process improvement.
• Clear communication skills, especially when explaining technical concepts.
• A commitment to inclusive and customer-focused solutions.
• The ability to influence and align teams around shared goals.

Benefits & Culture

• Flexible working and hybrid working policies.
• Market-leading family-friendly policies, including 28 days holiday with the option to buy more and additional volunteering days.
• Private healthcare; life and critical illness cover.
• Wellbeing and work-life balance support.
• Shopping discounts in the West End and other perks.

About The Crown Estate

Digital · The Crown Estate, 1 St James Market · Hybrid. We welcome applicants from all backgrounds and experiences. If you don’t meet every requirement but feel excited about the role, we encourage you to apply.

How to Apply

Are you passionate about data and cloud technologies? Join us as a Senior Data Engineer and help shape the future of The Crown Estate's Azure data platform. In this role, you\'ll contribute to building and evolving our cloud-based data infrastructure, supporting technical data engineering initiatives and delivering end-to-end analytical solutions that are reliable, scalable, secure, and cost-effective.