Senior Data Engineer (Grade E3)

Department: Corporate Services

Employment Type: Permanent - Full Time

Location: Edinburgh - Hybrid

Compensation: E3 Grade £46,392 - £54,003. Civil Service Pension. Flexible Working Hours. Hybrid Working.

Description

At Scottish Funding Council, we’re embarking on an exciting digital transformation to redefine how we use data to drive innovation and deliver exceptional value to our customers. Central to this journey is the creation of the Azure-based data ecosystem, enabling us to unlock the full potential of our data through transformative and intelligent solutions.

Our Data Engineering team plays a pivotal role in this mission. We manage the entire data lifecycle—from integrating diverse data sources and optimizing storage and processing pipelines to delivering actionable insights—while ensuring compliance with company standards and data protection regulations.

As a Senior Data Engineer, you will be a technical leader within this dynamic team, driving innovation and engineering excellence. You’ll work closely with teams across the organisation, including Analytics and Cloud Engineering, to cultivate a data-driven culture and lead initiatives that turn data into a powerful tool for transformation.

This role offers a unique opportunity to shape the future of post-16 education in Scotland. By delivering innovative, data-driven solutions, you will enable institutions, and policymakers to make informed decisions, enhance learning outcomes, and create opportunities that empower students to thrive in an increasingly data-centric world.

Key Responsibilities

• Translate business requirements into technical specifications, roadmaps and deliverable data solutions, including data streams, integrations, transformations, databases, data warehouses, and business intelligence, reporting and analytical platforms.
• Define the data architecture framework, standards and principles, including modelling, metadata, security and data virtualisation.
• Support the Head of Data Engineering to develop and enhance standards and policies/guidelines whilst driving adoption of standards.
• Define data flows and data lineage, visualising which parts of the organization generate data, which require data to function, how data flows are managed, and how data changes in transition.
• Provide technical guidance and advice to help in the design and development of data solutions for data modelling and warehousing, data integration, and analytics.
• Provide direction and support to a team of data engineers and provide technical guidance on the data products.
• Develop roadmaps for both product related DE work as well as overall data maturity roadmap.
• Drive the design, building, and launching of new data models and data pipelines in production.
• Perform peer reviews, audits, standards compliance checks and due diligence as required.
• Report delivery progress and status to both internal and external stakeholders.

Skills, Knowledge and Expertise

Evidence of proven experience of each of the following essential criteria is required:

• Proven track record of designing, developing and delivering enterprise-scale data products and solutions within the Microsoft Azure ecosystem.
• Advanced proficiency in SQL and modern data processing frameworks, coupled with strong programming skills in at least one language (Python preferred).
• Comprehensive expertise in data architecture, including dimensional modelling, data warehouse design patterns, and business intelligence solution architecture.
• Deep hands-on technical knowledge acquired through extensive practical implementation experience.
• Exceptional analytical capabilities with proven ability to conduct comprehensive data profiling, source system analysis, and deliver actionable insights that drive business value.
• Demonstrated ability to translate complex technical concepts into clear, compelling narratives for diverse stakeholder audiences.
• Proven leadership experience in guiding and mentoring data engineering teams, fostering technical excellence and professional growth.
• Track record of identifying strategic data opportunities, initiating transformative projects, and driving technical direction from concept to successful delivery.
• Strong stakeholder management skills with the ability to influence and align technical solutions with organisational objectives.
• Outstanding interpersonal skills with demonstrated ability to engage effectively with technical teams and business stakeholders.
• Expertise in requirements gathering, solution design, and cross-functional collaboration.
• Degree level education (SCQF level 9) or equivalent experience, ideally in a technical field such as Computer Science, Mathematics or Physics.

Desirable criteria include:

• Significant exposure to Azure utilising some of the following: Azure Synapse Analytics, Azure SQL, Azure Data Factory, Azure Data Lake, Azure DevOps and PowerBI.
• Azure Data Engineer Associate certification or higher OR Azure AI Engineer Associate certification or higher.
• Experience implementing solutions using Microsoft Fabric.

Terms and Benefits

Normal full-time hours of work are 35 per week. We will consider flexible working arrangements. A flexi-time system is in operation.

Annual leave entitlement of 26.5 days pro-rata, rising to 30 days pro-rata after 2 years’ continuous service. Public and privilege holiday entitlement of 13 days pro-rata.

A flexible approach to hybrid working, giving you flexibility to work from home anywhere in the UK for some of the time while also maintaining regular in-person contact with colleagues.

Annual pay review: approved within the framework of the Scottish Government’s Public Sector Pay Policy and negotiated with our recognised trade union, Unite. Salaries are reviewed annually in April for employees who commence employment prior to 1 October in the preceding year.

Eligibility to join the Civil Service Pension Scheme. With its low member contribution rates and generous employer contributions, this gives you a secure, inflation-proof pension for life with no investment uncertainty.

Support for continuous professional development: as a part of SFC, we are dedicated to providing comprehensive support for continuous learning and professional development.

Support for health and wellbeing, including generous occupational sick pay, free access to confidential advice and support through our 24/7 Employee Assistance Programme, Special Leave (paid and unpaid), a contribution to learning outside work through our Lifelong Learning Fund, free winter flu vaccination, and access to occupational health support.

We provide support to SFC employees with Volunteering Days.

Support for travel to and from work, including a salary sacrifice cycle loan scheme, cycle storage and shower facilities, an interest-free loan for bus or rail season tickets and free office car parking for employees on a first-come basis.