Overview

Lead Data Engineer or Architect role at Made Tech. You will help public sector organisations become data-led by equipping them with robust data platforms and by embedding data knowledge into delivery teams. You will also help implement efficient data pipelines and storage.

Responsibilities

• Define, shape and perfect data strategies in central and local government.
• Help public sector teams understand the value of their data, and make the most of it.
• Establish yourself as a trusted advisor in data-driven approaches using public cloud services like AWS, Azure and GCP.
• Contribute to recruitment efforts and take on line management responsibilities.

Skills, knowledge and expertise

• Proficiency in Git (including Github Actions) and able to explain the benefits of different branch strategies.
• Strong experience in IaC and guidance on deploying infrastructure into different environments.
• Knowledge of handling and transforming data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop.
• Understanding of architectures in modern data systems (Data Warehouse, Data Lakes, Data Meshes).
• Ability to create data pipelines on a cloud environment with error handling.
• Experience creating reusable libraries to promote consistency across data pipelines.
• Ability to document and present end-to-end diagrams for data processing systems on cloud platforms.
• Familiarity with diagramming approaches (C4, UML, etc.).
• Enthusiasm for learning and self-development.
• Experience in agile delivery-lead projects and applying practices such as Scrum, XP, Kanban.
• Ability to own the cloud infrastructure underpinning data systems via a DevOps approach.
• Design and implement efficient data transformation processes at scale (batch and streaming).
• Experience delivering data platforms as a Data Engineer.
• Knowledge of SOLID, DRY and TDD principles and how to apply them in projects.
• Commercial mindset to grow accounts with senior stakeholders.
• Experience improving resilience by checking for software vulnerabilities and implementing testing strategies (unit, integration, data quality).
• Ability to guide robust DevOps practices in data projects.
• Familiarity with DataOps tools in orchestration, data integration and analytics.

Desirable experience

• Experience in a technology consultancy.
• Working with Docker and virtual environments as part of development and CI/CD.
• Working with senior stakeholders to gather requirements and keep them engaged.
• Experience with pair programming or mob programming.
• Productionising advanced data deliverables with data scientists (e.g., ML models).
• Working knowledge of statistics.
• Experience working with multidisciplinary digital and technology teams.
• Experience working within the public sector.

Benefits & Work Culture

• Flexible benefits platform including Smart Tech scheme, Cycle to work, and an individual benefits allowance (healthcare cash plan or pension).
• Optional social and wellbeing calendar; communities of practice and channels for employee groups.
• 30 days holiday; flexible working hours; flexible parental leave options; remote working options; paid counselling and advisory services.

Location & Employment Details

• Location: Any UK Office Hub (Bristol, London, Manchester, Swansea)
• Department: Technology > Data & AI
• Employment Type: Permanent - Full Time
• Workplace Type: Hybrid
• Compensation: £80,000 - £95,000 per year

Note: This description preserves the original role information and expectations without adding new details. If you believe any section should be expanded or adjusted for clarity, please specify.