Solutions Architect
New Today
Job Title: Solutions Architect (Databricks SME)
Location: Remote
A consultancy client of ours have secured a project requiring an Azure Databricks expert. This is an exciting opportunity to work on cutting-edge data projects, building scalable data pipelines and cloud-based systems that deliver real impact.
Responsibilities
- Lead the design, development and optimisation of scalable data solutions using Azure Databricks
- Provide subject matter expertise on Databricks architecture, best practices and performance tuning
- Collaborate with data engineering, BI and analytics teams to deliver robust and reusable data pipelines
- Drive the adoption of Databricks features such as Delta Lake, Unity Catalog, and MLflow where appropriate
- Support the migration of legacy ETL processes to Databricks-based workflows
- Ensure data quality, governance and security standards are met across all Databricks solutions
- Mentor and upskill team members in Databricks usage and data engineering techniques
- Troubleshoot complex technical issues and act as the escalation point for Databricks-related queries
- Contribute to the continuous improvement of the data platform, tooling and engineering practices
- Work closely with stakeholders to understand data needs and deliver fit-for-purpose solutions at pace
Experience and Qualifications Required
- Extensive hands-on experience with Azure Databricks, including Delta Lake, notebooks, and job orchestration
- Strong proficiency in Python, SQL and Spark for building and optimising data pipelines
- Solid understanding of cloud architecture, ideally within Azure, including Data Lake, Data Factory and related services
- Experience designing and implementing data solutions using dimensional modelling (e.g. Kimball methodology)
- Proven track record of delivering data products in large-scale, enterprise environments
- Familiarity with data governance, security, and compliance frameworks
- Experience with CI/CD practices and DevOps tools in a data engineering context
- Strong problem-solving skills and ability to troubleshoot complex data issues
- Excellent communication and stakeholder engagement skills across technical and non-technical teams
- Previous experience mentoring or upskilling engineers in Databricks or data engineering practices
If this sounds like an exciting opportunity please apply with your CV.
Seniority level
- Mid-Senior level
Employment type
- Contract
Job function
- Information Technology
Industries
- IT Services and IT Consulting
- Location:
- United Kingdom
- Salary:
- £125,000 - £150,000
- Job Type:
- FullTime
- Category:
- IT & Technology