We are looking for an experienced Technology Architect with strong expertise in PySpark, Azure Data Factory (ADF), and Databricks to join our team. The ideal candidate will have 10+ years of experience in Data Engineering and excellent client-facing skills.

Responsibilities

• Gather and understand client requirements, create conceptual diagrams, and develop data models.
• Work hands-on with Medallion architecture using Azure services.
• Utilize Erwin for data modeling and implement performance optimization in data transformation.
• Guide the engineering team on development activities using ADF, Databricks, Python, JSON, and YAML.
• Build and maintain source-to-target mapping documentation.
• Apply strong knowledge of dimensional modeling, normalization, data harmonization, and schema design.
• Deploy code artifacts using GitHub Actions and CI/CD pipelines.
• Collaborate effectively with cross-functional teams.
• (Plus) Experience with Log Analytics and KQL queries.
• Manage configuration settings using JSON files.

Requirements

• 10–15 years of relevant Data Engineering experience.
• Strong technical project management, communication, and problem-solving skills.
• Proven hands-on experience with PySpark, ADF, and Databricks.

Seniorität level

• Mid-Senior level

Employment type

• Contract

Job function

• Information Technology

Industries

• IT Services and IT Consulting