Senior Big Data Engineer
New Yesterday
Overview
Department: Technology. Location: Madrid.
As part of the Big Data Team, you will work with cutting edge technologies to collate data across sources within GiG. Sources are real time and you will support an event driven micro service lambda architecture. You will contribute to the platform’s objectives, enabling other data technology stakeholders such as Business Intelligence, Data Science and Quality Assurance teams. You will maintain and add new features to a platform that ingests up to 5000 messages per second across multiple products such as Lottery, Sports and Casino. You will report to the Lead Big Data Engineer and be supported by the Big Data Architect to deliver world class product increments for our Tier 1 Platform.
Responsibilities
- Participate in all agile scrum meetings such as daily standups, refinement sessions, retro sessions, etc
- Maintain the data platform by means of daily reconciliations, data reloads, tackling support tickets, etc.
- Propose ideas to improve existing products and services
- Implement bug fixes and enhancements within the data platform
- Perform code reviews for other engineers
- Take ownership of releases where necessary
- Communicate with stakeholders to ensure information is transmitted correctly to the right audience
- Take ownership of complex, large-scale initiatives, including data migration projects, ensuring successful planning, execution, and delivery
Skills, Knowledge & Expertise
You’re really awesome at:
- Object oriented programming (Java)
- Data modelling using any database technologies
- ETL processes and experience with Apache Spark or Apache NiFi
- Applied understanding of CI/CD in change management
- Dockerised applications
- Used distributed version control systems
- Excellent team player
- Meticulous and passionate about your work
You’re also good at:
- Functional oriented programming (experience with Python, Scala)
- Analytical mindset
- Low latency databases such as ClickHouse
- Hold a Bachelor’s Degree in Computer Science or equivalent
- Collaborate in scoping exercises
- Mentoring skills
- Experience with Linux and Windows environments
Job Benefits
- Great career development opportunities
- 100% remote or hybrid working model
- International Health Insurance
- Health and Wellbeing Package (350 EUR per year)
- Birthday Day Off
- Me Time - 1 day off per year
- Free lunches in the office
- Location:
- Manchester, England, United Kingdom
- Salary:
- £80,000 - £100,000
- Job Type:
- FullTime
- Category:
- IT & Technology