The Role

We are hiring for a Senior MLE position in our Agentic AI platform team, working on Agentic AI frameworks which will be used by multiple teams across the business. The role is a mix of platform tooling development and applied research, with the main focus on developing and implementing Agentic AI evaluation techniques, using strategies such as LLM-as-judge.

As an MLE, you will work within a multidisciplinary team of machine learning engineers and software engineers building the Agentic AI platform, and liaise closely with downstream teams using the platform to build agentic applications. These applications range from consumer-facing chatbots to intelligent backend systems, and use techniques such as RAG and multimodal input / output. Your team has independence and the platform enables some of the most difficult problems at the intersection of our three-sided marketplace (riders, consumers, and restaurants). Your work will contribute to creating the company-wide Agentic AI evaluation strategy and ensure that agentic applications being developed are compliant, robust and well-engineered.

The role includes:

• Developing, assessing and evaluating agentic systems built with a variety of LLM providers, including OpenAI, Anthropic & Google.
• Research and implementation of new GenAI evaluation techniques.
• Contributions to the development of software packages and evaluation harnesses to allow downstream teams to develop their own evaluation datasets and metrics.
• Development of common tooling to support the above, including labelling UIs and associated tooling.
• Defining best practices for GenAI evaluations across the business and working closely with downstream teams and product partners to align evaluation strategies with business needs.

Requirements

• 5+ years' experience as an ML Engineer or Data Scientist
• 5+ years' experience writing production code in Python
• Experience using tools like Git, Docker, Kubernetes, CircleCI
• Experience productionising Generative AI workstreams or Agentic AI projects
• You know the fundamentals of Generative AI and have a good understanding of the science behind it, including LLMs, VLMs, transformers and fine-tuning techniques.
• A robust understanding of traditional ML and evaluation techniques, and a good understanding of the research and developments around Generative AI evaluation techniques.
• You get satisfaction from seeing your work shipped and driving measurable impact to the business
• Experience mentoring others in the team.
• You have a bias to simplicity, where you care most about achieving impact

Bonus

• Experience with evaluation harnesses and frameworks for Generative AI
• Experience with observability, monitoring, and safety techniques for deployed GenAI systems
• Experience in strongly typed languages such as Go

The Company

Our mission is to be the definitive food company. We are transforming the way the world eats by making food more convenient and accessible. We are a technology-driven company at the forefront of the most rapidly expanding industry in the world. We are still a small team, making a very large impact, looking to answer some of the most interesting questions out there. We move fast, value autonomy and ownership, and we are always looking for new ideas.

At Deliveroo we know that people are the heart of the business and we prioritise their welfare. Benefits differ by country, but we offer many benefits in areas including healthcare, well-being, parental leave, pensions, and generous annual leave allowances, including time off to support a charitable cause of your choice. Benefits are country-specific, please ask your recruiter for more information.

Diversity

At Deliveroo, we believe a great workplace is one that represents the world we live in and how beautifully diverse it can be. That means we have no judgement when it comes to any one of the things that make you who you are - your gender, race, sexuality, religion or a secret aversion to coriander. All you need is a passion for (most) food and a desire to be part of one of the fastest-growing businesses in a rapidly growing industry.

We are committed to diversity, equity and inclusion in all aspects of our hiring process. We recognise that some candidates may require adjustments to apply for a position or fairly participate in the interview process. If you require any adjustments, please don't hesitate to let us know. We will make every effort to provide the necessary adjustments to ensure you have an equitable opportunity to succeed.

Compensation

• We aim to pay every employee competitively for the role they are performing in their respective location
• Depending on role and location, some employees may be eligible for an annual cash bonus, sign-on bonus or relocation support
• Up to 5% matched pension contributions

Equity

• Some roles may be eligible for share awards, giving them ownership in Deliveroo and a share in our success

Food

• Free Deliveroo Plus: free delivery and access to special offers
• Team lunches from the best local restaurants

Time away

• 25 days annual leave plus bank holidays, increasing with length of time spent working at Deliveroo
• One day of paid leave per year to volunteer with a registered charity

Benefits

• Funded single cover healthcare on our core plan, with the option to add family members at own cost
• On-site gym (HQ), discounted external gym membership
• Access to wellbeing apps such as LesMills+, Strava, Headspace, Yogaia via GymPass
• Discounted dental insurance and a range of other flexible benefits, such as critical illness cover, partner life cover, travel insurance, health assessments
• Life assurance

Work Life

• Maternity, paternity and parental leave, eligible from day one of employment
• Excellent kit to enable working from home and a parent-friendly working culture
• Access to free mortgage advice
• Cycle to Work Scheme or Season Ticket Loans, depending how you wish to travel
• Excellent learning and development opportunities and access to RooLearn, our learning platform, packed with high-quality training and content
• Regular Employee Resource Group (ERG) led social events – examples include dinners, dance lessons and in-office yoga sessions