Senior Software Engineer

New Today

Recruitment Consultant at Intellect Group

Location: Remote (London office available)

Type: Full-time

We’re looking for an experienced Senior Python Data Engineer to join a small, highly skilled engineering team building a next‑generation Financial Services Data and Compliance Intelligence platform.

You’ll work at the intersection of data engineering, AI, and large‑scale analytics, designing systems that collect, process, and analyse massive volumes of structured and unstructured regulatory and financial data.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines and backend systems in Python using FastAPI and modern cloud services.
  • Build and optimise ETL frameworks to ingest, clean, and transform high‑volume datasets from multiple external APIs and internal sources.
  • Collaborate with the data science team to productionise AI/LLM models, ensuring data quality, traceability, and performance.
  • Take ownership of core data services, contributing to architectural decisions as we transition our cloud infrastructure from Azure to GCP (and potentially AWS).
  • Implement best practices for data governance, observability, and monitoring, ensuring compliance with security and regulatory standards.
  • Work closely with product and engineering teams to deliver data‑driven insights that enhance automation and regulatory intelligence.

About You

  • Strong professional experience with Python, particularly in data engineering or backend development.
  • Deep understanding of data modelling, ETL/ELT processes, and distributed data systems.
  • Hands‑on experience with SQL/NoSQL databases, and data frameworks like Pandas, PySpark, or Airflow.
  • Cloud experience with GCP, Azure, or AWS (BigQuery, Dataflow, ADF, Glue, or similar).
  • Comfortable working autonomously in a fast‑moving environment, with the curiosity and initiative to explore new data technologies.
  • Familiarity with LLMs, ML pipelines, or data science workflows is a plus.
  • Knowledge of financial services, compliance, or regulatory data is beneficial but not essential.

What We Offer

  • Flexible remote working, with an optional London office for in‑person collaboration.
  • The opportunity to shape the data backbone of a cutting‑edge AI‑driven platform in financial compliance.
  • A collaborative, low‑bureaucracy environment where your work has immediate impact and visibility.
#J-18808-Ljbffr
Location:
United Kingdom
Salary:
£125,000 - £150,000
Job Type:
FullTime
Category:
IT & Technology