Principal Data Engineer
New Today
Overview
Principal Data Engineer — full-time, remote from anywhere in the UK. The Principal will be responsible for supporting complex or leading singular projects related to data engineering requirements and initiatives across Research and Development. The Principal will support data projects from across the business including Clinical, Pre-Clinical, Non-Clinical, Chemistry, RWD and Omics.
Responsibilities
- Support the design, development and maintenance of data pipelines for processing Research and Development data from diverse sources (Clinical Trials, Medical Devices, Pre-Clinical, Omics, Real World Data) utilizing the AWS technology platform.
- Create and optimize ETL/ELT processes for structured and unstructured data using Python, R, SQL, AWS services and other tools.
- Build and maintain data repositories using AWS S3 and FSx technologies. Establish data warehousing solutions using Amazon Redshift.
- Build and maintain standard data models.
- Develop data quality frameworks, validation processes and KPIs to ensure accuracy and consistency of data pipelines.
- Implement data versioning and lineage tracking to support data traceability, regulatory compliance and audit requirements.
- Create and maintain documentation for data processes, architectures, and workflows.
- Implement modern software development best practices (e.g. Code Versioning, DevOps, CD/CI).
- Maintain compliance with data privacy regulations such as HIPAA, GDP.
- May be required to develop, deliver or support data literacy training across R&D.
Required Knowledge, Skills and Abilities
- Strong knowledge of data engineering tools such as Python, R and SQL for data processing.
- Strong proficiency with AWS services particularly S3, Redshift, FSx, Glue, Lambda.
- Strong proficiency with relational databases.
- Strong background in data modeling and database design.
- Familiarity with unstructured database technologies (e.g. NoSQL) and other database types (e.g. Graph).
- Familiarity with Containerization such as Docker and EKS/Kubernetes.
- Familiarity with one or more RnD research process and associated regulatory requirements.
- Exposure to healthcare data standards (CDISC, HL7, FHIR, SNOMED CT, OMOP, DICOM).
- Exposure to big data technologies and handling.
- Knowledge of machine learning operations (MLOps) and model deployment.
- Strong problem-solving and analytical abilities.
- Excellent communication and collaboration skills.
- Experience working in an Agile development environment.
Minimum Requirements
- Bachelor\'s Degree in Computer Science, Statistics, Mathematics, Life Sciences, or other relevant scientific fields; Master\'s Degree preferred
- 3-5 years of experience in data engineering, with at least 1.5 years focusing on healthcare, research or clinical related data
- Location:
- London, England, United Kingdom
- Salary:
- £150,000 - £200,000
- Job Type:
- FullTime
- Category:
- IT & Technology
We found some similar jobs based on your search
-
New Today
Principal Data Engineer
-
London, England, United Kingdom
-
£150,000 - £200,000
- IT & Technology
Overview Principal Data Engineer — full-time, remote from anywhere in the UK. The Principal will be responsible for supporting complex or leading singular projects related to data engineering requirements and initiatives across Research and Developm...
More Details -
-
New Yesterday
Principal Data Engineer
-
City Of Edinburgh, Scotland, United Kingdom
-
£125,000 - £150,000
- IT & Technology
Principal Data Engineer - Edinburgh or Witham. Salary between £63,440 - £95,160, depending on experience. Will lead the design and development of complex cloud-first data solutions in AWS. Will collaborate with data engineers, product managers, analysts, BI engineers, and data users.
More Details -
-
New Yesterday
Principal Data Engineer
-
Witham, England, United Kingdom
-
£100,000 - £125,000
- IT & Technology
Principal Data Engineer - Edinburgh or Witham. Salary between £63,440 - £95,160, depending on experience. Will lead the design and development of complex cloud-first data solutions in AWS. Will collaborate with data engineers, product managers, analysts, BI engineers, and data users.
More Details -
-
5 Days Old
Principal Data Engineer (Databricks)
-
United Kingdom
-
£100,000 - £125,000
- IT & Technology
Overview Join to apply for the Principal Data Engineer (Databricks) role at DATAPAO . Get AI-powered advice on this job and more exclusive features. Sign in to access AI-powered advices. The base pay range and other compensation details are provi...
More Details -
-
7 Days Old
Principal Data Engineer
-
Manchester, England, United Kingdom
-
£125,000 - £150,000
- IT & Technology
Overview Principal Data Engineer Northwest / Hybrid / Flexible Lead the data engineering strategy and roadmap. The basics are in place for a new Databricks platform and the job now is to enhance and optimise the platform, delivering value to the bu...
More Details -
-
7 Days Old
Principal Data Engineer - Azure Databricks (Unity Catalog) - Contract
-
Gloucester, England, United Kingdom
-
£100,000 - £125,000
- IT & Technology
Principal Data Engineer - Azure Databricks (Unity Catalog) - Contract.Location: Bristol - Hybrid - 2 days a week in the office.Contract Length: 12 months.Day Rate: Negotiable.Job Ref: J12998.
More Details -