Principal Test Engineer – AI Core Services (Azure / .Net)

Location: Cambridge, UK (Hybrid) | Contract

Simon James IT are hiring a Principal Test Engineer to lead the validation of cloud-native AI services and APIs built on Microsoft Azure and .NET. You’ll design automated testing frameworks and AI-specific evaluation tools to ensure reliability, security, and ethical compliance.

Responsibilities

• Lead functional, performance, and security testing of Azure‑based services
• Build automated test suites for APIs, service components, and AI pipelines
• Develop tools to assess AI outputs for accuracy, consistency, and safety
• Define quality metrics and observability with engineering and data science teams
• Ensure compliance with NIST AI RMF, EU AI Act, and ethical AI standards
• Conduct threat modelling and validate exposed APIs
• Mentor junior testers and drive innovation

Qualifications

• Strong background in automated testing and QA leadership
• Deep understanding of AI systems and regulatory compliance

Required Skills

• Testing: API validation, performance profiling, OWASP security testing
• Agile collaboration across global R&D teams
• Experience with advanced AI testing methodologies