Job Description
Python Senior Engineer
12 Month contract initially + Extensions
Based: 2 days p/w onsite in London
Rate - £400 - £500 pay p/d via Umbrella
Key Responsibilities
- Building and evolving AI-powered services using Python
- Designing and implementing evaluation frameworks for LLM-based systems
- Improving output quality through structured evals rather than purely code changes
- Applying techniques such as LLM-as-a-Judge to assess response and recommendation quality
- Working with non-deterministic systems and iterating based on real-world behaviour
- Integrating AI services into a broader platform and API ecosystem
- Contributing to production readiness including reliability, observability, and performance
- Partnering with data scientists on prompts, model usage, and evaluation strategies
Key Skills and Experience
- Strong Python engineering expe...