Job Description
We’re building an agentic AI platform that orchestrates intelligent automation across enterprise systems. This role owns LLM reasoning pipelines end-to-end, from prompt design to production deployment on Azure Kubernetes.
You will own the system’s quality, milestone payments depend on acceptance tests.
What You’ll Do
- Build pytest automation frameworks for API, integration, and E2E workflows
- Validate LLM structured outputs against expected baselines
- Implement PII/PHI leakage detection tests for AI outputs
- Enforce schema validation (Pydantic/JSON) across APIs
- Integrate tests with CI/CD (GitHub Actions)
- Add security scanning (Gitleaks, Trivy, Bandit)
- Run internal dry-runs before milestone demos
Must-Have
- 3+ years Python test automation (pytest preferred)
- Strong REST API testing experience
- ...