Job Description
Responsibilities:
- Design and own the end-to-end functional test strategy for the voice runtime covering call ingress, ASR/TTS partners, router and middleware, multi-agent orchestration, tool/API calls, downstream system integrations, and call termination.
- Build and maintain integration test suites that exercise the full graph of services, including partner APIs (ElevenLabs, Decagon), internal microservices, queues/streams, databases, and downstream business systems.
- Define and enforce environment readiness: dev, staging, UAT, pre-prod, and prod. Build environment health checks, configuration drift detection, and smoke tests that gate every deploy.
- Own production sanity testing synthetic call flows, heartbeat checks, post-deploy validations, and the runbooks the on-call team uses to confirm a release is healthy.
- Build regression suites that catch functional breakage from agent definition changes, prompt updates, SOP edits, tool...