Job Description
Senior LLM Ops Engineer
Responsibilities
- Design and implement scalable pipelines to collect and process production ML and LLM traffic from multiple sources;
- Define data storage strategies, retention policies, and privacy controls aligned with business and regulatory requirements;
- Develop observability, debugging, and monitoring capabilities to support production issue investigation and operational excellence;
- Build and maintain evaluation frameworks, automated rating systems, and alerting mechanisms to detect model and prompt performance regressions;
- Implement data protection measures, including PII redaction, content safety controls, and end-to-end platform operations.
Requirements
- Proven experience building and operating production-grade data or ML platforms, including ingestion, storage, governance, monitoring, and operational support;
- Hands-on experience creating and main...