Job Description
Role: Sr Site Reliability Engineer
Location: Bellevue US
Contract Role
JOB DESCRIPTION:
"AI Platform & Gateway Engineering
• Design, deploy, and operate enterprise AI Gateway infrastructure supporting OpenAI and internal LLM-based services.
• Implement and manage regional routing (east/west), failover strategies, and upstream host configurations for AI traffic.
• Develop and maintain Helm charts, Kubernetes manifests, and Jinja templates for multi-environment deployments (dev, plab, qlab).
• Enable per-API configuration for rate limiting, AI feature toggles, security credentials, and regional host overrides.
• Stay current with industry best practices for:
o AI Gateways and MCP servers
o Secure LLM consumption patterns
o Token handling, secrets management, and request isolation
o Observability standards for AI platforms
<...
Location: Bellevue US
Contract Role
JOB DESCRIPTION:
"AI Platform & Gateway Engineering
• Design, deploy, and operate enterprise AI Gateway infrastructure supporting OpenAI and internal LLM-based services.
• Implement and manage regional routing (east/west), failover strategies, and upstream host configurations for AI traffic.
• Develop and maintain Helm charts, Kubernetes manifests, and Jinja templates for multi-environment deployments (dev, plab, qlab).
• Enable per-API configuration for rate limiting, AI feature toggles, security credentials, and regional host overrides.
• Stay current with industry best practices for:
o AI Gateways and MCP servers
o Secure LLM consumption patterns
o Token handling, secrets management, and request isolation
o Observability standards for AI platforms
<...