Job Description
What you’ll own
- Engineer batch and stream pipelines using Fabric Data Pipelines, Azure Data Factory, Synapse or Databricks.
- Implement data quality rules, schema validation, de-duplication (SCD) and reconciliation checks.
- Operationalize lineage, cataloging and classifications with Microsoft Purview and enforce RBAC and access patterns.
- Automate CI/CD via Azure DevOps or GitHub with environment promotion, infrastructure‑as‑code (Bicep/Terraform) and secrets management via Key Vault.
- Build feature stores and model‑serving data contracts in partnership with MLOps and AI engineering teams.
- Own reliability alerts, runbooks, on‑call rotation and cost and performance optimization.
- Review and finalize vendor‑delivered data pipelines and data architecture for AI projects, ensuring compliance with client standards for security, performance and reliability, and approve production readiness.
- Collaborate with delivery part...