Job Description
Data Engineer (Lakehouse & Hybrid Data Platforms)
My client is looking for a Data Engineer to design and build scalable data pipelines that deliver trusted, analytics‑ready datasets for BI, AI, and operational use cases across a hybrid environment.
Key Responsibilities
- Build pipelines across bronze, silver & gold layers (Databricks, Spark, dbt)
- Implement data quality checks, contracts & schema validation
- Apply governance (catalog, lineage, RBAC, metadata)
- Deliver curated datasets, features & embeddings for AI/BI
- Monitor pipeline health, performance & cost to meet SLAs
Tech Stack
- Databricks, Spark, Delta Lake, dbt
- Azure Data Factory, Kafka/Event Hubs
- CI/CD (Azure DevOps/GitHub)
Governance & Ops
- Enforce data contracts, lineage & cataloging
- Apply masking, tokenisation & access controls (PII/PHI)
- Build observable pipelines with ...