Job Description
We are looking to hire Azure Data Engineers for a client who is a leader in the AI and Analytics solution. You will work on a broad range of cutting-edge data analytics problems.
Roles & Responsibilities:
- Design and build scalable & metadata driven data ingestion pipelines (For Batch and Streaming Datasets)
- Execute high-performance data processing for structured and unstructured data, and data harmonization
- Schedule, orchestrate, and validate pipelines
- Design exception handling and log monitoring for debugging
- Make tech stack and tools related decisions
- Collaborate with business consultants, data scientists, and application developers to develop analytics solutions
Required Experience, Skills & Competencies:
- 4 to 8 years of total IT experience with 2+ years on big data engineering an...