Job Description
Job Summary
We are seeking a highly skilled Senior Data Engineer with strong expertise in Databricks, Snowflake, and modern data engineering practices. The ideal candidate should have hands-on experience in building scalable batch and streaming data pipelines, optimizing Spark jobs, and working with large-scale distributed data systems.
Requirements
Key Responsibilities
Design, develop, and maintain scalable data pipelines (batch & streaming) Build and optimize data processing workflows using PySpark and SQL Work with Databricks for data processing, cluster management, and job orchestration Implement and manage data pipelines using Delta Lake architecture Integrate data from multiple sources including Kafka and cloud storage systems Ensure data quality, governance, and reliability across pipelines Collaborate with cross-functional teams for data platform enhancements ...