Job Description
We are seeking a highly skilled Data Engineer with strong problem-solving expertise to join our dynamic data engineering team. Your primary focus will be to design, develop, and optimize data pipelines and workflows leveraging Databricks and AWS.
Responsibilities
Supporting L2 and L3 functions within Data engineering to troubleshoot and rectify production pipelines.
Develop and maintain high-performance data pipelines using Databricks.
Collaborate with architects and analysts to build data models and transformations.
Ensure data quality, security, and compliance within Databricks environments.
Implement monitoring and logging strategies to ensure data pipeline reliability and performance.
Deploy and manage code via CI/CD workflows.
Troublesho...