Job Description
Title - Azure Databricks Lead
Location - Charlotte, NC / Jersey City. NJ - Onsite Hybrid
Your Role:
We are looking for an experienced Azure Databricks Engineer with strong expertise in cloud based data engineering ETL development and distributed data processing , The ideal candidate should have solid hands on experience with PySpark Delta Lake Azure Data Factory and building scalable data pipelines on Azure
The engineer will work closely with business Data Architects and cross functional teams to design develop and optimize data pipelines for enterprise grade analytics and reporting
Key Responsibilities
- Data Engineering Pipeline Development Design develop and optimize ETLELT pipelines using Azure Databricks PySpark
- Build scalable data ingestion workflows from various structured and unstructured sources
- ...