Job Description
Job Title : Data Engineer
Location: Washington DC (Day One onsite)
Key Responsibilities
Design, develop, and maintain scalable data pipelines using Azure Databricks and Apache Spark
Implement complex data transformations using Spark SQL and Python (mandatory)
Build and manage analytics models using DBT Core / DBT Cloud, following analytics engineering best practices
Develop and orchestrate data ingestion and transformation workflows using Azure Data Factory
Ensure data quality, reliability, and performance across batch and near real time pipelines
Integrate Databricks workloads with downstream reporting, analytics, and AI/ML use cases
Collaborate with cross functional teams to understand business requirements and translate them into technical solutions
Implement CI/CD pipelines and source control using Azure DevOps
Apply secure data engineering practices aligned with WBG data governance and complian...
Location: Washington DC (Day One onsite)
Key Responsibilities
Design, develop, and maintain scalable data pipelines using Azure Databricks and Apache Spark
Implement complex data transformations using Spark SQL and Python (mandatory)
Build and manage analytics models using DBT Core / DBT Cloud, following analytics engineering best practices
Develop and orchestrate data ingestion and transformation workflows using Azure Data Factory
Ensure data quality, reliability, and performance across batch and near real time pipelines
Integrate Databricks workloads with downstream reporting, analytics, and AI/ML use cases
Collaborate with cross functional teams to understand business requirements and translate them into technical solutions
Implement CI/CD pipelines and source control using Azure DevOps
Apply secure data engineering practices aligned with WBG data governance and complian...