Job Description
Duration: 12 months Contract
Job Overview:
This position focuses on Data pipelines & workflows
Key Responsibilities:
Job Overview:
This position focuses on Data pipelines & workflows
Key Responsibilities:
- Embed within a cross-functional Agile team, participating in sprint planning, stand-ups, backlog refinement, and technical discussions.
- Design, build, troubleshoot, and maintain ETL/ELT workflows that support application functionality, analytics, reporting, and scientific workflows.
- Develop and manage data pipelines using Apache Airflow, ensuring reliable orchestration, scheduling, monitoring, and recovery of data processes.
- Work with stakeholders including software developers, scientists, and engineers to understand data sources, workflow requirements, and downstream data needs.
- Extract, transform, validate, and load data across systems, including relational databases such as Postgres SQL and Oracle.
- Write, opti...