Job Description
Job Description:-
The Senior Data Engineer is responsible for designing and delivering high‑quality data engineering solutions across tactical and strategic initiatives. The role spans building reliable data pipelines, centralising transformation logic, and supporting enterprise analytics platforms, including Palantir, while operating within governed and regulated environments.
Key Responsibilities
* Design and implement scalable data transformation and integration solutions using SQL‑based and programmatic patterns.
* Build and maintain batch data pipelines using Python and cloud‑native execution models.
* Implement incremental data loading, idempotent processing, and recovery patterns to support reliable data refreshes.
* Establish and manage control structures such as watermarks, run metadata, and monitoring.
* Work across cloud environments (AWS and/or Azure) to enable secure and efficient data movement.
* Contribute t...
The Senior Data Engineer is responsible for designing and delivering high‑quality data engineering solutions across tactical and strategic initiatives. The role spans building reliable data pipelines, centralising transformation logic, and supporting enterprise analytics platforms, including Palantir, while operating within governed and regulated environments.
Key Responsibilities
* Design and implement scalable data transformation and integration solutions using SQL‑based and programmatic patterns.
* Build and maintain batch data pipelines using Python and cloud‑native execution models.
* Implement incremental data loading, idempotent processing, and recovery patterns to support reliable data refreshes.
* Establish and manage control structures such as watermarks, run metadata, and monitoring.
* Work across cloud environments (AWS and/or Azure) to enable secure and efficient data movement.
* Contribute t...