Job Description
Interview process: 2 Teams + 1 In-person interview
Senior Data Engineer
Job Responsibilities and Requirements:
- Lead architecture and technical design discussions for Credit Risk data platforms using industry-standard data engineering technologies; support production operations and resolve pipeline issues as a senior Data Engineer within the Credit Risk technology team
Design and implement scalable batch and streaming data pipelines using PySpark within the Medallion Lakehouse architecture on Databricks, supporting credit risk analytics and reporting workflows
Build and maintain ingestion flows from upstream risk systems (loan origination, trading systems, market data feeds) into object storage (e.g., S3/ADLS) using Parquet and Delta formats, including partitioning, z-ordering, and schema evolution
Develop and optimi...