Job Description
We are seeking a high-caliber Senior Data Engineer to join a premier global financial services firm. In this role, you will play a pivotal part in evolving our enterprise-wide Centralized Data Platform, built on the Databricks Lakehouse architecture. You will collaborate with data scientists and analysts to transform complex financial data into high-value insights, leveraging AI-enhanced development and cutting-edge cloud infrastructure to drive technical excellence. Key Responsibilities Lakehouse Architecture: Design and implement scalable Databricks solutions for enterprise-level data processing and advanced analytics. Pipeline Engineering: Build, optimize, and maintain robust ETL/ELT processes, including Delta Live Tables for seamless ingestion and transformation. Streaming & Real-Time: Create and manage structured streaming pipelines to facilitate real-time data delivery. Governance & Security: Implement Unity Catalog features and IAM best practices to ensure rigorous security and ...