Job Description
Description We are looking for a Database Engineer to support the performance, stability, and scalability of a modern data platform in Irvine, California. This role focuses on building dependable data pipelines, improving platform operations, and ensuring data assets remain governed, accessible, and cost-efficient in a production environment. The ideal candidate brings strong hands-on experience with Databricks, Spark, Python, SQL, and SQL Server, along with the ability to troubleshoot issues across orchestration, storage, and source system connectivity.
Responsibilities:
• Oversee daily health and uptime of Databricks pipelines, job schedules, compute resources, Delta Lake datasets, and warehouse environments to maintain consistent platform performance.
• Design, build, and refine Spark-based data processing workflows in Databricks notebooks across bronze, silver, and gold layers, including incremental ingestion patterns using Auto Loader and streaming frameworks when n...
Responsibilities:
• Oversee daily health and uptime of Databricks pipelines, job schedules, compute resources, Delta Lake datasets, and warehouse environments to maintain consistent platform performance.
• Design, build, and refine Spark-based data processing workflows in Databricks notebooks across bronze, silver, and gold layers, including incremental ingestion patterns using Auto Loader and streaming frameworks when n...