Job Description
Job Title: Senior Data Bricks/Scala/Spark Engineering Specialist
Location: Montreal, QC (Onsite)
Employment Type: Contract
Duration: 12 Months
Job Description
We are migrating complex on-prem regulatory reporting pipelines from a legacy ETL + Autosys + SQL + Teradata stack to a modern Databricks + Snowflake platform on Azure. The role is hands-on: design, implement, test, and reconcile production pipelines feeding regulatory reports under strict parity requirements.
Required Qualifications
- Scala / Spark - production experience writing Spark applications in Scala (not just notebooks); comfortable with the DataFrame API, joins, window functions, partitioning, and performance tuning.
- Databricks - Serverless compute, Unity Catalog, Asset Bundles, Databricks CLI.
- SQL - fluent in writing, analyzing, and extracting requirements from complex SQL scripts.
- Snowflake - schema...