Job Description
RQ11099 - Sr. DataOps/Cloud Data Engineer
1-year 11-month contract (457 business days) - possible extension
ONSITE 5 days - 5700 Yonge St. Toronto'
Security Level: CRJMC
MUST HAVES:
· Data engineering (pandas, pyspark)
· Data lakehouse solutions such as Databricks (Delta Lake).
· Working with XLSX, CSV, JSON files, relational databases, cloud storage, structured and unstructured data
· Experience using AWS Services such as Glue, StepFunctions, Lambda, S3
· Extract/Transform/Load data using tools such as Informatica IDMC
Responsibilities:
Design, develop, test, implement, and troubleshoot:
· data pipelines using various tools such as Databricks, Azure Data Factory, AWS Glue
· complex data transformation procedures
· data models for ...