Job Description
Authority Partners is seeking an experienced Data Engineer to join our team. You will design, expand, and optimize data pipelines and architectures to support cross-functional teams. The ideal candidate is skilled in building and enhancing data systems, supporting developers, analysts, and scientists, and ensuring seamless data delivery across projects.
Up for the challenge? Then read on and apply!
Responsibilities
- Design, build, and maintain scalable data pipelines for ingesting, transforming, and delivering structured and unstructured data.
- Collaborate with stakeholders in an Agile environment to gather requirements and design data solutions and technology roadmaps aligned with business goals.
- Define and implement best practices for data quality, governance, and security within Azure Databricks.
- Provide expertise on advanced concepts including medallion architecture, Delta Live Tables (DLT), and Unity Catalog. ...