Job Description
Responsibilities
- Design, implement, and maintain robust ETL/ELT processes to ingest, clean, and transform data from multiple sources
- Process and manage complex datasets to support business and analytical needs
- Conduct regular testing and enhancement of data pipelines to improve efficiency
- Implement best practices for data validation, testing, and monitoring, proactively identifying and resolving issues to maintain data integrity
- Collaborate with software engineers and AI/ML engineers to ensure seamless data accessibility
- Implement best practices for data governance, security, and quality assurance
- Document data architectures, lineage, and metadata to ensure transparency and reproducibility
- 5+ years of experience in data engineering, ETL development, or data warehousing
- Demonstrated ability to design and manage ETL/ELT processes using tools like Airflow, Lu...