Job Description
The QA & Automation Engineer will be responsible for validating ETL pipelines, data migration processes, and cloud data platform integrations across Azure services. This role involves hands‑on testing of large-scale data platforms, automation development, advanced SQL validation, and ensuring end‑to‑end data quality across enterprise data engineering initiatives.
Key Responsibilities
- Perform end‑to‑end testing of ETL pipelines built using Azure Data Factory, Azure Databricks, Azure Synapse, and SSIS.
- Validate data transformations, mappings, data quality rules, and data lineage.
- Conduct source‑to‑target (S2T) reconciliation, data profiling, completeness, and accuracy checks.
- Verify schema changes, incremental loads, delta loads, and historical load processes.
Data Migration Testing
- Design and execute test strategies for large‑scale on‑prem to cloud or cross‑cloud data migration projects.