Job Description
Responsibilities
- Design and develop the robust data solutions on SQL Server, ensuring optimal performance through advanced query optimization, indexing strategies, and partition management
- Design and optimize large-scale ETL pipelines using Apache Spark to process high-volume data from diverse sources across the bank
- Ensure data quality and reliability across the platform through comprehensive validation frameworks and proactive monitoring
- Collaborate with analytics teams using SAP BusinessObjects and other systems to deliver regulatory reports and business intelligence
- Drive continuous improvement by evaluating and adopting emerging technologies and best practices in big data engineering
- Troubleshoot and resolve complex data pipeline issues, performance bottlenecks, and system failures
- Around 8 years of data engineering experi...