Job Description
About Company: one of the cloud and data analytics company that empowers businesses to unlock insights and drive innovation through modern data solutions.
Experience: 6+Yrs
Location: Chennai
Roles and responsibilities:
- Design, develop, and maintain scalable data pipelines using Databricks and PySpark.
- Work with large datasets to extract, transform, and load (ETL) data from various sources into data lakes and data warehouses.
- Write efficient and optimized SQL queries for data extraction, transformation, and reporting purposes.
- Build automation scripts and tools using Python to support data ingestion and transformation processes.
- Develop and deploy data solutions in a cloud environment (AWS) using services such as S3, Lambda, Glue, Redshift, EMR,...