Job Description
Key Responsibilities
- Design, implement, and optimize scalable data solutions using Snowflake and Databricks platforms to meet evolving business needs.
- Develop and maintain complex ETL/ELT pipelines integrating structured and semi-structured data from diverse sources, ensuring reliability and performance.
- Create and manage Snowflake objects including databases, schemas, tables, views, stored procedures, streams, and tasks to support robust data management and accessibility.
- Construct and optimize Databricks notebooks and Spark jobs leveraging PySpark and Spark SQL for advanced data transformation and analytics.
- Collaborate with cloud infrastructure teams to integrate data pipelines with cloud storage solutions and enterprise applications using APIs and connectors.
- Apply data modeling best practices including dimensional modeling, partitioning, and data partition strategies to enhance query performance and system scalability.