Job Description
Advance your career as a Principal Data Engineer at Tata Consultancy Services, specializing in Databricks and modern data architectures. This position is ideal for those experienced in large-scale data solutions and financial data models in a hybrid role.
You will drive the transformation from Cloudera to Databricks, ensuring data governance and integrity throughout the migration process. Your expertise will play a key role in shaping enterprise data platforms and enhancing reporting capabilities.
Key Responsibilities:
• Lead transformation initiatives from Cloudera to Databricks
• Design and implement cloud-based data architectures
• Ensure compliance with data quality and governance frameworks
• Optimize data pipelines with Spark SQL and PySpark
• Act as a subject matter expert and mentor for teams
Requirements:
• Proven experience in Data Warehouse and Lakehouse environments
• Strong technical skills in Databricks, Delta Lake, and Spark
• Familiarity...
You will drive the transformation from Cloudera to Databricks, ensuring data governance and integrity throughout the migration process. Your expertise will play a key role in shaping enterprise data platforms and enhancing reporting capabilities.
Key Responsibilities:
• Lead transformation initiatives from Cloudera to Databricks
• Design and implement cloud-based data architectures
• Ensure compliance with data quality and governance frameworks
• Optimize data pipelines with Spark SQL and PySpark
• Act as a subject matter expert and mentor for teams
Requirements:
• Proven experience in Data Warehouse and Lakehouse environments
• Strong technical skills in Databricks, Delta Lake, and Spark
• Familiarity...