Job Description
Responsibilities:
- Support and manage Cloudera Data Platform (CDP) and Oracle database environments.
- Monitor, troubleshoot, and resolve data pipeline, job failure, and performance issues.
- Support batch and streaming data ingestion and optimize data storage (partitioning, retention, lifecycle).
- Develop, maintain, and optimize SQL queries, stored procedures, and database performance.
- Design and support ETL/ELT pipelines using tools like Spark, Talend, Sqoop, and Airflow.
- Integrate data from multiple sources (APIs, databases, flat files).
- Ensure data quality, consistency, governance, and compliance with enterprise standards.
- Develop and maintain Power BI dashboards, reports, and data models (DAX, star schema).
- Implement data security, access controls, and row-level security.
- Automate reporting and data refresh processes.
- Work with business users and IT teams to gather requiremen...