Job Description
<p><b>Job Details: <br /> Role Overview:</b><br /> ix and enhance Dataflow and/or Dataproc Data ingestion pipelines (batch & Streaming) .<br /> Have Good Understanding of GCP Composer (Apache Airflow) environments.<br /> Manage Airflow DAGs and troubleshoot Airflow-related issues.<br /> Monitor and optimize Composer performance and scalability.<br /> Maintain GCP infrastructure including services like:<br /> o Google Cloud Storage (GCS)<br /> o BigQuery (BQ)<br /> o Cloud Dataflow ( Apache Beam )<br /> o Cloud Dataproc<br /> o Cloud Functions<br /> o Cloud Run<br /> Have Good Understanding of:<br /> o IAM and service account permissions<br /> o Secret Manager<br /> Monitor GCP usage and quotas, and proactively prevent quota-related issues.<br /> Set up and manage alerting, logging, and monitoring using tools like Stackdriver (Cloud Mon...