Job Description
Job Description
Responsibilities
• Work closely with Subject Matter Experts (SMEs) to design and develop the ontology (data model) and data pipelines.
• Design, implement, and maintain robust data pipelines and ETL processes.
• Develop and optimize cloud-based data storage and processing solutions.
• Collaborate with data analysts and data scientists to understand data requirements and deliver high-quality data solutions.
• Ensure data integrity and security across all data workflows and storage solutions.
• Monitor and troubleshoot data pipelines, addressing any issues promptly to ensure the smooth flow of data.
• End to End data pipeline development – responsible for using Python and Pyspark to perform ETL and derive new datasets necessary for business applications.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative act...
Responsibilities
• Work closely with Subject Matter Experts (SMEs) to design and develop the ontology (data model) and data pipelines.
• Design, implement, and maintain robust data pipelines and ETL processes.
• Develop and optimize cloud-based data storage and processing solutions.
• Collaborate with data analysts and data scientists to understand data requirements and deliver high-quality data solutions.
• Ensure data integrity and security across all data workflows and storage solutions.
• Monitor and troubleshoot data pipelines, addressing any issues promptly to ensure the smooth flow of data.
• End to End data pipeline development – responsible for using Python and Pyspark to perform ETL and derive new datasets necessary for business applications.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative act...