Job Description
Role Summary
Our client is looking for a strong Data Engineer with hands-on experience in data platforms, large-scale scraping, LLMs, and agentic AI solutions.
This person should be able to build reliable data pipelines and also help design AI agents that can use tools, query systems, process data, and automate complex workflows.
Key Responsibilities
- Build scalable data pipelines for batch and near-real-time ingestion.
- Ingest data from APIs, files, databases, event streams, and web sources.
- Design and operate large-scale scraping and data acquisition solutions.
- Clean, validate, transform, and model data for analytics, reporting, and AI use cases.
- Build LLM-powered workflows and agentic solutions using tool calling, structured outputs, RAG, and API/database integration.
- Support data lake, warehouse, and lakehouse architectures.