Job Description
The missions are to:
- Implement solutions using PySpark
- Design, build, and maintain efficient, reusable, and reliable code,
- Ensure the best possible performance, quality, and responsiveness
- Identify bottlenecks and bugs, and devise solutions to mitigate and address those issues,
- Help maintain code quality and organization.
Qualifications:
- Proven expertise in Hadoop, Spark, Scala, and PySpark.
- Significant professional experience in the Big Data domain, with in-depth expertise in the Hadoop, Spark, Scala, and PySpark ecosystem.
- Excellent command of the Java programming language, with advanced development and maintenance skills.
- Strong Scala or PySpark development skills, with experience in rewriting Java components in Scala or PySpark.
- Good knowledge of data engineering, systems engineering, software engineering, and Big Data architecture principles.