Job Description
Job Description: Hadoop AdministratorRole OverviewWe are looking for an experienced Hadoop Administrator to manage, maintain, and upgrade our on-premises Hadoop clusters. The role involves working on Apache Hadoop versions and , ensuring cluster stability, performance, and scalability, along with ecosystem components like Hive and YARN. Key Responsibilities1. Cluster Administration:- Install, configure, and manage on-prem Hadoop clusters based on Apache Hadoop (versions and - Administer and monitor Hadoop Distributed File System (HDFS) including storage management, replication, and data balancing- Manage resource allocation and scheduling using Apache YARN2. Upgrade & Migration:- Hadoop upgrades ( → ;in on-prem environments- Perform Cluster migration, Data validation (HDFS checksums, block integrity) & Backward compatibility validation for jobs- Experience with migration tools and distribution changes3. Ecosystem Management- Administer and opti...