Roles & Responsibilities:

• Should be able to deploy Hadoop Cluster (Preferably CDH/CDP), add and remove nodes,
• Keep track of jobs, monitor critical parts of cluster, configure name-node HA, schedule and configure backups.
• General operational expertise such as good troubleshooting skills, understanding system’s capacity, bottlenecks, basics of memory, CPU, OS, storage and networks.
• Hadoop stacks like HIVE, Impala, Hbase, Nifi, etc
• Good Knowledge of Linux as Hadoop runs on Linux.
• Familiarity with open source configuration and deployment tools such as Jenkins, Puppet/Chef and Linux scripting.
• Responsible for implementation and ongoing administration of Hadoop Infrastructure.
• Aligning with different Engineering teams to propose and deploy hardware and software
• environments required for Hadoop and to expand existing environments.
• Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals and testing the services for new users.
• Cluster maintenance using Cloudera Manager.
• Performance tuning for Hadoop clusters and Hadoop map reduce routines.
• Monitor Hadoop cluster connectivity and security.
• Log and storage management.
• Diligently teaming with infrastructure, network, database, application and BI teams to guarantee high data availability. 

Secondary Responsibilities:

• Software installation and configuration.
• Database backup and recovery
• Database connectivity and security.
• Performance monitoring and tuning.
• Disk space management.