Position Details

Salary $86K – $113K USD / year

Type Not Specified

Experience senior

Exp. Years Not specified

Education Not specified

Category Cloud & Infrastructure

About this role

Administer and operate Hadoop infrastructure to keep clusters running reliably and performing as expected. Manage scaling, configuration, monitoring, backups, and troubleshooting, collaborating with multiple technical teams.

Key Responsibilities

Deploy and maintain Hadoop clusters by adding/removing nodes
Configure Name Node high availability
Monitor running Hadoop jobs and cluster connectivity/performance
Manually set Hadoop configuration (CoreSite, HDFS Site, YARN Site, Map Red Site)
Manage log review, backup and recovery, resource and security management, and troubleshooting

Technical Overview

You will deploy and maintain Hadoop clusters by adding/removing nodes and configuring NameNode high availability. The role requires manually setting CoreSite, HDFS Site, YARN Site, and Map Red Site for Hadoop distributions such as Hortonworks, Cloudera, or MapR, with monitoring via Ganglia/Nagios/Cloudera Manager and operational support including backups, recovery, logs, and security/resource management.

Ideal Candidate

The ideal candidate is a senior Hadoop administrator experienced in deploying and maintaining Hadoop clusters, including node scaling and NameNode high availability. They have hands-on skills with Hadoop configuration (CoreSite, HDFS Site, YARN Site, Map Red Site), monitoring (Ganglia, Nagios, Cloudera Manager), and operational tasks like log review, backup/recovery, and troubleshooting.

Must-Have Skills

Azure Infra ServicesHadoop cluster administrationGanglia Nagios or Cloudera ManagerName Node high availabilityHDFS SiteYARN SiteMap Red Sitecapacity planningHadoop log file reviewbackup and recovery tasksresource and security managementtroubleshooting application errors

Tools & Platforms

GangliaNagiosCloudera ManagerHortonworksClouderaMapR

Required Skills

Hadoop cluster administrationadding and removing nodesGangliaNagiosCloudera ManagerName Node high availabilityHadoop job monitoringHortonworksClouderaMapRmanual setup CoreSiteHDFS SiteYARN SiteMap Red Sitecapacity planningHDFSmonitoring cluster connectivity and performanceHadoop log filesbackup and recoveryresource and security managementtroubleshooting application errorsAzure Infra Services

Hard Skills

Hadoop cluster administrationdeploying Hadoopmaintaining Hadoop clustersadding nodesremoving nodescluster monitoring toolsGangliaNagiosCloudera ManagerName Node high availabilityHadoop job monitoringHadoop infrastructure managementadministering Hadoop infrastructureHortonworksClouderaMapRmanual setup CoreSiteHDFS SiteYARN SiteMap Red Sitecapacity planningHDFS capacity estimationmonitoring cluster connectivitymonitoring cluster performanceHadoop log file reviewbackup and recovery tasksresource managementsecurity managementtroubleshooting application errorsAzure Infra Servicessystem management

Soft Skills

cross-functional collaborationcommunication with database teamcommunication with network teamcommunication with BI teamcommunication with application teamsissue troubleshooting communication

Industry & Role

Industry Consulting

Job Function Operate and administer Hadoop clusters for availability, performance, and reliability

Role Subtype Linux Sysadmin

Tech Domains Azure, Linux

Keywords for Your Resume

Hadoop AdministratorSenior ConsultantSystem ManagementHadoop clusterdeploying maintaining the Hadoop clusteradding and removing nodesGangliaNagiosCloudera ManagerName Node high availabilityHadoop jobsHortonworksClouderaMapRCoreSiteHDFS SiteYARN SiteMap Red Sitecapacity planningHDFSmonitoring the clusterHadoop log filesbackup and recoveryresource and security managementtroubleshootingAzure Infra Services

Deal Breakers

Must have Azure Infra Services, Must have Hadoop cluster administration experience including Name Node high availability, Must be able to configure CoreSite, HDFS Site, YARN Site, and Map Red Site manually

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Hadoop Administrator (Senior Consultant - System Management)

Get matched to jobs like this