Job Description:
- We are looking for a highly skilled Senior Hadoop Administrator with 9 12 years of experience in administering and supporting enterprise scale Big Data platforms
- The ideal candidate should possess deep expertise in Hadoop ecosystem administration cluster architecture performance optimization security implementation automation and cloud based Big Data platforms
- The role requires leading platform operations driving modernization initiatives and mentoring junior team members while ensuring high availability and reliability of the Hadoop infrastructure
Key Responsibilities:
- Install configure administer and maintain Hadoop clusters in production environments
- Manage and support Hadoop ecosystem components such as HDFS YARN MapReduce Hive HBase Spark Sqoop Oozie Kafka ZooKeeper and Impala
- Perform cluster monitoring health checks capacity planning and resource optimization
- Configure and manage Hadoop security including Kerberos Ranger Knox and LDAP AD integration
- Troubleshoot cluster application and performance related issues
- Plan and execute Hadoop upgrades patches and migrations with minimal downtime
- Implement backup recovery and disaster recovery procedures
- Monitor system performance using tools such as Ambari Cloudera Manager Grafana Nagios or Prometheus
- Support data engineering and analytics teams in deploying and troubleshooting workloads
- Manage user access permissions and governance policies
- Automate administrative tasks using Shell Scripting Python or Ansible
- Ensure platform compliance with organizational security and operational standards
- Create and maintain operational documentation runbooks and SOPs
Technical Requirements:
- Strong experience in Hadoop Administration Apache Hadoop Cloudera CDP CDH Hortonworks HDP or MapR
- Hands on experience with HDFS YARN Hive Spark HBase Kafka and ZooKeeper
- Experience with Linux Unix administration
- Proficiency in Shell Scripting and basic Python scripting
- Knowledge of Hadoop cluster architecture resource management and performance tuning
- Experience in troubleshooting distributed systems and production support environments
- Understanding of high availability disaster recovery and backup strategies
- Experience with security tools such as Kerberos Ranger Knox and LDAP
- Cloud platform exposure AWS EMR Azure HDInsight Databricks or GCP Dataproc
- Knowledge of containerization technologies like Docker and Kubernetes
- Experience with CI CD and automation tools such as Jenkins and Ansible
- Understanding of data warehousing and ETL concepts
Additional Responsibilities:
- Infosys is a global leader in next generation digital services and consulting
- We enable clients in more than 50 countries to navigate their digital transformation
- With over four decades of experience in managing the systems and workings of global enterprises we expertly steer our clients through their digital journey
- We do it by enabling the enterprise with an AI powered core that helps prioritize the execution of change
- We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight
- Our always on learning agenda drives their continuous improvement through building and transferring digital skills expertise and ideas from our innovation ecosystem
- Infosys provides equal employment opportunities to applicants and employees without regard to race color sex gender identity sexual orientation religious practices and observances national origin pregnancy childbirth or related medical conditions status as a protected veteran or spouse family member of a protected veteran or disability
Preferred Skills:
Technology->Big Data - Hadoop->Hadoop Administration