Hadoop Administrator

Company: CYNET SYSTEMS
Location: San Antonio
Posted on: May 28, 2023

Job Description:

Job Description:

• 
  
• Hands-on experience on Cloudera installation, configuration, debugging, tuning and administration.
  
• Collaborate and assist developers in successful implementation of their code, monitor and fine tune their process for optimum resource utilization on cluster, ability to automate run time process.
  
• Must have prior Cloudera Hadoop (CDP) cluster deployment experience from the scratch.
  
• Hands-on experience on Cloudera, working with data delivery teams to set up new Hadoop users.
  
• This includes setting up Linux users, setting up Kerberos principals and testing HDFS, Hive.
  
• Exposure to Data Science collaborative tools such as data science workbench, Jupyter hub etc.
  
• Competency in Red Hat Linux administration (security, configuration, tuning, troubleshooting, and monitoring).
  
• Expert knowledge on Active Directory/LDAP security integration with Cloudera Big Data platform.
  
• Performance tuning of Cloudera clusters and Spark (PySpark, SparkQL,) and MapReduce routines.
  
• Optimize clusters for future workloads.
  
• Hands-on experience on node management, monitoring and response, support processes creation, upgrades, and patches, logging configuration and managing user rights and space quota.
  
• Working knowledge of Networks, Linux OS, and Unix Shell Scripting.
  
• Strong hands-on experience in implementation of security like Kerberos, Sentry, OS Upgrade and TLS/SSL implementation etc.
  
• Experience with setting up and configuring the YARN queues using the YARN queue manager and Authorization through Apache sentry.
  
• An Important role is to keep the cluster performing well and dependable.
  
• Perform periodic updates to the cluster and keep the stack current.
  
• Familiarity with Clouderas BDR tool to perform and monitor backups of critical data and be able to restore data when in need.
  
• Exposure to AWS, or any Cloud Platform.
  
• Exposure to Snowflake (Nice to have).
  
  
  

Keywords: CYNET SYSTEMS, San Antonio , Hadoop Administrator, Other , San Antonio, Texas