Hadoop Administrator Resume Samples

Description :

1. Experienced of Managing and scheduling jobs, types of schedulers in Hadoop, configuring the schedulers and run MapReduce jobs and Cluster Monitoring and Troubleshooting Configured FIFO and Fair Scheduler to provide service-level agreements for multiple users of a cluster.
2. Managing nodes on Hadoop cluster connectivity and security.
3. Experienced of configured more than one namenode and monitor active namenode and standby namenode.
4. Also configure QJM (Quorum Journal Manager) and verified that QJM read edits logs and applies to its own namespace Involved in Hadoop Cluster administration of adding and removing nodes in cluster, cluster capacity planning, performance tuning, cluster Monitoring, Troubleshooting.
5. Experienced of manage user and group access to various Big Data Environments Experienced of configure Rack Awareness.
6. Setting up Hadoop Backup, whitelist and blacklist datanodes in a Cluster Experienced of Service Monitoring, Service and Log Management, Auditing and Alerts, Hadoop Platform Security, and Configuring Kerberos.
7. Performance optimization Experienced of analyze problem, plan, Design, and Create a Hadoop Cluster for a use case, setup and configure commonly used Hadoop ecosystem components such as Pig and Hive.

Experience

5-7 Years

Level

Executive

Education

Computer Science

Description :

1. Performance Food Group delivers more than 150,000 food and related products to customers across Each division meets the needs of a unique group of customers and continues to evolve as the industry grows and changes.
   
2. Responsible for the implementation and support of the Enterprise Hadoop environment.
3. Involves designing, capacity arrangement, cluster set up, performance fine-tuning, monitoring, structure planning, scaling, and administration.
4. Installation and configuration of Linux for a new build environment.
5. Day-to-day - user access, permissions, Installing and Maintaining Linux Servers.
6. Created volume groups logical volumes and partitions on the Linux servers and mounted file systems and created partitions Experienced in Installation and configuration Cloudera CDH4 in a testing environment.
7. Responsible on-boarding new users to the Hadoop cluster (adding user a home directory and providing access to the datasets).

Experience

2-5 Years

Level

Junior

Education

Bachelors Of Technology

Description :

1. Responsible for the installation, configuration, maintenance, and troubleshooting of Hadoop Cluster.
2. Monitoring cluster performance using various tools to ensure the availability, integrity, and confidentiality of application and equipment.
3. Experience in installing and configuring RHEL servers in Production, Test and Development environment and used them in building application and database servers.
4. Deployed the Hadoop cluster in a cloud environment with scalable nodes as per the business requirement.
5. Installed, configured and optimized Hadoop infrastructure using Cloudera Hadoop distributions CDH5 using Puppet.
6. Monitored workload, job performance and capacity planning using the Cloudera Manager Interface.
7. Improved the Hadoop cluster performance by considering the OS kernel, Disk I/O, Networking, memory, reducer buffer, mapper task, JVM task, and HDFS by setting appropriate configuration parameters.
8. Experience in commissioning and decommissioning nodes of the Hadoop cluster.

Experience

2-5 Years

Level

Executive

Education

Bachelors Of Engineering

Description :

1. Currently working as Hadoop administrator in Hortonworks distribution for 3 clusters ranges from POC clusters to PROD clusters.
2. Responsible for Cluster maintenance, commissioning and decommissioning Data nodes, Cluster Monitoring, Troubleshooting, Manage and review data backups, Manage & review Hadoop log files.
3. Monitoring systems and services, architecture design and implementation of hadoop deployment, configuration management, backup, and disaster recovery systems and procedures.
4. Responsible for cluster availability and experienced on ON-call support Experienced in Setting up the project and volume setups for the new Hadoop projects.
   
5. Involved in snapshots and HDFS data backup to maintain the backup of cluster data and even remotely.
6. Implementing the SFTP for the projects to transfer data from External servers to hadoop servers.
7. Installation of various Hadoop Ecosystems and Hadoop Daemons.

Experience

7-10 Years

Level

Management

Education

Diploma

Description :

1. Expertise in recommending hardware configuration set up bench mark for cluster set up for Hadoop cluster.
2. Installing, Upgrading and Managing Hadoop Cluster on Cloudera distribution across data centers.
3. Automated all the jobs, for pulling data from FTP server to load data into Hive tables, Using Oozie workflows.
4. Installed, managed and configured domains, server instances in Web logic/Tomcat application servers Managing and reviewing Hadoop and HBase log files for debugging and error analyzing process.
5. Loading logs data directly into HDFS using Flume Experience with implementing UNIX shell scripts to manage and setup data nodes space across cluster.
6. Practical knowledge on functionalities of every Hadoop daemons, interaction between them, resource utilizations and dynamic tuning to make cluster available and efficient.
7. Performed Importing and exporting data into HDFS and Hive using Sqoop.
8. Created, Managing tasks like listing jobs, killing jobs and failing jobs.

Experience

2-5 Years

Level

Executive

Education

Diploma

Description :

1. Currently working as Hadoop administrator in Hortonworks distribution for 3 clusters ranges from POC clusters to PROD clusters.
2. Responsible for Cluster maintenance, commissioning and decommissioning Data nodes, Cluster Monitoring, Troubleshooting, Manage and review data backups, Manage & review Hadoop log files.
3. Monitoring systems and services, architecture design and implementation of hadoop deployment, configuration management, backup, and disaster recovery systems and procedures.
4. Working knowledge on hive and its components and troubleshooting if any issues with hive.
5. Responsible for cluster availability and experienced on ON-call support.
6. Experienced in Setting up the project and volume setups for the new hadoop projects.
7. Involved in snapshots and HDFS data backup to maintain the backup of cluster data and even remotely.
8. Implementing the SFTP for the projects to transfer data from External servers to hadoop servers.

Experience

10+ Years

Level

Senior

Education

Diploma

Description :

1. Responsible for architecting Hadoop clusters Translation of functional and technical requirements into detailed architecture and design.
2. Installed and configured multi-nodes fully distributed Hadoop cluster of large number of nodes.
3. Provided Hadoop, OS, Hardware optimizations.
4. Setting up the machines with Network Control, Static IP, Disabled Firewalls, Swap memory.
5. Installed and configured Cloudera Manager for easy management of existing Hadoop cluster Administered and supported distribution of Hortonworks.
6. Worked on setting up high availability for major production cluster Implemented Fair scheduler on the job tracker to allocate fair amount of resources to small jobs.
7. Performed operating system installation, Hadoop version updates using Automation tools.
8. Configured Oozie for workflow automation and coordination.

Experience

2-5 Years

Level

Junior

Education

Diploma

Description :

1. Involved in collecting requirements from business users, designing and implementing data pipelines and ETL workflows.
2. Responsible for performance tuning, backup and recovery with respect to Hadoop systems.
3. Involved in transferring data between RDBMS and HDFS using Sqoop.
4. Responsible for troubleshooting issues in the execution of Map Reduce jobs by inspecting and reviewing log files.
5. Created internal and external Hive tables and defined static and dynamic partitions as per requirement for optimized performance.
6. Effectively used Oozie to develop automatic workflows of Sqoop, Map Reduce and Hive jobs.
7. Used Tableau to visualize the analyzed data.
8. Conducted root cause analysis and worked with users to troubleshoot map reduce job failures and issues with Hive and Map Reduce.

Experience

7-10 Years

Level

Consultant

Education

Master Of Science

Description :

1. Responsible for architecting Hadoop clusters Translation of functional and technical requirements into detailed architecture and design.
2. Worked exclusively on Cloudera distribution of Hadoop.
3. Installed and configured multi-node fully distributed Hadoop cluster of large number of nodes.
4. Installed and configured Cloudera Manager for easy management of existing Hadoop cluster.
5. Worked on setting up high availability for major production cluster and designed automatic failover control using Zookeeper and Quorum Journal Nodes.
6. Implemented Fair scheduler on the job tracker to allocate fair amount of resources to small jobs.
7. Performed operating system installation and Hadoop version updates using automation tools.
8. Configured Oozie for workflow automation and coordination.

Experience

5-7 Years

Level

Executive

Education

BS In Economics

Description :

1. Installed and configured Apache Hadoop, Hive and Pig environment on Cloudera.
2. Maintained Hadoop clusters health through Cloudera Managers.
3. Extensively involved in Installation and configuration of Cloudera distribution Hadoop, Name Node, Job Tracker, Task Trackers and Data Nodes.
4. Configured MySQL Database to store Hive metadata.
5. Responsible for loading unstructured data into Hadoop File System (HDFS).
6. Used Sqoop tool to load data from RDBMS into HDFS.
7. Installed and configured Hadoop ecosystem like HBase, Flume, Pig and Sqoop.
8. Involved in Hadoop cluster task like Adding and Removing Nodes without any effect to running jobs and data.

Experience

7-10 Years

Level

Management

Education

Diploma

Description :

1. Worked on analyzing Hadoop cluster and different big data analytic tools including Pig, Hbase database and Sqoop.
2. Responsible for building scalable distributed data solutions using Hadoop.
3. Storage capacity management, performance tuning and benchmarking.
4. Interacted with different system groups for analysis of systems.
5. Created tables, views in Teradata, according to the requirements.
6. Implemented a script to transmit sysprin information from Oracle to Hbase using Sqoop.
7. Implemented best income logic using Pig scripts and UDFs.
8. Implemented test scripts to support test driven development and continuous integration.

Experience

2-5 Years

Level

Junior

Education

B.E In Electrical Engineering

Description :

1. Responsible for building scalable distributed data solutions using Hadoop.
2. Storage capacity management, performance tuning and benchmarking.
3. Interacted with different system groups for analysis of systems.
4. Created tables, views in Teradata, according to the requirements.
5. Implemented a script to transmit sysprin information from Oracle to Hbase using Sqoop.
6. Implemented best income logic using Pig scripts and UDFs.
7. Implemented test scripts to support test driven development and continuous integration.
8. Worked on tuning the performance Pig queries.

Experience

5-7 Years

Level

Executive

Education

Electrical Engineering