Just like other software engineers, a Hadoop Engineer is responsible for managing and developing codes and programming Hadoop applications. The day-to-day tasks vary based on the data needs and the amount of data that is being managed, however, the following duties mentioned on the Hadoop Engineer Resume are core and essential for all industries – creating Hadoop applications to analyze data collections; creating processing framework for monitoring data collections and ongoing data processes; performing data extraction functions, testing scripts and analyzing the results; maintaining cybersecurity to maintain data security; and removing unnecessary data to create space.
Companies hire candidates who have the following skills and abilities – excellent Hadoop application knowledge and management, strong programming skills in languages such as Java, Python, Unix Script; and C++; highly detail-oriented and ability to spot smallest problems; and multiple projects handling skills. At a minimum, a degree in Computer Science or IT is required. In addition, employers look for resumes that denote experience in writing Hadoop codes.
Headline : Around 8+ years of IT experience which includes hands on experience in Big Data/Hadoop development and good object oriented programming skills. Experience in all the phases of Data warehouse life cycle involving Requirement Analysis, Design, Coding, Testing, and Deployment.
Skills : Coding, Testing, Management.
Description :
Developed data pipeline using Flume, Sqoop, Pig and Java map reduce to ingest customer behavioral data and financial histories into HDFS for analysis.
Involved in writing Map Reduce jobs.
Involved in Sqoop, HDFS Put or Copy from Local to ingest data.
Used Pig to do transformations, event joins, filter boot traffic and some pre-aggregations before storing the data onto HDFS.
Involved in developing Pig UDFs for the needed functionality that is not out of the box available from Apache Pig.
Used Hive to analyze the partitioned and bucketed data and compute various metrics for reporting.
Involved in developing Hive DDLs to create, alter and drop tables.
Managed works including indexing data, tuning relevance, developing custom tokenizers and filters, adding functionality includes playlist, custom sorting and regionalization with Solr Search Engine.
Experience
5-7 Years
Level
Executive
Education
M.S.
Jr. Hadoop Engineer Resume
Objective : Overall 6 Years of IT experience in Data analytics and Programming. In depth and extensive knowledge of Splunk architecture and various components. Passionate about Machine data and operational Intelligence. Headed Proof-of-Concepts (POC) on Splunk implementation, mentored and guided other team members on Understanding the use case of Splunk.
Skills : Management, Hadoop.
Description :
Developed to observe keyword competition among different companies that advertise online.
Analyzed to see how competitors can make use of similar keywords to make their ads visible.
Installed/Configured/Maintained Pivotal Hadoop clusters for application development and Hadoop tools like Hive, Pig, HBase, Zookeeper and Sqoop.
Wrote the shell scripts to monitor the health check of Hadoop daemon services and respond accordingly to any warning or failure conditions.
Developed data pipeline using Shell scripting, HAWQ, Hive and Java map reduce to ingest customer behavioral data into HDFS for analysis.
Involved in collecting and aggregating large amounts of log data using Apache Flume and staging data in HDFS for further analysis.
Collected the logs data from web servers and integrated in to HDFS using Flume.
Worked on installing cluster, commissioning & decommissioning of DataNodes, NameNode recovery, capacity Planning and slots configuration.
Experience
2-5 Years
Level
Junior
Education
Bachelors
Sr. Hadoop Engineer Resume
Summary : 5+ years of experience in commercial software development and automation in multinational company. 3+ years of experience in Big Data technology, both as a developer as well as an admin. In depth knowledge the agile and the waterfall software development life cycles from collecting business specifications, user requirements, confirming the design decisions regarding data, process, interfaces, reviewing the code, documenting the entire life cycle, building and managing complex, distributed systems.
Skills : Management, Organizing.
Description :
Responsible for installing and Upgrading (major and minor) Mapr Cluster.
Supports of development and production clusters Installing and Upgrading (major and minor) and configuring various ecosystem components like hive, pig, sqoop, hue, spark, impala, kafka etc.
Ingests of various log sources in splunk and creating dashboards for monitoring of different servers.
Creates alerts using Zabbix.
Performs OS level configuration.
Solves day-today server and network issues.
Adds users, groups, quotas, and giving permissions in the servers.
Works closely with the network teams for network related issues.
Experience
10+ Years
Level
Senior
Education
Bachelors
Hadoop Engineer I Resume
Objective : Over 8 years of overall experience as Hadoop Engineer in design, development, deploying and supporting large scale distributed systems.
Skills : Management, Organizing.
Description :
Provides innovative solutions for hotels around the globe that increase revenue, reduce cost, and improve performance.
Collects terabytes of raw data including 10 billion hotel rates.
Involves migrating data from PostgresSQL, SQL Server Database and various other sources to Hadoop to perform analysis to drive hotel marketing, revenue management, and business strategy.
Installs, configures and deploys Hadoop cluster for development, production and testing.
Implements Fair scheduler on the job tracker to allocate the fair amount of resources to small jobs.
Performs operating system installation, Hadoop version updates using automation tools.
Works on setting up high availability for major production cluster and designed automatic failover control using zookeeper and quorum journal nodes.
Upgrades the Hadoop cluster from cdh3 to cdh4.
Experience
2-5 Years
Level
Junior
Education
Bachelors
Hadoop Engineer II Resume
Headline : 7 years of experience in IT field and 3 years of experience in developing, deploying, maintaining, monitoring and upgrading Hadoop Clusters in cloud as well as in-house. (Apache Hadoop, Hortonworks and Cloudera distributions) Built large-scale data processing pipelines and data storage platforms using open-source big data technologies.
Skills : MS Office, Organizing.
Description :
Implemented performance tuning for the existing development cluster.
Configured the cluster to achieve the optimal results by fine-tuning the cluster.
Performed score data analysis on the data stored in HDFS using HIVE.
Targeted the study of user behavior and patterns.
Deployed and monitored scalable infrastructure on Amazon web services (AWS) & configuration management using puppet.
Designed Puppet Modules to manage configurations and automate installation process.
Used AWS Data Pipeline to move data between instances stored in AWS EC2 instances and computer instances.
Applied by making use of Congo DB Got expertise hand in implementing AWS Redshift as an data ware house platform of all our management data that includes provisioning profiles and journaling filesystem Experience AWS Cloud Formation to create instances of compute sources, EC2 data base instances to manage cloud for automation on these DB databases.
Experience
5-7 Years
Level
Executive
Education
Bachelors
Hadoop Engineer III Resume
Summary : 13+ years of experience in analysis, design and development using Big Data, Java and Government(Judicial), Configured Zoo Keeper, Flume, Kafka & Sqoop to the existing Hadoop cluster. Hands-on experience with Hadoop applications (such as administration, configuration management, monitoring, debugging, and performance tuning).
Skills : Management, Organizing.
Description :
Manages the clusters for the application teams like Alpide, Andes, Peaks, Alps, Everest, CAQF, RRBT etc.
Provides access to the groups within the teams, resolving the issues in the environment such as Dev, UAT, Prod and DR.
Helps the teams to maintain standards until they complete their releases.
Manages several Hadoop clusters and other services of Hadoop Ecosystem in development and production environments.
Works closely with engineering teams and participate in the infrastructure development and framework development.
Works on POCs in R&D environment on Hive2, Spark and Kafka before providing services to the applications teams.
Automates deployment and management of Hadoop services including implementing monitoring.
Works closely with Alpide team, ensuring all the issues where addressed or resolved sooner.
Contributes to the evolving architecture of our services to meet changing requirements for scaling, reliability, performance, manageability, and price.
Experience
7-10 Years
Level
Management
Education
Master's
Asst. Hadoop Engineer Resume
Objective : Hadoop Engineer will be responsible for evaluating and performing detailed engineering activities supporting the design, development, and optimization of the data interconnection in a wireless network
Skills : Management, Organizing.
Description :
Enabled business reporting and outbound feeds.
Explored and used Hadoop ecosystem features and architectures.
Configured the Hadoop Cluster in Local (Standalone), Pseudo-Distributed, Fully-Distributed Mode.
Worked closely with business team to gather their requirements and new support features.
Developed Map-Reduce jobs for Log Analysis and Analytics.
Wrote Map-Reduce job to generate reports for the number of activities created on a particular day, during a time interval etc.for the Analytics module.
Implemented an end-to-end oozie workflow for extracting, processing and analyzing the data.
Experience
2-5 Years
Level
Junior
Education
Bachelors
Associate Hadoop Engineer Resume
Headline : Over 8+ years of professional experience in IT industry as a Linux/Hadoop Administrator and production support of various applications on Red Hat Enterprise Linux, Sun Solaris, windows, Cloudera, Hortonworks, and MapR distribution of Hadoop environment. 4+ years of experience in Configuring, installing, benchmarking and managing Apache Hadoop in various distributions like Cloudera, Hortonwoks, and MapR.
Skills : Management, MS Office.
Description :
Installed and configured various components of Hadoop ecosystem and maintained their integrity on Cloudera.
Extensively involved in Cluster Capacity planning, Hardware planning, Installation, Performance Tuning of the Hadoop Cluster.
Experienced in installing, configuring and optimizing Cloudera Hadoop version CDH4 and Hortonworks (HDP 2.2.4.2) in a Multi Clustered environment.
Performed benchmark test on Hadoop clusters and tweak the solution, based on test results.
Experienced in dealing with structured, semi-structured and unstructured data in Hadoop.
Experienced on adding/installation of new components and removal of them through Cloudera Manager.
Worked with big data developers, designers and scientists in troubleshooting map reduce job failures and issues with Hive, Pig and Flume.
Exported the analyzed data to the relational databases using SQOOP for visualization and to generate reports for the BI team.
Monitored systems and services through Cloudera manager dashboard to make the clusters available for the business.
Experience
5-7 Years
Level
Executive
Education
Bachelor Of Engineering
Lead Hadoop Engineer Resume
Summary : Hadoop Engineer is to maintain the integrity of all building systems by operating the building in an efficient manner while performing a variety of tenant services.
Skills : Organizing, Management.
Description :
Worked on creating oozie workflows for scheduling jobs for generating reports on a daily, weekly, and monthly basis.
Used sqoop to import and export the data from mysql, oracle db onto hdfs and hive tables.
Created pig latin scripts to extract from log files and store them on hdfs.
Worked on pig for cleansing and optimizing millions of records on text data.
Worked on partitioning, bucketing, parallel execution, map side joins for optimizing hive queries.
Customized the mapreduce framework for utilizing various data types, input formats, partitioners and custom serde's.
Developed generic hive udf's to process the business logic, and performance tuning.
Experience
10+ Years
Level
Senior
Education
Bachelor's
Hadoop Engineer Resume
Headline : Over 7 years of IT Experience in working on Hadoop Cluster including cluster planning, designing, implementing, benchmarking, performance tuning and monitoring. Experience in developing applications using core Java, Web Technologies along with data structures, collections, JDBC, Servlets, JSP, XML, HTML and LIFERAY portals.
Skills : Coding, Management, Organizing.
Description :
Serves a broad range of financial services, including personal banking, small business lending, mortgages, credit cards, auto financing and investment advice.
Continuously improves a user's experience with the Web site content, and how their applications perform on the actual browsers, networks, and mobile devices.
Responsible for building, monitoring and supporting Hadoop infrastructure and help the team in designing and implementing ETL workflows.
Proactively monitored systems and services, architecture design and implementation of Hadoop deployment, configuration management and backup procedures.
Involved in Analyzing system failures to identify the root causes, and recommended course of actions.
Worked on expanding the cluster along with the Engineering team and deployed new Hadoop environments.
Performed operating system installation, Hadoop updates, patches and version upgrades as per requirement using automated tool.
Creating an account is free and takes five seconds.
You'll get access to the PDF version of this resume template.
Choose an option.
Sign up with Google
Sign up with Facebook
Sign up with Linkedin
This helps us make sure you're human and prevents spammers from abusing our services.
By continuing, you agree to our Privacy Policy and Terms.
Unlock the Power of Over 10,000 Resume Samples.
Take your job search to the next level with our extensive collection of 10,000+ resume samples. Find inspiration for your own resume and gain a competitive edge in your job search.
Get Hired Faster with Resume Assistant.
Make your resume shine with our Resume Assistant. You'll receive a real-time score as you edit, helping you to optimize your skills, experience, and achievements for the role you want.
Get Noticed with Resume Templates that Beat the ATS.
Get past the resume screeners with ease using our optimized templates. Our professional designs are tailored to beat the ATS and help you land your dream job.
