Hadoop Consultant Resume Samples

A Hadoop Consultant advises organizations about big data, big data strategies, big data implementation, and the technologies that fit best the needs of the organization. The job description includes implementing the selected big data solutions. While the duties vary based on the needs of the client, the following are certain core and common duties seen on the Hadoop Consultant Resume – designing strategies and programs to store, analyze, collect and visualize data from various sources for specific projects; developing Hadoop solution recommendation, ensuring implementation of the chosen big data solution; and assessing data sets.

In order to ensure quality in providing consultation service, the professional must have sufficient technical knowledge, be able to program in different scripting and programming languages such as Python, Ruby, Java, SQL, and Clojure; a good understanding of Hadoop hive and familiarity with disciplines such as clustering analysis, text mining is also needed. A Master’s qualification with a professional certification in Hadoop Management is needed.

Hadoop Consultant Resume example

Senior Hadoop Consultant Resume

Summary : Hadoop Consultant Over 8 years of overall experience as software developer in design, development, deploying and supporting large scale distributed systems. Over 3 years of extensive experience as HadoopDeveloper and BigDataAnalyst.

Skills : HDFS, MapReduce, YARN, Pig, Hive, Sqoop, HBase, Flume, Oozie, Zookeeper.

Description :

    1. Organizes and manages based primarily upon geographic location and the nature of the products and services it offers.
    2.  Uses Sqoop to transfer data between RDBMS and HDFS.
    3. Involves in collecting and aggregating large amounts of streaming data into HDFS using Flume and defined channel selectors to multiplex data into different sinks.
    4. Implementes complex map reduce programs to perform map side joins using distributed cache.
    5. Designs and implementes custom writable, custom input formats, custom partitions and custom comparators in Mapreduce.
    6. Thoroughly testes MapReduce programs using MRUnit and Junit testing frameworks.
    7. Responsible for troubleshooting issues in the execution of Mapreduce jobs by inspecting and reviewing log files Converted existing SQL queries into Hive QL queries.
Years of Experience
Experience
7-10 Years
Experience Level
Level
Senior
Education
Education
Bachelors


Associate Hadoop Consultant Resume

Headline : Hadoop Consultant of extensive experience in Big Data Hadoop and its ecosystem. Experienced Hadoop/Java developer having end to end experience in developing applications in Hadoop ecosystem.

Skills : .Hadoop Map Reduce, Hive, Sqoop, Pig, HDFS, Hbase, Cassandra, ZooKeeper, Oozie, and Flume.

Description :

    1. Worked on a 100 nodes Hadoop cluster.
    2. Worked with unstructured and semi structured data of 1+ Petabytes in size.
    3. Involved in full life-cycle of the project from Design, Analysis, logical and physical architecture modeling, development, Implementation, testing.
    4. Extracted the data from Teradata into HDFS using Sqoop.
    5. Created and worked Sqoop (version 1.4.3) jobs with incremental load to populate Hive External tables.
    6. Developed MapReduce(YARN) jobs for cleaning, accessing and validating the data.
    7. Written multiple MapReduce programs in java for data extraction, transformation and aggregation from multiple file formats including XML, JSON, CSV and other compressed file formats.
Years of Experience
Experience
5-7 Years
Experience Level
Level
Executive
Education
Education
Bachelors


Junior Hadoop Consultant Resume

Objective : Hadoop Consultant of competitive intelligence and holistic, timely analysis of Big Data made possible by the successful installation, configuration, administration and maintenance of Hadoop ecosystem components and architecture.

Skills : Cloudera Manager, Apache Hadoop, Kerberos, Cluster Management, Performance Improvement, YARN, SQL, Agile, Unix Administration.

Description :

    1. Hands on experience with Apache Hadoop and CDH distributions.
    2. Installed and configured multiple Apache and CDH Hadoop clusters.
    3. Involved in hadoop cluster planning, finalizing the architecture, onboarding the projects to the cluster, cluster monitoring and maintenance.
    4. Assisted with data capacity planning and node forecasting.
    5. Translation of functional and technical requirements into detailed architecture and design.
    6. Responsible for Installation, monitoring, managing, troubleshooting, applying patches in different environments such as Development Cluster, Test Cluster and Production environments.
    7. Monitored and controlled local file system disk space usage, local log files, cleaning log files with automated scripts.
    8. Monitored cluster health status on daily basis, tuning system performance related configuration parameters.
Years of Experience
Experience
2-5 Years
Experience Level
Level
Junior
Education
Education
MBA

Hadoop Consultant I Resume

Objective : Highly qualified Hadoop Consultant with experience in the industry. Enjoy creative problem solving and getting exposure on multiple projects, and would excel in the collaborative environment on which company prides itself.

Skills : Management, Organizing.

Description :

    1. Used Sqoop to transfer data between RDBMS and HDFS.
    2. Involved in collecting and aggregating large amounts of streaming data into HDFS using Flume and defined channel selectors to multiplex data into different sinks.
    3. Implemented complex map reduce programs to perform map side joins using distributed cache Designed and implemented custom writable, custom input formats, custom partitions and custom comparators in Mapreduce.
    4. Thoroughly tested MapReduce programs using MRUnit and Junit testing frameworks.
    5. Responsible for troubleshooting issues in the execution of Mapreduce jobs by inspecting and reviewing log files Converted existing SQL queries into Hive QL queries.
    6. Implemented UDFs, UDAFs, UDTFs in java for hive to process the data that can't be performed usingHive inbuilt functions Effectively used Oozie to develop automatic workflows of Sqoop, Mapreduce and Hive jobs.
    7. Exported the analyzed data into relational databases using Sqoop for visualization and to generate reports for the BI team.
Years of Experience
Experience
2-5 Years
Experience Level
Level
Junior
Education
Education
Masters

Hadoop Consultant II Resume

Headline : Around 8 years of IT experience in Hadoop, Data Warehousing, Linux and JAVA. Over 2 years of experience in providing solutions for Big data using Hadoop 2.x, HDFS, MR2, YARN, Kafka, PIG, Hive, Tez, Sqoop, HBase, Zoo keeper, Oozie,UC4, Hue, CDH5 & HDP 2.x. Expertise in doing Sprint planning, story pointing, daily scrum, Sprint retrospective and Sprint reviews.

Skills : Management, Organizing.

Description :

    1. Performs payment processing for online vendors, auction sites and other commercial users.
    2. Partnesr detection service Will automatically crawl through the merchant's sites using eBay crawler and does the partner search based on the rules engine with a degree of integrated confidence levels.
    3. Co-ordinates between multiple cluster teams for business queries and migration.
    4. Evaluates of the Hadoop platform and its ecosystem tools for the batch process.
    5. Responsible for building scalable distributed data solutions using Hadoop.
    6. Handles importing of data from various data sources, performed transformations using hive, map reduce, and loaded data into hdfs.
    7. Uses agile methodology in developing the application, which included iterative application development, weekly status report and stand up meetings.
Years of Experience
Experience
5-7 Years
Experience Level
Level
Executive
Education
Education
Bachelors

Hadoop Consultant III Resume

Summary : Hadoop Consultant works in key projects for leading organizations in data mining & knowledge Discovery, predictive modeling, trend modeling, Simulation models (Monte Carlo), Review of credit rating and scoring models and quant support to the business and R&D projects.

Skills : Management, Organizing.

Description :

    1. Worked on a live Big Data Hadoop production environment with 200 nodes.
    2. Worked in implementing Hadoop with the AWS EC2 system using a few instances in gathering and analyzing data log files.
    3. Developed Use cases and Technical prototyping for implementing PIG, HDP, HIVE and HBASE.
    4. Analyzed the alternatives for NOSQL Data stores and intensive documentation for HBASE vs.Accumulo data stores.
    5. Communicated with developers using in-depth knowledge of Cassandra Data Modeling for converting some of the applications to use Cassandra instead of Oracle.
    6. Responsible for design and development of Big Data applications using Hortonworks Hadoop.
    7. Worked on data using Sqoop from HDFS to Relational Database Systems and vice-versa.
    8. Maintained and troubleshoot Hadoop core and ecosystem components (HDFS, Map/Reduce, Name node, Data node, Job tracker, Task tracker, Zookeeper, YARN, Oozie, Hive, Hue, Flume, HBase, and Fair Scheduler).
Years of Experience
Experience
7-10 Years
Experience Level
Level
Management
Education
Education
Bachelors

Asst. Hadoop Consultant Resume

Objective : Hadoop Developer with 8 years of experience, which includes 4+ experience in the Big Data ecosystem, related technologies Adept at problem-solving, ensuring that an appropriate level of application quality is maintained. An experienced Big Data-Hadoop Programmer with varying level of expertise around different Hadoop projects like HBase, Storm, Hive, Flume, Pig.

Skills : Coding, Management.

Description :

    1. Generated and stored in the same database where legacy data reside, this made the process, capture and querying difficult.
    2. Big Data Hadoop solution solved this problem.
    3. Imported reporting and work data tables to HDFS cluster through Sqoop.
    4. Coded Pig and Hive scripts and ran as per demand in batch mode for reporting.
    5. Worked on analyzing, writing Hadoop Mapreduce jobs using JavaAPI, Pig and Hive.
    6. Responsible for building scalable distributed data solutions using Hadoop.
    7. Involved in loading data from edge node to HDFS.
    8. Created HBase tables to store variable data formats of data coming from different portfolios.
Years of Experience
Experience
2-5 Years
Experience Level
Level
Junior
Education
Education
Masters

Associate Hadoop Consultant Resume

Summary : Over all IT experience 8+ years. 3+ years' experience on Hadoop ecosystem. Maintained Hadoop clusters forDevelopment/Quality/Production. Experience in monitoringand managing 100+ node Hadoop cluster. Experience in deploying Hadoop cluster on Public and Private Cloud Environment like Amazon AWS, Rack Space.

Skills : Monitoring, Management, Organizing.

Description :

    1. Helped the team to increase cluster size from 35 nodes to 113 nodes.
    2. Installed, configured and deployed a 60 node ClouderaHadoop cluster for development, production.
    3. Worked on setting up high availability for major production cluster and designed automatic failover.
    4. Performed both major and minor upgrades to the existing CDH cluster.
    5. Performed tune Hadoop cluster to achieve higher performance.
    6. Configured Hive metastore with MySQL, which stores the metadata of Hive tables.
    7. Configured Flume for efficiently collecting, aggregating and moving large amounts of log data.
Years of Experience
Experience
7-10 Years
Experience Level
Level
Executive
Education
Education
Bachelors

Lead Hadoop Consultant Resume

Summary : 10 years of IT experience in Analysis, Design, Development of e-commerce, intranet web applications, Software Applications. Experience in providing solutions for Big Data using Hadoop, HDFS, , PIG, Hive, Sqoop, Cloudera Manager, Zoo keeper, Azkaban, Hue. Experience in importing and exporting data using Sqoop from HDFS/Hive/Pig to Relational Database Systems and vice-versa.

Skills : Management, Organizing.

Description :

    1. Developed, debugged & tested Data Services related various stories in Agile Environment.
    2. Extracted the data from weblogs into HDFS using Sqoop and data from relational Database tables using Flume.
    3. Worked on level 2 hadoop process with Informatica BDE for operative Created and worked on Sqoop jobs with incremental load to populate Hive External tables.
    4. Involved in creating Hive tables, loading with data and writing hive queries for logs.
    5. Created and Submitted spark python jobs thru Azkaban.
    6. Used Bitbucket for versioning for python scripts.
    7. Built trust and strong working relationships with Business and Technology stakeholders.
Years of Experience
Experience
10+ Years
Experience Level
Level
Senior
Education
Education
Bachelor's

Hadoop Consultant Resume

Headline : Over 8 +years of IT experience which includes 3+ years of experience with Hadoop, HDFS, MapReduce and Hadoop Ecosystem (Pig, Hive, HBase, Cassandra) Experience in administering Hadoop. Experience in Installation, Configuration, Testing, Backup, Recovery, Customizing and Maintenanceof clusters using Apache, Cloudera, AWS.

Skills : Frameworks Hadoop , Datameer Operating System RHEL.

Description :

  • Leads the planning and implementation of eDiscovery projects.
  • Develops and manages project plans, budgets, resource allocation, and project timelines.
  • Provides direction and support to project team.
  • Performs quality control on client project deliverables.
  • Monitors and reports on the progress of projects to all stakeholders.
  • Evaluates project results and identify changes that can be implemented for future work.
  • Accounts penetration and development for new and existing clients.
  • Serves as an expert on Servient’s proprietary offerings and machine-learning.
Years of Experience
Experience
5-7 Years
Experience Level
Level
Executive
Education
Education
Bachelors