Senior Hadoop Consultant Resume
Summary : Hadoop Consultant Over 8 years of overall experience as software developer in design, development, deploying and supporting large scale distributed systems. Over 3 years of extensive experience as HadoopDeveloper and BigDataAnalyst.
Skills : HDFS, MapReduce, YARN, Pig, Hive, Sqoop, HBase, Flume, Oozie, Zookeeper.
Description :
- Organizes and manages based primarily upon geographic location and the nature of the products and services it offers.
- Uses Sqoop to transfer data between RDBMS and HDFS.
- Involves in collecting and aggregating large amounts of streaming data into HDFS using Flume and defined channel selectors to multiplex data into different sinks.
- Implementes complex map reduce programs to perform map side joins using distributed cache.
- Designs and implementes custom writable, custom input formats, custom partitions and custom comparators in Mapreduce.
- Thoroughly testes MapReduce programs using MRUnit and Junit testing frameworks.
- Responsible for troubleshooting issues in the execution of Mapreduce jobs by inspecting and reviewing log files Converted existing SQL queries into Hive QL queries.
Experience
7-10 Years
Level
Senior
Education
Bachelors
Associate Hadoop Consultant Resume
Headline : Hadoop Consultant of extensive experience in Big Data Hadoop and its ecosystem. Experienced Hadoop/Java developer having end to end experience in developing applications in Hadoop ecosystem.
Skills : .Hadoop Map Reduce, Hive, Sqoop, Pig, HDFS, Hbase, Cassandra, ZooKeeper, Oozie, and Flume.
Description :
- Worked on a 100 nodes Hadoop cluster.
- Worked with unstructured and semi structured data of 1+ Petabytes in size.
- Involved in full life-cycle of the project from Design, Analysis, logical and physical architecture modeling, development, Implementation, testing.
- Extracted the data from Teradata into HDFS using Sqoop.
- Created and worked Sqoop (version 1.4.3) jobs with incremental load to populate Hive External tables.
- Developed MapReduce(YARN) jobs for cleaning, accessing and validating the data.
- Written multiple MapReduce programs in java for data extraction, transformation and aggregation from multiple file formats including XML, JSON, CSV and other compressed file formats.
Experience
5-7 Years
Level
Executive
Education
Bachelors
Junior Hadoop Consultant Resume
Objective : Hadoop Consultant of competitive intelligence and holistic, timely analysis of Big Data made possible by the successful installation, configuration, administration and maintenance of Hadoop ecosystem components and architecture.
Skills : Cloudera Manager, Apache Hadoop, Kerberos, Cluster Management, Performance Improvement, YARN, SQL, Agile, Unix Administration.
Description :
- Hands on experience with Apache Hadoop and CDH distributions.
- Installed and configured multiple Apache and CDH Hadoop clusters.
- Involved in hadoop cluster planning, finalizing the architecture, onboarding the projects to the cluster, cluster monitoring and maintenance.
- Assisted with data capacity planning and node forecasting.
- Translation of functional and technical requirements into detailed architecture and design.
- Responsible for Installation, monitoring, managing, troubleshooting, applying patches in different environments such as Development Cluster, Test Cluster and Production environments.
- Monitored and controlled local file system disk space usage, local log files, cleaning log files with automated scripts.
- Monitored cluster health status on daily basis, tuning system performance related configuration parameters.
Experience
2-5 Years
Level
Junior
Education
MBA
Hadoop Consultant I Resume
Objective : Highly qualified Hadoop Consultant with experience in the industry. Enjoy creative problem solving and getting exposure on multiple projects, and would excel in the collaborative environment on which company prides itself.
Skills : Management, Organizing.
Description :
- Used Sqoop to transfer data between RDBMS and HDFS.
- Involved in collecting and aggregating large amounts of streaming data into HDFS using Flume and defined channel selectors to multiplex data into different sinks.
- Implemented complex map reduce programs to perform map side joins using distributed cache Designed and implemented custom writable, custom input formats, custom partitions and custom comparators in Mapreduce.
- Thoroughly tested MapReduce programs using MRUnit and Junit testing frameworks.
- Responsible for troubleshooting issues in the execution of Mapreduce jobs by inspecting and reviewing log files Converted existing SQL queries into Hive QL queries.
- Implemented UDFs, UDAFs, UDTFs in java for hive to process the data that can't be performed usingHive inbuilt functions Effectively used Oozie to develop automatic workflows of Sqoop, Mapreduce and Hive jobs.
- Exported the analyzed data into relational databases using Sqoop for visualization and to generate reports for the BI team.
Experience
2-5 Years
Level
Junior
Education
Masters
Hadoop Consultant II Resume
Headline : Around 8 years of IT experience in Hadoop, Data Warehousing, Linux and JAVA. Over 2 years of experience in providing solutions for Big data using Hadoop 2.x, HDFS, MR2, YARN, Kafka, PIG, Hive, Tez, Sqoop, HBase, Zoo keeper, Oozie,UC4, Hue, CDH5 & HDP 2.x. Expertise in doing Sprint planning, story pointing, daily scrum, Sprint retrospective and Sprint reviews.
Skills : Management, Organizing.
Description :
- Performs payment processing for online vendors, auction sites and other commercial users.
- Partnesr detection service Will automatically crawl through the merchant's sites using eBay crawler and does the partner search based on the rules engine with a degree of integrated confidence levels.
- Co-ordinates between multiple cluster teams for business queries and migration.
- Evaluates of the Hadoop platform and its ecosystem tools for the batch process.
- Responsible for building scalable distributed data solutions using Hadoop.
- Handles importing of data from various data sources, performed transformations using hive, map reduce, and loaded data into hdfs.
- Uses agile methodology in developing the application, which included iterative application development, weekly status report and stand up meetings.
Experience
5-7 Years
Level
Executive
Education
Bachelors
Hadoop Consultant III Resume
Summary : Hadoop Consultant works in key projects for leading organizations in data mining & knowledge Discovery, predictive modeling, trend modeling, Simulation models (Monte Carlo), Review of credit rating and scoring models and quant support to the business and R&D projects.
Skills : Management, Organizing.
Description :
- Worked on a live Big Data Hadoop production environment with 200 nodes.
- Worked in implementing Hadoop with the AWS EC2 system using a few instances in gathering and analyzing data log files.
- Developed Use cases and Technical prototyping for implementing PIG, HDP, HIVE and HBASE.
- Analyzed the alternatives for NOSQL Data stores and intensive documentation for HBASE vs.Accumulo data stores.
- Communicated with developers using in-depth knowledge of Cassandra Data Modeling for converting some of the applications to use Cassandra instead of Oracle.
- Responsible for design and development of Big Data applications using Hortonworks Hadoop.
- Worked on data using Sqoop from HDFS to Relational Database Systems and vice-versa.
- Maintained and troubleshoot Hadoop core and ecosystem components (HDFS, Map/Reduce, Name node, Data node, Job tracker, Task tracker, Zookeeper, YARN, Oozie, Hive, Hue, Flume, HBase, and Fair Scheduler).
Experience
7-10 Years
Level
Management
Education
Bachelors
Asst. Hadoop Consultant Resume
Objective : Hadoop Developer with 8 years of experience, which includes 4+ experience in the Big Data ecosystem, related technologies Adept at problem-solving, ensuring that an appropriate level of application quality is maintained. An experienced Big Data-Hadoop Programmer with varying level of expertise around different Hadoop projects like HBase, Storm, Hive, Flume, Pig.
Skills : Coding, Management.
Description :
- Generated and stored in the same database where legacy data reside, this made the process, capture and querying difficult.
- Big Data Hadoop solution solved this problem.
- Imported reporting and work data tables to HDFS cluster through Sqoop.
- Coded Pig and Hive scripts and ran as per demand in batch mode for reporting.
- Worked on analyzing, writing Hadoop Mapreduce jobs using JavaAPI, Pig and Hive.
- Responsible for building scalable distributed data solutions using Hadoop.
- Involved in loading data from edge node to HDFS.
- Created HBase tables to store variable data formats of data coming from different portfolios.
Experience
2-5 Years
Level
Junior
Education
Masters
Associate Hadoop Consultant Resume
Summary : Over all IT experience 8+ years. 3+ years' experience on Hadoop ecosystem. Maintained Hadoop clusters forDevelopment/Quality/Production. Experience in monitoringand managing 100+ node Hadoop cluster. Experience in deploying Hadoop cluster on Public and Private Cloud Environment like Amazon AWS, Rack Space.
Skills : Monitoring, Management, Organizing.
Description :
- Helped the team to increase cluster size from 35 nodes to 113 nodes.
- Installed, configured and deployed a 60 node ClouderaHadoop cluster for development, production.
- Worked on setting up high availability for major production cluster and designed automatic failover.
- Performed both major and minor upgrades to the existing CDH cluster.
- Performed tune Hadoop cluster to achieve higher performance.
- Configured Hive metastore with MySQL, which stores the metadata of Hive tables.
- Configured Flume for efficiently collecting, aggregating and moving large amounts of log data.
Experience
7-10 Years
Level
Executive
Education
Bachelors
Lead Hadoop Consultant Resume
Summary : 10 years of IT experience in Analysis, Design, Development of e-commerce, intranet web applications, Software Applications. Experience in providing solutions for Big Data using Hadoop, HDFS, , PIG, Hive, Sqoop, Cloudera Manager, Zoo keeper, Azkaban, Hue. Experience in importing and exporting data using Sqoop from HDFS/Hive/Pig to Relational Database Systems and vice-versa.
Skills : Management, Organizing.
Description :
- Developed, debugged & tested Data Services related various stories in Agile Environment.
- Extracted the data from weblogs into HDFS using Sqoop and data from relational Database tables using Flume.
- Worked on level 2 hadoop process with Informatica BDE for operative Created and worked on Sqoop jobs with incremental load to populate Hive External tables.
- Involved in creating Hive tables, loading with data and writing hive queries for logs.
- Created and Submitted spark python jobs thru Azkaban.
- Used Bitbucket for versioning for python scripts.
- Built trust and strong working relationships with Business and Technology stakeholders.
Experience
10+ Years
Level
Senior
Education
Bachelor's
Hadoop Consultant Resume
Headline : Over 8 +years of IT experience which includes 3+ years of experience with Hadoop, HDFS, MapReduce and Hadoop Ecosystem (Pig, Hive, HBase, Cassandra) Experience in administering Hadoop. Experience in Installation, Configuration, Testing, Backup, Recovery, Customizing and Maintenanceof clusters using Apache, Cloudera, AWS.
Skills : Frameworks Hadoop , Datameer Operating System RHEL.
Description :
- Leads the planning and implementation of eDiscovery projects.
- Develops and manages project plans, budgets, resource allocation, and project timelines.
- Provides direction and support to project team.
- Performs quality control on client project deliverables.
- Monitors and reports on the progress of projects to all stakeholders.
- Evaluates project results and identify changes that can be implemented for future work.
- Accounts penetration and development for new and existing clients.
- Serves as an expert on Servient’s proprietary offerings and machine-learning.
Experience
5-7 Years
Level
Executive
Education
Bachelors
