Big Data Engineer Resume
Objective : Big Data Architect/Engineer with extensive experience in all phases of software development life cycle. Passionate about Big Data technologies and the delivery of effective solutions through creative problem solving. Track record of building large-scale systems using Big Data technologies.
Skills : Scala, Spark, C++, Java, Python, PHP, HTML, JavaScript, MySQL,Hadoop.
Description :
- Lead architect responsible for Endgame's Big Data Platform.
- Technologies include Hadoop, Hive, Pig, Storm, Kafka, and Spark.
- Platforms include Hortonworks, Cloudera, Mongo, MariaDB, Postgres and OrientDB.
- Developed Java Map Reduce and pyspark jobs for analytics use cases.
- Developed MariaDB database schemas for malware metadata repository.
- Developed real-time anomaly detection library using Storm.
- Wrote a python library for preprocessing json for ingest into ElasticSearch to support search and analytics use cases.
- Wrote custom Flume serializer and blob handler in Java.
- Wrote pyspark Streaming client that emits RDDs from a Kafka topic with defined start and end offsets.
Experience
2-5 Years
Level
Junior
Education
Computer Science
Sr. Big Data Engineer Resume
Summary : Solid knowledge of OS, Computer Networks, Database, Algorithms & Data structures. Hands-on big data management and analysis experience in related tools Ability to work under pressure and able to work in a fast-paced environment efficiently.
Skills : Python, C, C++, JAVA, MATLAB, R Programming, Ruby, SAP ABAP, Javascript, JQuery.
Description :
- Provide customer satisfaction and improve sales opportunities by integrating the data.
- Involved in building a multi-node Hadoop Cluster Installed and configured Cloudera Manager Managed and analyzed Hadoop Log Files.
- Configured Hive Metastore to use the Oracle database to establish multiple user connections to hive tables.
- Imported data into HDFS using Sqoop.
- Experience in retrieving data from databases like MYSQL and Oracle into HDFS using Sqoop and ingesting them into HBase.
- Developed Hive queries to analyze the data in HDFS to identify issues and behavioral patterns.
- Used PigLatin to analyze datasets and perform transformation according to business requirements.
Experience
7-10 Years
Level
Management
Education
Masters Of Science
Jr. Big Data Engineer Resume
Objective : Over 8+ years of Professional experience in IT Industry, involved in Developing, Implementing, configuring, testing Hadoop ecosystemcomponents and maintenance of various web based applications using Java, J2EE.
Skills : Spark, Hadoop, Machine Learning.
Description :
- Enhances the customer information using data from public domains.
- Installed and configured Hadoop MapReduce, MapR-FS, Developed multiple MapReduce jobs in java and python for data cleaning and preprocessing.
- Participated in Development and Implementation of MapR environment.
- Implemented and running Hadoop jobs to process terabytes of data.
- Loaded and transformed large sets of structured, and semi structured data.
- Responsible to manage data coming from different sources.
- Experienced in querying data from various servers into MapR-FS.
- Importing and exporting data into MapR-FS and Hive using Sqoop.
Experience
2-5 Years
Level
Junior
Education
IT
Big Data Engineer III Resume
Summary : Over Seven years of extensive experience as a Hadoop developer, Master-slave architecture designer and as a java developer. Experienced in processing large datasets of different forms including structured, semi-structured and unstructured data. Hands on experience with Cloudera and multi cluster nodes on Hortonworks Sandbox.
Skills : Java, Apache Oozie, Apache Sqoop, HDFS, Apache Hive,.
Description :
- Analyze and develop reports for the customers discontinuing banks based on banking trends.
- Developing the solution report to the company for improvement in banking service.
- Transferred data from a Data Source using Sqoop to HDFS to perform analysis.
- Used Scala for spark streaming and also SPARK for ongoing transactions of customers.
- Developed Scala applications using the Spring tool suits environment.
- Used Shell scripting to analyze the data from the ERP source and processed it to store it into HDFS.
- Stored data from HDFS to respective Hive tables for further analysis in order to identify the Trends in data.
Experience
7-10 Years
Level
Management
Education
Engineering
Big Data Engineer II Resume
Headline : Overall 4 years of experience in Architect, Analysis, Design, Development, Testing, Implementation, Maintenance and Enhancements on various IT Projects. Around 2+ years of experience in Big Data in implementing end-to-end Hadoop solutions.
Skills : MapReduce, Hue, Scala, Solr, Git, Maven and CHEF.
Description :
- Installed and configured Hadoop MapReduce, HDFS developed multiple MapReduce jobs in Java for data cleaning and pre-processing.
- Developed simple to complex Map Reduce job using Hive.
- Used Sqoop extensively to import data from RDMS sources into HDFS.
- Performed transformations, cleaning and filtering on imported data using Hive, Map Reduce, and loaded final data into HDFS Developed Pig UDFs to pre-process data for analysis.
- Implemented test cases for Spark and Ignite functions using Scala as language.
- Created reports for the BI team using Sqoop to export data into HDFS and Hive.
- Migration of ETL processes from Oracle to Hive to test the easy data manipulation using Talend.
Experience
5-7 Years
Level
Executive
Education
Computer Science
Big Data Engineer I Resume
Summary : Seeking a challenging position in Software development industry that needs innovation, creativity and dedication and enable me to continue to work in a demanding and fast paced environment, leveraging current knowledge and fostering creativity with many learning opportunities.
Skills : Data Engineer, Data Manager.
Description :
- Gained an international reputation for their dedication to engaged learning.
- Creativity into the development of research and service-learning projects that match the course curriculum with the world's most pressing issues.
- Address community needs, and fulfill students' desires to contribute to the common good.
- Worked on developing and configuring the database using the Hive Warehousing program.
- Performing various types of queries on selected tables and data from different fields.
- Developed reports related to financial, hospital environments.
- Developed website using Joomla for coordinating the functionality of big data on the Internet as well.
- Provided expert consulting services, solutions and training around Big Data ecosystem (Hadoop, NoSQL, Cloud).
Experience
7-10 Years
Level
Management
Education
Information Systems
Big Data Engineer/Developer Resume
Summary : Experienced in processing large datasets of different forms including structured, semi-structured and unstructured data. Familiar with data architecture including data ingestion pipeline design, Hadoop information architecture, data modeling and data mining, machine learning and advanced data processing.
Skills : Data Developer, Data Technician.
Description :
- Analyze and develop reports for the customers discontinuing banks based on banking trends.
- Developing the solution report to the company for improvement in banking service.
- Transferred data from a Data Source using Sqoop to HDFS to perform analysis.
- Used Scala for spark streaming and SPARK for ongoing transactions of customers.
- Developed Scala applications using the Spring tool suits environment.
- Used Shell scripting to analyze the data from the ERP source and processed it to store it into HDFS.
- Stored data from HDFS to respective Hive tables for further analysis to identify the Trends in data.
- Data from the data sources are pushed into spark using Flume.
Experience
7-10 Years
Level
Management
Education
Bachelors Of Science
Big Data Engineer/Specialist Resume
Summary : Experience building wicked fast, scalable systems for ingesting, storing, and managing large amounts of data. Strong organizational skills, and an ability to learn quickly are a must.
Skills : Database skills and tools.
Description :
- Assists in providing guidance to small groups of two to three engineers, including offshore associates, for assigned Engineering projects.
- Demonstrates up-to-date expertise and applies this to the development, execution, and improvement of action plans.
- Manages small to large-sized complex projects.
- Models compliance with company policies and procedures and supports company mission, values, and standards of ethics and integrity.
- Participates in the discovery phase of small to medium-sized projects to come up with high-level design.
- Provides and supports the implementation of business solutions.
- Provides support to the business.
Experience
7-10 Years
Level
Management
Education
Engineering
Big Data Engineer/Developer Resume
Summary : Analyzing large data sets to develop custom models and algorithms to drive business solutions. Data Scientists work on project teams in order to provide analytical support to projects (for example, email targeting, business optimization, consumer recommendations) for Walmart eCommerce.
Skills : Big Data Developer, Data Engineer, Data Analyst.
Description :
- Build and maintain batch and real-time ETL pipelines in a Google Cloud Platform architecture (BigQuery, Dataproc, Firestore, etc.)
- Identify code quality issues and implement tests to improve future notifications.
- Implement data integrity tests to ensure we are ingesting accurate data.
- Translate business requirements into actionable data tasks.
- Partner with business users to understand their needs, come up with an end to end solutions, and communicate the results back to the users.
- Implement high-quality test-driven code.
Built big data solutions using hbase handling millions of records for the different trends of data and exporting it to hive.
Experience
7-10 Years
Level
Management
Education
Engineering
Big Data Engineer Resume
Headline : Overall 12 years of experience as Big Data Engineer, ETL System Engineer and SQL Server DBA. Hadoop Developer for IT Data Science Team and Big Data Engineer. Business Intelligence Systems Engineer and Database Administration.
Skills : Data Scientist, Data Specialist.
Description :
- Transform the raw data into meaningful information to support business decisions.
- Develop, Deploy and Troubleshoot the ETL Work Flows using Hive, Pig, Sqoop and Spark.
- Develop Map Reduce jobs for Data Cleanup in Python, Java, and C#.
- Dimensions and Facts Design and Data Modeling for reporting purposes.
- Design and Implement DataMart and improve performance.
- Identify the Reports for decision making and create the Dash Boards by using the power.
- Tested and solved the critical issues faced while data ingestion into the data unit.
Experience
5-7 Years
Level
Executive
Education
Master Of Business
