Hadoop Developer

  • Free
  • Published date: June 13, 2018
    • Illinois, United States


Location : Lisle, IL

o Need a strong Scala/PySpark programmer. Python experience also.

o Expert SQL background

o 8+ years of experience in data analysis, data modeling and implementation of enterprise class systems spanning Big Data, Data Integration, Object Oriented programming and Advanced Analytics

o Excellent understanding of Hadoop architecture and different demons of Hadoop clusters which include Job Tracker, Task Tracker, Name Node and Data Node

o Good understanding of Data Mining and techniques

o Experience in importing and exporting data from RDBMS to HDFS, Hive tables and HBase by using Sqoop

o Experience in importing streaming data into HDFS using flume sources, and flume sinks and transforming the data using flume interceptors

o Exposure on usage of Apache Kafka develop data pipeline of logs as a stream of messages using producers and consumers

o Knowledge of Hbase and Json.

o Knowledge of TFS and GIT.

o Proficient in using various IDEs like Eclipse, JDeveloper and IntelliJ

o Working knowledge of Maven and SBT for project build/test/deployment Log4j for error logging and Debugging, JUnit for unit and integration testing and XMLSpy for XML validation

o Experience in Software Development Life Cycle (SDLC), OOA, OOD and OOP through implementation and testing.

o Experienced with different scripting languages like Python and shell scripts

o Comfortability with the Linux operating system.

o Map Reduce Experiencing writing Map Reduce code would be great. Spark is replacing this but it's still at the foundation of all data manipulation inside Hadoop.

o HDFS Fundamental understanding of how HDFS works is a minimum.

o Flume Experience in using Flume in different use cases would be nice.

o Parquet and AVRO file experience.

o Yarn Basic understanding of how Yarn works and how to use it.

● Education requirement: At least a 4 year Technology Degree

● Years of Experience: 8+

● Required/Preferred Certifications: None at this time
Reference : Hadoop Developer jobs

Useful information

  • Avoid scams by acting locally or paying with PayPal
  • Never pay with Western Union, Moneygram or other anonymous payment services
  • Don't buy or sell outside of your country. Don't accept cashier cheques from outside your country
  • This site is never involved in any transaction, and does not handle payments, shipping, guarantee transactions, provide escrow services, or offer "buyer protection" or "seller certification"

Leave your comment (spam and offensive messages will be removed)

Related listings

  • Senior SAP EWM

    Senior SAP EWM

    Technology (Illinois) May 30, 2018 Free

    NEED::Senior SAP EWM Consultant Duration : 6 months. Location : Bloomington, IL Job Description :     1.Inbound Processes (Goods Receipt, Inspection/Counting, Directed Put Away) 2.Internal Processes (Radio Frequency Transactions, Inventory/Cycle Coun...

  • Sales Position

    Sales Position

    Technology (Illinois) May 29, 2018 Free

    City : Chicago Welcome to one of the Highest Paying and Most Rewarding Industries in both the United States. We put people just like you, in a position to potentially earn extraordinary income right from your home or office. If you are tired of all t...

  • Systems Engineer

    Systems Engineer

    Technology (Illinois) May 29, 2018 Free

    Job Title: Systems Engineer Location: US-IL- Goodfield Contract or Fulltime Overview: Responsibilities Develop systems for use in Agricultural Equipment and Off-Highway Equipment Create requirements for systems and software based on customer specific...