Data Engineer

  • Free
  • Published date: May 2, 2020
    • California, United States

Role: Data Engineer

Location: Emeryville, CA

Type: Contract

 

Job Description:

  

·       Build and optimize performance of Scala-Spark batch jobs using AWS EMR

·       Build and optimize performance of Kafka, NIFI and other components of
real-time pipelines

·       Participate and contribute to the design, architecture and
development of high quality data-lake data models

·       Build data pipeline orchestration

·       Ensuring code quality and conformance of code to applicable rules,
norms and relevant best

·       practices

·       Coaching, mentoring and developing new hires and less experienced
developers to work on Big Data projects

 

Skills

·       Strong understanding of distributed systems and distributed
computation.

·       Strong working knowledge in Scala and Spark, Kafka

·       Good knowledge in AWS services like S3, EMR, Glue, SageMaker, Lambda,
ECS, DMW and Athena.

·       Demonstrated working knowledge in Spark, Kafka, NiFi, 

·       Demonstrated working knowledge of data modeling

·       Experience in designing and running Unit and Integration testing

·       Hands-on exposure to data store technologies like MongoDB, DynamoDB,
Postgres and Redshift.

·       Knowledge of TDD & BDD methodologies, tools and practices

 


Reference : Data Engineer jobs

Useful information

  • Avoid scams by acting locally or paying with PayPal
  • Never pay with Western Union, Moneygram or other anonymous payment services
  • Don't buy or sell outside of your country. Don't accept cashier cheques from outside your country
  • This site is never involved in any transaction, and does not handle payments, shipping, guarantee transactions, provide escrow services, or offer "buyer protection" or "seller certification"


post to multiple job boards
Now take benefits of multiple job boards and search engine posting.
Try it.

Related listings

  • HAIR STYLISTS NEEDED

    Technology (Georgia) October 23, 2021 Free

    HAIR STYLISTS NEEDED We are looking for Stylists and/or Barbers for our salon: Marietta, GA location!! We are a family business. Do you love working with children? YES!!! Do you love cutting and styling hair? YES!!! Do you have high energy level? YES...

  • Staff Nurse

    Technology (Massachusetts) October 23, 2021 Free

    The Staff Nurse – RN duties include but are not limited to: triage; access and case management of patients and nursing support of clinical sessions in our ambulatory setting. Position is Full Time at the Daniel Driscoll-Neponset Health Center, hours ...

  • Part-Time Faculty, Clinical Nursing

    Technology (Florida) October 23, 2021 Free

    Join our Team! Valencia College is seeking Florida Licensed Registered Nurses or Advanced Registered Nurse Practitioners to join our dedicated, passionate faculty team for the upcoming spring term as Part-Time Faculty, Clinical Nurses. You will be re...