Data Engineer - Remote

  • Free
  • Published date: December 7, 2022
    • Victoria, Australia

eRole: Data Engineer

Location: Remote

Contract

 

NOTE- Must have experience with Spark pipelines implementation

 

Job Description :

 

Implementing Spark pipelines using Scala for it. 

·        Then, the candidate must have enough understanding and experience
working with Spark. 

·         How to create, deploy and execute spark applications to apply
complex transformations to the data.

·         At least it is required to be at a middle level. For example, how
to: create, join, filter, and transform Data Frames, efficiently.

 

About Scala, need to be focusing on Spark applications. 

·        Then the candidate should know enough to implement Spark pipelines.

·         An expert on Scala is not needed, but at least to have good
fundamentals. 

·        Understand the primary types of objects/structures like Case
Classes, Tuples, and Collections

·        How to interact with Collections to transform them (map, flat Map,
foreach, etc.), and 

How to deal with NULLS that are discouraged in Scala.


Reference : Data Engineer - Remote jobs

Useful information

  • Avoid scams by acting locally or paying with PayPal
  • Never pay with Western Union, Moneygram or other anonymous payment services
  • Don't buy or sell outside of your country. Don't accept cashier cheques from outside your country
  • This site is never involved in any transaction, and does not handle payments, shipping, guarantee transactions, provide escrow services, or offer "buyer protection" or "seller certification"


post to multiple job boards
Now take benefits of multiple job boards and search engine posting.
Try it.

Related listings

  • webMethods Developer

    Technology (Victoria) December 7, 2022 Free

    Position : webMethods Developer Duration : 12+ Months Job description Experience in software systems Development client/server, Business systems and web-based applications with at least 5 years of experience in WebMethods Candidate should be Strong i...

  • Senior Full-Stack Java Developer - Remote

    Technology (Victoria) November 9, 2022 Free

    Position: Full Stack Java Developer Location: 100% remote Communication Skills: Proficient English (written and verbal) Qualifications: MUST HAVES: - Front End: Angular or React - Back End: Java - Gherkin Syntax - Cucumber - BDD This Engineer will be...

  • DevOps Engineer

    Technology (Victoria) November 9, 2022 Free

    Role: DevOps Engineer (Kubernetes with Elastic Path experience) Duration : Long Term Contract  Initial remote and then onsite The main skill sets are Terraform, Linux, Ansible, Puppet, AWS, and Docker Responsibilities: Design and build identity manag...