GCP Data Engineer-Remote

  • Free
  • Published date: January 27, 2023
    • Oregon, United States

Role: GCP Data Engineer
Location: Remote

Job Description:

 

The Role:

 

Looking for an experienced Data Engineer who can help move on-prem Hadoop
workloads to Google

Cloud (GCP).

 

Responsibilities:

? Export data from the Hadoop ecosystem to ORC or Parquet file

? Build scripts to move data from on-prem to GCP

? Build Python/PySpark pipelines

? Transform the data as per the outlined data model

? Proactively improve pipeline performance and efficiency

 

?Must Have? Experience:

? 4+ years of Data Engineering work experience

? 2+ years of building Python/PySpark pipelines

? 2+ years working with Hadoop/Hive

? 4+ years of experiencing with SQL

? Experience with Data Warehousing & Data Lake

? Understanding of Data Modeling

? Google experience ? Cloud Storage, Cloud Composer, Dataproc & BigQuery

? Understanding of data files format like ORC, Parquet, Avro

 

?Nice to Have? Experience:

? Understanding of GCP services

? Experience using Cloud Warehouses like BigQuery (preferred), Amazon
Redshift, Snowflake

? etc.

? Working knowledge of Distributed file systems like GCS, S3, HDFS etc.

? Understanding of Airflow / Cloud Composer

? CI/CD and DevOps experience

? ETL tools e.g., Informatica (IICS) Ab Initio, Infoworks, Pentaho, SSIS


Reference : GCP Data Engineer-Remote jobs

Useful information

  • Avoid scams by acting locally or paying with PayPal
  • Never pay with Western Union, Moneygram or other anonymous payment services
  • Don't buy or sell outside of your country. Don't accept cashier cheques from outside your country
  • This site is never involved in any transaction, and does not handle payments, shipping, guarantee transactions, provide escrow services, or offer "buyer protection" or "seller certification"


post to multiple job boards
Now take benefits of multiple job boards and search engine posting.
Try it.

Related listings

  • RF Field Service Technician

    Technology (Oregon) December 20, 2022 Free

    RESPONSIBILITIES Install, maintain and provide technical support and service of wireless communications equipment such as: UHF/VHF and 800/900 MHz analog and digital systems. Operating mobile, portable radio equipment, dispatch consoles, and microwav...

  • General Maintenance Mechanic

    Technology (Oregon) December 4, 2022 Free

    Location: Eugene, OR Categories: Facilities/Grounds/Skilled Trades Department: Facilities Services Classification: General Maintenance Mechanic Appointment Type and Duration: Regular, Ongoing Salary: $20.62 - $26.00 per hour Review of Applications Be...

  • Business Analyst

    Technology (Oregon) November 30, 2022 Free

    Location: Portland, OR (Initial Remote)   Job Description:   5+ years of experience in business systems analysis and/or design, 2+ of which must be in the logistics domain. ·         Use strategic thinking to make recommendations that may not be wide...