Big Data Operations Engineer
- Free
- Published date: November 30, 2022
-
- Texas, United States
Position: Big Data Operations Engineer
Location: Dallas, TX (Day 1Onsite)
Type: Contract
Job Description:
Job Responsibilities
? Experience in setting up production Hadoop clusters with optimum
configurations.
? Drive automation of Hadoop deployments, cluster expansion and
maintenance operations.
? Manage Hadoop cluster, monitoring alerts and notification.
? Job scheduling, monitoring, debugging and troubleshooting.
? Monitoring and management of the cluster in all respects, notably
availability, performance and security.
? Data transfer between Hadoop and other data stores (incl. relational
database).
? Set up High Availability/Disaster Recovery environment.
? Debug/Troubleshoot environment failures/downtime.
? Performance tuning of Hadoop clusters and Hadoop Map Reduce routines.
Skills - Experience and Requirements
? Experience with Kafka, SPARK etc.
? Experience working with AWS big data technologies (EMR, Redshift,
S3, Glue, Kinesis, Dynamodb, and Lambda)
? Good knowledge on creation of Volumes, Security group rules, Key
pairs, Floating IPs, Images and Snapshots and Deploying Instances on AWS.
? Experience configuring and/or integrating with monitoring and
logging solutions such as syslog, ELK (Elastic, Logstash, and Kibana).
? Strong UNIX/Linux systems administration skills, including
configuration, troubleshooting and automation
? Knowledge of Airflow, NiFi, Streamsets, etc.
? Knowledge of container virtualization
Reference : Big Data Operations Engineer jobs
Useful information
- Avoid scams by acting locally or paying with PayPal
- Never pay with Western Union, Moneygram or other anonymous payment services
- Don't buy or sell outside of your country. Don't accept cashier cheques from outside your country
- This site is never involved in any transaction, and does not handle payments, shipping, guarantee transactions, provide escrow services, or offer "buyer protection" or "seller certification"
Related listings
-
Senior Abinitio Developer
Technology (Texas) November 30, 2022 FreeJob Title:- Senior Abinitio Developer Location:- Plano, TX (Initial Remote) Job Description:- · Relevant consulting or industry experience delivering large scale ETL projects using Ab Initio Continuous Flows, MDH, BRE and CO>Ops · T...
-
Housekeeper
Technology (Texas) November 28, 2022 FreeFull or part-time experienced cleaning person needed for residential and small commercial jobs in the Sherman, TX and surrounding areas. This is a positive work environment with no drama included. We provide paid certification to teach you how the PR...
-
Housekeeper
Technology (Texas) November 28, 2022 FreeFull or part-time experienced cleaning person needed for residential and small commercial jobs in the Sherman, TX and surrounding areas. This is a positive work environment with no drama included. We provide paid certification to teach you how the PR...