Big Data Systems Engineer - Cloud (DevOps)

GET HIRED RECRUITING LLC
San Francisco, CA, United States
14 days ago
Apply on www.thejobnetwork.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours

Tech stack

Amazon Web Services Systems Engineering Bash Shell Big Data Cloud Computing Continuous Integration DevOps Distributed Systems Apache Hadoop Apache HBase Python (Programming Language) Ansible
+8 more
Apache Spark Electronic Medical Records Git Kubernetes Apache Kafka Terraform Amazon Elastic Mapreduce (EMR) Jenkins

Job description

The successful candidate will be designing, implementing, and operating AWS solutions primarily using EKS and EMR. Strimzi is a Kubernetes Operator so infrastructure as code is something you are familiar with.

We manage our infrastructure with Git as the source of truth. It is home to Terraform and Ansible we use to do all the heavy lifting. You got Python and Bash in your back pocket and can’t wait to use it! We have proper immutable infrastructure using CICD declarative pipelines with Jenkins.

Requirements

The ideal candidate will have at least three years experience with Hadoop, Hbase, and Kafka. Sprinkle in some Spark, and you’re a great candidate! We have CDH and are migrating to AWS EMR with Kafka (Strimzi) and Spark on Kubernetes.

You will primarily focus on EMR, Kafka, and Spark. But, you are either certifiable in both AWS and Kubernetes or can’t wait to be. We use Terraform and Ansible in depth and you are ready to triage, diagnose, and remediate production failures at scale. Monitoring and documentation are in the definition of done and you are well written., You love the pressure that comes with high stakes maintaining the integrity of complex system’s data. We have a complex cloud-native distributed system that requires experience and discipline. You are very collaborative, reliable, and deliver to clever people.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.thejobnetwork.com
Prepare application

Good distractions

Loading talks and stories from around this role…