Data Infrastructure Engineers

Bayside Solutions

United States

10 days ago

Apply on www.dice.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Compensation

$114,400.0 - $135,200.0

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Amazon Web Services Cloud Database Computer Programming Data Infrastructure Data Integrity Data Structures Relational Databases Software Debugging Distributed Data Store Distributed Systems PostgreSQL Standard Sql

+6 more

Software Engineering Apache Yarn System Availability Apache Spark Kubernetes Api Design

Job description

We are looking for highly skilled Data Infrastructure Engineers with strong expertise in distributed systems, API development, and software engineering., * Develop and maintain a batch orchestration platform that runs 100,000+ jobs per day

Develop migration tooling to facilitate the transfer of job configurations to a new data platform
Write efficient, high-performance code in Scala
Design and implement distributed data systems for high availability, reliability, and performance.
Collaborate with stakeholders and other software engineers to build robust platform features.
Ensure data integrity, governance, and security within the infrastructure.

Requirements

Strong programming skills in Scala
Deep understanding of data structures, algorithms, and distributed computing principles.
Experienced in API development
General SQL knowledge
Experience deploying production applications to Kubernetes
Experience with relational databases (such as PostgreSQL)., * In-depth experience with Kubernetes.
Proficiency in Scala.
Strong problem-solving skills with the ability to debug and optimize large-scale distributed systems
Experience with cloud-based data solutions (AWS). Familiarity with Yarn and Spark jobs