Big Data ML Engineer

Spectraforce
Plano, TX, United States
17 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
4 years minimum
Working hours
Regular working hours

Tech stack

Java (Programming Language) Agile Methodology Amazon Web Services Microsoft Azure Big Data Cloud Computing Cloud Database Data Governance Data Systems Distributed Data Store Apache Hadoop Python (Programming Language)
+10 more
Key Management DataOps Scaled Agile Framework SQL Databases Workflow Management Systems Apache Spark Electronic Medical Records Low Latency Apache Kafka Data Pipelines

Job description

Job Description: Design, build, and operate large-scale batch and real-time data pipelines that move, transform, and publish data across the enterprise with high reliability and low latency

Collaborate with Agile teams to architect end-to-end data solutions - from ingestion and orchestration through to event streaming and downstream delivery

Requirements

4+ years of experience building or operating data pipeline and orchestration systems

4+ years of data or application engineering experience, including Java, Python and SQL

4+ years of experience building and operating real-time or event-driven data systems

4+ years of experience with distributed data and computing tools (Kafka, Spark, EMR, Hadoop, or equivalent)

4+ years of experience with cloud data warehousing platforms at scale

4+ years of experience with cloud platforms (AWS, Azure, or GCP)

3+ years of experience with pipeline scheduling and workflow orchestration tools

2+ years of experience with secure secrets management and credential handling in production systems

2+ years of experience working in Agile engineering environments

Familiarity with data observability practices - monitoring, alerting, SLA tracking, and data quality frameworks Experience in financial services or other regulated, compliance-driven industries

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on jobs.localjobnetwork.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

5:48 min

Balancing delivery latency with stream reliability and scale

Phil Cluff · LIVE

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

2:00 min

Separating dataset creation from low-level software implementation steps

Jan Zawadzki · WWC 2022

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

3:37 min

Accessing API documentation and testing remote driving latency

Alexandru Ciinaru Alexandru Ciinaru +3 · WWC 2025

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

Videos

See all

Related articles

See all