Data Engineer - Infrastructure

IMC Financial Markets

Chicago, IL, United States

about 1 month ago

Apply on www.indeed.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

5 years minimum

Compensation

$175,000.0 - $225,000.0

Working hours

Regular working hours

Job source

www.indeed.com

Tech stack

Java (Programming Language) Application Programming Interfaces (APIs) Amazon S3 Systems Engineering Big Data Configuration Management Data Systems Software Debugging Linux Apache Hadoop Open Source Technology Performance Tuning

+10 more

Ansible Prometheus Data Storage Technologies Apache Yarn Kubernetes Infrastructure Automation Frameworks Bare Metal Apache Kafka Data Management Puppet

Job description

We are hiring an Engineer to join our Data Engineering Infrastructure team, where you will help build and scale the storage and data platforms that power our HFT business. This is a hands-on role for someone who enjoys working close to the bare metal systems. Operating large-scale open-source storage, enterprise storage, tuning Linux systems for performance, automating infrastructure. As our data footprint grows, you will play a key part in keeping our infrastructure fast, reliable, and ready to scale.

Core Responsibilities:

Design, deploy, and operate large-scale data storage infrastructure, including Hadoop, enterprise storage and S3-compatible platforms
Tune Linux systems for I/O throughput and overall performance
Automate configuration and deployment using Ansible, Puppet or other automation platform
Build observability into the platform with Prometheus and related tooling
Partner with engineering teams to deliver reliable, well-architected data solutions with a focus on Storage and Kafka
Familiarity with Kubernetes

Requirements

5+ years of experience in systems engineering with a strong focus on data storage
Strong Linux fundamentals, debugging skills, including performance tuning for I/O throughput
Hands-on experience with Ansible and Puppet for configuration management and automation
Familiarity with open-source, S3 API compliant, and enterprise storage technologies
Working knowledge of the Hadoop ecosystem, including YARN
Experience in Java and Python
Comfort working with AI-assisted development tools such as Claude (e.g., “vibecoding”) in an enterprise setting
Experience with Prometheus-based monitoring and alerting

Benefits & conditions

The Base Salary range for the role is included below. Base salary is only one component of total compensation; all full-time, permanent positions are eligible for a discretionary bonus and benefits, including paid leave and insurance. Please visit Benefits - US

IMC Trading for more comprehensive information.

About the company

IMC is a global trading firm powered by a cutting-edge research environment and a world-class technology backbone. Since 1989, we’ve been a stabilizing force in financial markets, providing essential liquidity upon which market participants depend. Across our offices in the US, Europe, Asia Pacific, and India, our talented quant researchers, engineers, traders, and business operations professionals are united by our uniquely collaborative, high-performance culture, and our commitment to giving back. From entering dynamic new markets to embracing disruptive technologies, and from developing an innovative research environment to diversifying our trading strategies, we dare to continuously innovate and collaborate to succeed.