Data Engineer

IMC Inc
Chicago, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate
Compensation
$ 225K

Job location

Chicago, United States of America

Tech stack

Java
Amazon Web Services (AWS)
Bash
Big Data
Unix
Information Engineering
Data Integrity
Database Development
Hadoop
Hadoop Distributed File System
Monitoring of Systems
Python
Data Ingestion
Spark
Software Application Programming
Kubernetes
Apache Flink
Kafka
Data Management
Data Pipelines
Docker
Pagerduty
Databricks

Job description

  • Architect, develop and deploy our Big Data environment (Kafka, Hadoop, Dremio, etc.)
  • Build, deploy, and monitor our data processing pipelines (Java, Python, Spark, Flink)
  • Collaborate with development teams on data modeling, data ingestion, and capacity planning
  • Work with users to ensure data integrity and availability
  • Act as a Big Data SME and consult on a variety of data-related questions from users and developers

Requirements

  • 5+ years experience working in a mature data engineering environment
  • 3+ years of experience building Kafka streaming applications and/or maintaining Kafka clusters
  • 2+ years of experience building applications/pipelines with Big Data backends (S3, HDFS, Databricks, Iceberg, etc)
  • Experience with Apache Spark, Apache Flink or similar tools
  • Strong Java, Python, and SQL development skills
  • Experience with common data-science toolkits, especially python-based
  • Hands-on experience with Kubernetes and Docker
  • Experience with monitoring tools such as PrometheGrafana, Alert Manager, Alerta and OpsGenie
  • Strong statistical analysis skills
  • Demonstrated ability to troubleshoot and conduct root-cause analysis
  • Unix scripting experience (bash, python, etc.)

Benefits & conditions

The Base Salary range for the role is included below. Base salary is only one component of total compensation; all full-time, permanent positions are eligible for a discretionary bonus and benefits, including paid leave and insurance. Please visit Benefits - US | IMC Trading for more comprehensive information.

Salary Range

$175,000-$225,000 USD

About the company

We are seeking a dedicated and experienced Data Engineer to join our Chicago team. The ideal candidate is energized by working in a cutting-edge environment that enables IMC to continue to be at the forefront of the evolving global financial markets., IMC is a global trading firm powered by a cutting-edge research environment and a world-class technology backbone. Since 1989, we've been a stabilizing force in financial markets, providing essential liquidity upon which market participants depend. Across our offices in the US, Europe, Asia Pacific, and India, our talented quant researchers, engineers, traders, and business operations professionals are united by our uniquely collaborative, high-performance culture, and our commitment to giving back. From entering dynamic new markets to embracing disruptive technologies, and from developing an innovative research environment to diversifying our trading strategies, we dare to continuously innovate and collaborate to succeed.

Apply for this position