Senior Data Engineer

Epsilon, Inc.
Chicago, IL, United States
2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Compensation
$88,900.0 - $165,100.0
Working hours
Regular working hours
Job source

Tech stack

Airflow Amazon Web Services Big Data Cloud Computing Cloud Database Information Engineering Extract Transform Load (ETL) Data Systems Data Warehousing Linux Distributed Systems Python (Programming Language)
+15 more
NoSQL Cloud Services SQL Databases Workflow Management Systems Data Processing Cloud Platform System System Availability Apache Spark Kubernetes Information Technology Apache Kafka Data Management Data Pipelines Docker Databricks

Job description

  • Troubleshooting: Identify and resolve production issues, optimize performance, and address bottlenecks in data processing.
  • Build Scalable Data Products: Design, build, and optimize cloud-native data pipelines using Databricks, Spark, SQL, and Python to support large-scale ingestion, transformation, and delivery of high-value data across the platform.
  • Own Platform Reliability and Scale: Advance our cloud data platform with AWS services and strong engineering field, improving scalability, observability, resilience, cost efficiency, and operational excellence.
  • Lead with Technical Depth: Apply deep expertise in Databricks, AWS, SQL, Python, Linux, and cloud integration patterns to solve complex engineering problems and influence architecture decisions.
  • Partner Across Functions: Collaborate with cloud architects, integration engineers, analysts, and product partners to deliver data solutions that are scalable, maintainable, and aligned to business outcomes.
  • Drive Continuous Improvement: Continuously improve on data engineering standards, developer productivity, automation, and platform capabilities by bringing forward modern tools, patterns, and guidelines. Influencing technical decisions and contributing to our evolving platform.
  • Communication : Clearly articulate technical concepts and solutions to internal teams and partners, fostering a collaborative environment.
  • Troubleshooting: Identify and resolve production issues, optimize performance, and address bottlenecks in data processing.

Requirements

Do you have experience in Spark?, Do you have a Bachelor’s degree?, * BA/BS in Computer Science or related field.

  • 6-8 years of experience in data engineering, cloud data platform engineering, or large-scale data systems.
  • Strong track record of delivering production-grade solutions using Databricks, AWS, SQL, Python, and modern ETL/ELT frameworks.
  • Proficiency in working with Databricks, Spark, SQL, and Python from previous professional positions.
  • Hands-on experience with AWS cloud services, Linux, workflow orchestration, and modern data pipeline development in cloud-native environments.
  • Deep understanding of distributed systems, cloud data architecture, data warehousing, and integration patterns.
  • Experience with Kafka, Airflow, Docker, Kubernetes, relational and NoSQL databases, and enterprise-scale data platforms is highly valued.
  • Strong communication, problem solving, and ownership approach, with the ability to work effectively across teams and contribute in a high-performance engineering environment

Why you might stand out from other talent:

  • Exposure to modern data tools and frameworks such as Kubernetes, Docker, and Airflow (a plus).
  • Familiarity with the internet/digital advertising ecosystem is a plus.

Benefits & conditions

3.43.4 out of 5 stars Chicago, IL 60601 Hybrid work $88,900 - $165,100 a year - Full-time, Pulled from the full job description

  • Tuition reimbursement
  • Parental leave
  • 401(k)
  • Health insurance
  • Paid sick time
  • Adoption assistance
  • Commuter assistance, As an Epsilon employee, you deserve perks and benefits that put you, your family and your finances first. Our benefits encompass a wide range of offerings, including but not limited to the following:
  • Time to Recharge: Flexible time off (FTO), 15 paid holidays
  • Time to Recover: Paid sick time
  • Family Well-Being: Parental/new child leave, childcare & elder care assistance, adoption assistance
  • Extra Perks: Comprehensive health coverage, 401(k), tuition assistance, commuter benefits, professional development, employee recognition, charitable donation matching, health coaching and counseling

Epsilon benefits are subject to eligibility requirements and other terms.

About the company

At Epsilon, we do more than collect and store data. We help some of the world’s biggest brands discover real opportunities inside the data types, delimiters and decimals.

We are looking for a Senior Data Engineer to help build the next generation of our cloud data platform. This role is ideal for an engineer who thrives on solving complex data challenges at scale and brings deep expertise in Databricks, AWS cloud services, and modern data integration. You will design and operate high-performance, cloud-native data pipelines and analytics systems that power mission-critical workloads across our Ad Stack and external data ecosystems.

If you are energized by distributed systems, platform thinking, automation, and building reliable data products in a fast-moving environment, this is an opportunity to make meaningful technical impact. Join a team where you’re empowered to unleash your full potential by working with the most cutting-edge concepts in Ad-Tech., Epsilon is a global data, technology and services company that powers the marketing and advertising ecosystem. For decades, we’ve provided marketers from the world’s leading brands the data, technology and services they need to engage consumers with 1 View, 1 Vision and 1 Voice. 1 View of their universe of potential buyers. 1 Vision for engaging each individual. And 1 Voice to harmonize engagement across paid, owned and earned channels.

Epsilon’s comprehensive portfolio of capabilities across our suite of digital media, messaging and loyalty solutions bridge the divide between marketing and advertising technology. We process 400+ billion consumer actions each day using advanced AI and hold many patents of proprietary technology, including real-time modeling languages and consumer privacy advancements. Thanks to the work of every employee, Epsilon has been consistently recognized as industry-leading by Forrester, Adweek and the MRC. Epsilon is a global company with more than 9,000 employees around the world.

Our pillars aren’t just words. They’re how we show up every day.

  • People centricity: We focus on employee well-being in an environment where colleagues truly care about each other.
  • Collaboration: We work together, support one another, and collectively achieve goals.
  • Growth: There are endless opportunities for growth through learning, development and career advancement.
  • Innovation: We drive progress through cutting-edge solutions and forward-thinking approaches.
  • Flexibility: We’ve created a balance between work and personal life, and we encourage adaptability to solve problems creatively.

Our values guide us to create value for our clients, our people and consumers.

  • Act with integrity
  • Work together to win together
  • Innovate with purpose
  • Respect all voices
  • Empower with accountability

These pillars and values are our foundation-shaping our culture, guiding our decisions, and uniting us in common purpose.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

52 sec

Running persistent Linux environments directly on Windows

Ben Breard Ben Breard · WWC 2025

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · WWC 2025

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:16 min

Terminology differences between relational and NoSQL databases

Tim Faulkes · LIVE

Videos

See all

Related articles

See all