Senior, Data Engineer

Epsilon, Inc.
Chicago, IL, United States
6 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Compensation
$145,870.0 - $182,000.0
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Amazon Web Services Amazon S3 Audit Trail Unit Testing Big Data Continuous Integration Extract Transform Load (ETL) Amazon DynamoDB Greenplum Identity and Access Management Python (Programming Language)
+14 more
PostgreSQL SQL Databases Delivery Pipeline Large Language Models Mttr Cloudformation Pyspark Integration Tests Information Technology Deployment Automation AWS Glue Cloudwatch Data Pipelines Amazon Elastic Mapreduce (EMR)

Job description

Duties: Develop and execute software tests to identify software problems and their causes. Write and optimize complex SQL Scripts and build Python scripts to execute large-scale transformations on Greenplum. Create test plans, run rigorous unit/integration tests, and deliver reproducible, well-documented results. Design and maintain AI-enabled, PySpark data pipelines on AWS primarily EMR, Glue, Athena, DynamoDB, and S3 to process large datasets at scale. Harden and tune jobs for performance, cost, and compliance, and manage data partitioning, cataloging, and lineage. Automate deployments and infrastructure with CloudFormation and parameterized configurations, and schedule batch workloads to keep pipelines timely and reliable. Build internal dashboards and data products (e.g., Amplify apps) and instrument monitoring/alerting to catch issues early. client tickets, translating ambiguous requests into clear technical tasks., * Build PySpark ETL on AWS EMR/Glue reading/writing S3 (partitioning, predicate pushdown, broadcast joins) to deliver analytics-ready fact/dimension tables on schedule.

  • Author and tune complex SQL on Greenplum/Postgres (window functions, ROW_NUMBER dedupe, distribution keys, AO/AOCO compression, VACUUM/ANALYZE) to process large datasets efficiently.
  • Manage AWS Glue Data Catalog and query curated layers with Athena; design S3 layouts (prefix/partition strategy, lifecycle policies) to cut query time and storage cost.
  • Implement CI/CD with CodeCommit, CodeBuild, and CodePipeline; parameterize environments and use CloudFormation for IaC to enable repeatable, auditable, and fast rollbacks.
  • Engineer observability with CloudWatch logs/metrics/alarms and job health checks, create SLA dashboards and alerting to detect failures early and reduce MTTR.
  • Enforce data quality via SQL/Python unit tests, reconciliation (row counts, sums, duplicates), referential-integrity checks, and documented UAT evidence for change control.
  • Apply security and data-governance controls: normalize and encrypt sensitive identifiers, use KMS-managed keys, and enforce IAM least privilege with audit logging.
  • Develop GenAI-assisted delivery integrates LLMs (AWS Bedrock) with PySpark/SQL to auto-suggest transformations, generate test cases, and summarize validation results.
  • Build lightweight internal data apps with AWS Amplify + DynamoDB/Athena to manage lookup keys/brand lists and enable stakeholder self-service with controlled access.

Required to work from Company Office in Chicago IL certain days per week. Telecommuting allowed for balance of week.

Requirements

Requirements: Employer will accept a Master’s degree in Computer Science, Information Technology, Engineering or related field and two years of experience in the job offered or two years in any occupation in which the required experience was gained.

Position requires two years in the following

Benefits & conditions

As an Epsilon employee, you deserve perks and benefits that put you, your family and your finances first. Our benefits encompass a wide range of offerings, including but not limited to:

  • Time to recharge: Flexible time off (FTO), 14 paid holidays, paid sick time
  • Family well-being: Parental/new child leave, childcare & elder care assistance, adoption assistance
  • Extra perks: Comprehensive health coverage, 401(k), tuition assistance, commuter benefits, professional development, employee recognition, charitable donation matching, health coaching and counseling

Epsilon benefits are subject to eligibility requirements and other terms., Compensation Range: USD $145,870.00 - USD $182,000.00/Annually. This is the pay range the Company believes it will pay for this position at the time of this posting. Consistent with applicable law, compensation will be determined based on the skills, qualifications, and experience of the applicant along with the requirements of the position, and the Company reserves the right to modify this pay range at any time. Temporary roles may be eligible to participate in our freelancer/temporary employee medical plan through a third-party benefits administration system once certain criteria have been met. For regular roles, the Company will offer medical coverage, dental, vision, disability, 401k, and paid time off. The Company anticipates the application deadline for this job posting will be 1/9/2027.

About the company

When you join Epsilon, we’ll create something EPIC together. We’re a global leader in data and identity, with deep expertise in digital media, clean rooms, customer data platforms, loyalty and marketing services. Positioned at the center of Publicis Groupe, Epsilon helps brands deliver personalized experiences at scale and build lasting customer relationships by unlocking the full potential of data and identity. Epsilon operates in 30+ countries across EMEA, the Americas and APAC, with more than 8,000 employees.

Check out a few of these resources to learn more about what makes Epsilon so EPIC:

Our Culture: https://www.epsilon.com/us/about-us/our-culture-epsilon

Life at Epsilon: https://www.epsilon.com/us/about-us/epic-blog

Epsilon has five values that define our culture and guide us as we create value for our clients, our people and consumers. We seek candidates who align with our company values, demonstrate them and make them meaningful in their day-to-day work:

  • Act with integrity. We are transparent and have the courage to do the right thing.
  • Work together to win together. We believe collaboration is the catalyst that unlocks our full potential.
  • Innovate with purpose. We shape the market with big ideas that drive big outcomes.
  • Respect all voices. We embrace differences and foster a culture of connection and belonging.
  • Empower with accountability. We trust each other to own and deliver on common goals.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Loading talks and stories from around this role…