Data Engineer

Enigma LLC
New York, United States
26 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Compensation
$180,000.0 - $295,000.0
Working hours
Regular working hours
Job source

Tech stack

Airflow Data Infrastructure Data Systems Distributed Data Store Python (Programming Language) Management of Software Versions Apache Spark Pyspark Machine Learning Operations Data Pipelines Databricks

Job description

As a Senior Data Engineer, you will be responsible for designing, building, and maintaining our core small business data product. You will collaborate with cross-functional teams to build out new product capabilities starting from raw source data, through scalable data pipelines and models to the customer interface. We embrace customer focus and end-to-end ownership so your impact will be measured by the value we deliver and the technical quality and maintainability of our product. What You’ll Do

  • Understand the unmet needs of our customers and create capabilities to address these. This usually involves a process of exploring data, prototyping, and evaluation, followed by the build of robust and maintainable data pipelines.
  • Engineer scalable and maintainable data systems that tell the story of millions of U.S. small businesses (we use Databricks SQL, PySpark, and MLFlow).
  • You’ll be building on top of our innovative data infrastructure that’s designed for iteration and experimentation (uses Dagster for orchestration and LakeFS for data versioning).
  • Apply a data-focused, first-principles approach to problem solving. We value candidates who bias towards simple and elegant solutions but have the capability to implement state-of-the-art models and techniques when required.
  • Inspire your teammates to perform at their best while fostering a collaborative, supportive team culture.

What Makes This Role Exciting?

  • Ownership and Impact: Work directly with customers and internal teams to build product capabilities in an environment of high-trust and responsibility.
  • Technical Challenge: Tackle complex data and engineering problems, balancing speed of innovation with scalability and reliability.
  • Learning: Work on unique, high-impact data challenges that require creative problem-solving and cutting-edge techniques.

Requirements

  • Must have 5+ years of engineering or data science experience, including 3+ years working on distributed data systems.
  • Has practical experience extracting value from data in a creative way to deliver customer impact.
  • Cares deeply about creating value and wants to learn, ship, and iterate quickly.
  • Strong collaboration skills and a desire to work in a cross-functional environment.
  • A principled, metrics-driven approach to solving complex data problems.

Bonus Points If You

  • Have built data products in the entity resolution, sales, marketing, KYB, or credit underwriting space.
  • Prior experience in Python, Spark and Databricks.

Benefits & conditions

Salary Range: $180,000-$295,000

A note on salary ranges: we pride ourselves on paying competitively for our size and industry. Salary is one piece of a total Enigma compensation package that includes additional benefits and opportunities. All of our compensation packages include equity because we believe 100% of Enigma employees should have the option to purchase ownership in the company and benefit from the value we’re creating together.

About the company

At Enigma, we’re building the single, most reliable source of data on businesses to power the future of financial services. By engineering better data from hundreds of public and third-party sources, we aim to tell the complete story of every business, so that companies of every size can access the financial services they need to grow and thrive. Our core values - generosity, curiosity, ingenuity, & drive - guide everything we do, from how we make our most important product decisions to how we work with and support one another on a daily basis. We’re a team of curious, driven individuals with diverse backgrounds and skills, but we’re all passionate about engineering deeper understanding through data-together. If this resonates, we would love to hear from you!

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · WWC Europe 2026

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · WWC Europe 2026

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · WWC 2024

Videos

See all

Related articles

See all