Data Engineer - Remote

SUNDAE, INC.
United States
12 days ago
Apply on arc.dev
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Airflow BigQuery Business Systems Cloud Database Data Architecture Data Systems Data Vault Modeling Data Warehousing Distributed Data Store Python (Programming Language) Machine Learning
+11 more
SQL Databases Systems Integration Snowflake Apache Spark Data Layers Event Driven Architecture Debezium Low Latency Apache Flink Apache Kafka Data Pipelines

Job description

Data is at the core of Whatnot’s mission to foster community and connection through commerce. As our newest Data Engineer, you will be instrumental in building and scaling the data systems that support data-driven decision-making across the organization. You will collaborate directly with stakeholders in payments and finance teams to design reliable, scalable data architectures, develop resilient pipelines, and create foundational data products that drive growth and innovation.

On a day-to-day basis, your responsibilities will include owning end-to-end data architecture, defining how we capture, model, and serve critical business data, and implementing these designs in production. You will develop and operate streaming and batch data workflows to process high-volume events related to user activity, transactions, marketing performance, and operational telemetry, ensuring low latency, data completeness, and accuracy. Additionally, you will create domain-oriented data models that serve as the source of truth for analytics, machine learning, and real-time applications, establishing standards and ownership boundaries across teams.

Enforcing data quality at scale will be a key focus, involving building tests, lineage, monitoring, and reconciliation systems to ensure datasets are observable and anomalies are actionable. You will also automate operational workflows in partnership with business systems and platform teams to eliminate manual data handoffs and reconcile data across services, warehouses, and external systems. Supporting analytics, machine learning, and product teams by exposing high-quality, low-latency data through semantic layers, APIs, and real-time query systems will be essential to your role. Your work will directly influence product growth, insights, and innovation, making your contributions critical to Whatnot’s ongoing success., * Own data architecture end-to-end, including defining data capture, modeling, and serving strategies, and implementing them in production environments.

  • Develop and operate streaming and batch data pipelines to process high-volume events with guarantees on latency, completeness, and accuracy.
  • Create and maintain canonical data models that serve as authoritative sources for analytics, machine learning, and real-time applications.
  • Build and maintain data quality systems, including tests, lineage, monitoring, and reconciliation tools to ensure dataset reliability and observability.
  • Automate operational workflows by partnering with business systems and platform teams to streamline data processes and eliminate manual handoffs.
  • Support analytics, ML, and product teams by providing high-quality, low-latency data through APIs, semantic layers, and real-time query systems.
  • Continuously evaluate and improve data architecture, pipelines, and models to support business growth and product innovation.

Requirements

  • Minimum of 3+ years of experience as a data or software engineer building data warehouses, distributed data systems, or event-driven architectures.
  • Proficiency in designing and implementing data models using dimensional, Data Vault, or ledger-style techniques supporting analytical and transactional workloads.
  • Deep hands-on expertise with modern data tooling such as Kafka, Debezium, dbt, Spark, Flink, Dagster, Airflow, Monte Carlo, and Great Expectations.
  • Experience operating cloud data warehouses like Snowflake, BigQuery, or Redshift, including schema design, workload tuning, and cost optimization.
  • Proficiency in writing production-grade code in Python or SQL and integrating with CI/CD pipelines and infrastructure-as-code workflows.
  • Ability to collaborate across disciplines-engineering, product, and analytics-to translate complex business requirements into effective data systems.
  • Self-starter mentality with the ability to thrive in a fast-paced environment, owning both technical design and operational outcomes.

Benefits & conditions

  • Generous holiday and time-off policy to support work-life balance.
  • Comprehensive health insurance options including Medical, Dental, and Vision coverage.
  • Support for working from home, including a home office setup allowance and monthly allowances for internet and cell phone expenses.
  • Care benefits such as monthly wellness allowances and an annual childcare allowance.
  • Lifetime family planning benefits, including support for adoption and fertility expenses.
  • Retirement plans including 401(k) with employer match (up to 4%) for US employees and pension plans internationally.
  • Monthly allowance to use Whatnot as a user (dogfooding), fostering product understanding and engagement.

Equal Opportunity

About the company

Join the Future of Commerce with Whatnot! Whatnot is the largest live shopping platform in North America and Europe dedicated to enabling users to buy, sell, and discover the things they love. Our platform spans a wide range of categories including trading cards, fashion, electronics, and live plants, empowering sellers to build real businesses and connect with a global audience. We are pioneering live commerce at an unprecedented scale in the West, shaping an entirely new industry with no existing playbook. Our innovative approach is driven by a passionate team committed to transforming how people engage with commerce and community.

As a remote co-located team, we are inspired by our core values and maintain hubs across the US, UK, Ireland, Poland, Germany, and Australia. We prioritize moving quickly, staying close to our users, and focusing on impactful work. Recognized as one of the fastest-growing marketplaces, we were recently named the #1 Best Startup Employer in America by Forbes. Our commitment to innovation and community makes us a dynamic place to grow and make an impact. We continually update our community and engineering blogs to share our progress and invite talented individuals to join us in enabling anyone to turn their passion into a business and bring people together through commerce.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on arc.dev
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon ¡ World Congress 2026 Europe

1:19 min

The true role and evolution of data engineering

Sandhya Menon Sandhya Menon ¡ World Congress 2026 Europe

1:26 min

Building an initial solution using Debezium and Apache Kafka

Bobur Umurzokov ¡ LIVE

2:30 min

Leveraging BigQuery ML for scalable SQL-based segmentation experiments

Julian Joseph ¡ LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt ¡ LIVE

1:42 min

Handling stateful application schemas during progressive deployment

Kevin Dubois Kevin Dubois ¡ World Congress 2025

Videos

See all

Related articles

See all