Software Engineer, Data Platform

Whatnot Inc.
San Francisco, CA, United States
3 days ago
Apply on startup.jobs
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Data Analysis BigQuery Cloud Computing Content Analysis Data Infrastructure Data Systems Distributed Systems Python (Programming Language) Machine Learning Data Streaming Google Cloud
+11 more
Real Time Systems Snowflake Solid Principles Apache Flink Apache Kafka Operational Systems Api Design Terraform Stream Processing Data Pipelines Amazon Redshift

Job description

The Data Platform team at Whatnot builds services that improve our core product experience and unlock meaningful business value. In this role, you will:

  • Define technical direction and lead development of critical data platform systems that power next-generation capabilities at Whatnot
  • Lead the buildout and evolution of our Flink platform, helping drive stream processing from early platform investment to production-ready usage across the company.
  • Design scalable, reliable, multi-tenant streaming infrastructure rather than simply building pipelines on top of an existing platform.
  • Own core platform concerns including scalability, performance, reliability, SLOs, and operational excellence for stream processing systems.
  • Build high-quality systems that support real-time analytics, event-driven applications, and machine learning infrastructure needs across Whatnot.
  • Make key decisions about how data systems should be integrated across Whatnot, and then partner cross-functionally to bring that architecture to life
  • Collaborate closely with engineering partners across product, platform, machine learning, and data to enable fast, safe, and scalable development
  • Help shape broader company architecture across stream processing, real-time systems, analytics, and content understanding

Requirements

As our next Software Engineer, Data Platform, you should have 5+ years of experience, plus:

  • Ability to write well-tested, API-driven applications and services that run at scale in production
  • Track record of building scalable, high-performance distributed systems
  • Strong experience with streaming data systems such as Kafka, Flink, or Pulsar, with particular strength in building or evolving the platform layer itself - not just downstream pipelines.
  • Hands-on experience designing and operating stateful real-time data pipelines at scale, including concepts like checkpointing, state management, and watermarking.
  • Experience evaluating architectural tradeoffs in stream processing systems, including when Flink is the right solution and when it is not.
  • Experience building multi-tenant or end-to-end streaming infrastructure that supports multiple teams or production use cases.
  • Expertise in managing cloud data stores (Snowflake, BigQuery, Redshift, etc.) for processing and serving data products
  • Strong experience supporting operational systems to ensure uptime, reliability, and maintainability, including monitoring, alerting, and incident management

In addition to these role-specific qualifications, all engineering team members are expected to have:

  • Experience managing cloud technologies (AWS or Google Cloud) and comfort with infrastructure-as-code approaches (for example, Terraform)
  • Proficiency in at least one server-side programming language (preferably Python), common algorithms and data structures, and software design principles
  • Self-starter ethic, with the ability to thrive under a high level of autonomy
  • Exceptional interpersonal and communication skills

Benefits & conditions

  • Generous Holiday and Time off Policy
  • Health Insurance options including Medical, Dental, Vision
  • Work From Home Support
  • Home office setup allowance
  • Monthly allowance for cell phone and internet
  • Care benefits
  • Monthly allowance for wellness
  • Annual allowance towards Childcare
  • Lifetime benefit for family planning, such as adoption or fertility expenses
  • Retirement; 401k offering for Traditional and Roth accounts in the US (employer match up to 4% of base salary) and Pension plans internationally
  • Monthly allowance to dogfood the app
  • All Whatnauts are expected to develop a deep understanding of our product. We’re passionate about building the best user experience, and all employees are expected to use Whatnot as both a buyer and a seller as part of their job (our dogfooding budget makes this fun and easy!).
  • Parental Leave
  • 16 weeks of paid parental leave + one month gradual return to work *company leave allowances run concurrently with country leave requirements which take precedence.

About the company

Join the Future of Commerce with Whatnot!

Whatnot is the largest livestream shopping platform in North America and Europe to buy, sell, and discover the things you love. Whether it’s trading cards, fashion, electronics, or live plants, our sellers are building real businesses across hundreds of categories. We’re building live commerce at a scale that’s never been done in the West, and there’s no playbook to copy. The people here are shaping how an entirely new industry develops.

As a remote co-located team, we’re inspired by our values and anchored in hubs across the US, UK, Ireland, Poland, Germany, and Australia. We move fast, stay close to our users, and focus on the work that drives the most impact.

We’re one of the fastest growing marketplaces and were recently named the #1 Best Startup Employer in America by Forbes. Check out the latest Whatnot updates on our news and engineering blogs and join us as we enable anyone to turn their passion into a business and bring people together through commerce., Whatnot is proud to be an Equal Opportunity Employer. We value diversity, and we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, parental status, disability status, or any other status protected by local law. We believe that our work is better and our company culture is improved when we encourage, support, and respect the different skills and experiences represented within our workforce.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on startup.jobs
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:14 min

Solving complex platform architecture challenges at an enterprise scale

Maria Apazoglou · Coffee With Developers

1:33 min

Integrating internal APIs and maintaining data sovereignty

Mahran Meißner Mahran Meißner · World Congress 2026 Europe

1:34 min

Essential commands for running and testing Terraform configurations

Hennie Francis · LIVE

2:30 min

Leveraging BigQuery ML for scalable SQL-based segmentation experiments

Julian Joseph · LIVE

4:36 min

Hiring passionate software engineers to tackle unprecedented scaling challenges

Dana Lawson Dana Lawson +1 · World Congress 2026 Europe

2:46 min

Transforming data architecture from on-premise to cloud

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

Videos

See all

Related articles

See all