Data Engineer

Schonfeld Group
New York, United States
25 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Compensation
$200,000.0
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services Amazon S3 Big Data Continuous Integration Data as a Services Shard (Database Architecture) Python (Programming Language) PostgreSQL Operational Databases Performance Tuning
+15 more
Standard Sql Swagger Data Streaming Management of Software Versions Openapi Apache Spark Git Cloudformation Data Lakes Apache Flink Apache Kafka Data Management Api Design Terraform MemSQL

Job description

As the driving force behind Schonfeld’s next-generation data platforms, you will architect, operate, and continually refine underlying platform that empowers research, systematic trading, AI and risk analytics. On top of this robust foundation, you’ll build and run high-throughput pipelines spanning ultra-low-latency market-data streams to cost-efficient end-of-day workflows. Partner closely with quants, data scientists, and fellow engineers to achieve sub-minute SLAs, shape firm-wide architecture, and mentor peers. We believe diverse backgrounds and voices spark better ideas and more resilient systems, so you’ll join an inclusive culture where every perspective counts.

What you’ll do

  • Architect and operate the platform - 24x7 reliability, IaC-driven deployments, tight cost controls
  • Build and evolve batch and streaming pipelines that ingest billions of market-data events each day
  • Architect high-performance, cost-efficient Lakehouse tables
  • Expose curated datasets via robust, versioned APIs consumed by quants and AI agents
  • Optimize workflows to meet aggressive SLAs, embedding observability and automated data quality checks end-to-end
  • Champion Infrastructure-as-Code with Git-driven CI/CD for every data asset
  • Mentor junior engineers and enforce best-in-class coding standards
  • Continuously refine processes to keep our data ecosystem resilient and lightning-fast

Requirements

  • 7+ years building production data platforms with Python and SQL
  • Deep expertise in big-data architecture: partitioning, sharding, columnar formats
  • Hands-on with SingleStore/MemSQL, Spark/Flink/EMR and event buses (Kafka/Kinesis)
  • Proven AWS skills plus Terraform / CloudFormation infrastructure-as-code mastery
  • Experience delivering data services for AI/ML workloads and feature pipelines
  • Experience building AI/ML feature stores or RAG pipelines
  • Performance-tuning Postgres, SingleStore/MemSQL, or KDB for sub-second queries
  • Proficient in API design, versioning, and OpenAPI/Swagger documentation
  • Comfortable collaborating directly with traders, quants, and data scientists

We’d love if you had:

  • Market-data domain expertise (tick, options, macro)
  • Mastery of Iceberg, Delta Lake, or Hudi on S3
  • Hands-on work with real-time analytics engines such as SingleStore/MemSQL
  • Skill with performance profiling tools
  • Contributions to open-source data tooling or technical talks

Benefits & conditions

The base pay for this role is expected to be between $200,000 and $220,000. The expected base pay range is based on information at the time this post was generated. This role may also be eligible for other forms of compensation such as a performance bonus and a competitive benefits package. Actual compensation for the successful candidate will be determined based on a variety of factors such as skills, qualifications, and experience.

About the company

Who we areSchonfeld is a global multi-manager hedge fund that strives to deliver industry-leading risk-adjusted returns for our investors. We leverage both internal and external portfolio manager teams around the world, seeking to capitalize on inefficiencies and opportunities within the markets. We draw from decades of experience and a significant investment in proprietary technology, infrastructure and risk analytics to invest across four main strategies: Quant, Tactical, Fundamental Equity and Discretionary Macro & Fixed Income.

Our CultureAt Schonfeld, we’ll invest in you. Attracting and retaining top talent is at the heart of what we do, because we believe that exceptional outcomes begin with exceptional people. We foster a culture where talent is empowered to continually learn, innovate and pursue ambitious goals. We are teamwork-oriented, collaborative and encourage ideas-at all levels-to be shared. As an organization committed to investing in our people, we provide learning and educational offerings and opportunities to make an impact. We encourage community through internal networks, external partnerships and service initiatives that promote inclusion and purpose beyond the firm’s walls.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:53 min

Using OpenAPI as an executable contract

Violina Popova Violina Popova · Europe 2026 Virtual

3:54 min

Core capabilities of SingleStore distributed relational SQL database

Akmal Chaudhri Akmal Chaudhri · LIVE

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:48 min

Understanding the purpose of OpenAPI specifications

Christopher Walles Christopher Walles · WWC 2024

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · WWC Europe 2026

Videos

See all

Related articles

See all