> Markdown version of [/jobs/ext/1310114-data-engineer](https://www.wearedevelopers.com/jobs/ext/1310114-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** Schonfeld Group
- **Location:** New York, United States
- **Experience:** Expert
- **Salary:** $200,000.0
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Amazon S3, Big Data, Continuous Integration, Data as a Services, Shard (Database Architecture), Python (Programming Language), PostgreSQL, Operational Databases, Performance Tuning, Standard Sql, Swagger, Data Streaming, Management of Software Versions, Openapi, Apache Spark, Git, Cloudformation, Data Lakes, Apache Flink, Apache Kafka, Data Management, Api Design, Terraform, MemSQL
- **Published:** July 17, 2026
- **Apply:** https://www.dice.com/job-detail/8769eddd-d8f8-44c8-a405-8a63cb1a6690

## About the Role

* 7+ years building production data platforms with Python and SQL
 * Deep expertise in big-data architecture: partitioning, sharding, columnar formats
 * Hands-on with SingleStore/MemSQL, Spark/Flink/EMR and event buses (Kafka/Kinesis)
 * Proven AWS skills plus Terraform / CloudFormation infrastructure-as-code mastery
 * Experience delivering data services for AI/ML workloads and feature pipelines
 * Experience building AI/ML feature stores or RAG pipelines
 * Performance-tuning Postgres, SingleStore/MemSQL, or KDB for sub-second queries
 * Proficient in API design, versioning, and OpenAPI/Swagger documentation
 * Comfortable collaborating directly with traders, quants, and data scientists

We'd love if you had:

 * Market-data domain expertise (tick, options, macro)
 * Mastery of Iceberg, Delta Lake, or Hudi on S3
 * Hands-on work with real-time analytics engines such as SingleStore/MemSQL
 * Skill with performance profiling tools
 * Contributions to open-source data tooling or technical talks

## Description

As the driving force behind Schonfeld's next-generation data platforms, you will architect, operate, and continually refine underlying platform that empowers research, systematic trading, AI and risk analytics. On top of this robust foundation, you'll build and run high-throughput pipelines spanning ultra-low-latency market-data streams to cost-efficient end-of-day workflows. Partner closely with quants, data scientists, and fellow engineers to achieve sub-minute SLAs, shape firm-wide architecture, and mentor peers. We believe diverse backgrounds and voices spark better ideas and more resilient systems, so you'll join an inclusive culture where every perspective counts.

What you'll do

 * Architect and operate the platform - 24x7 reliability, IaC-driven deployments, tight cost controls
 * Build and evolve batch and streaming pipelines that ingest billions of market-data events each day
 * Architect high-performance, cost-efficient Lakehouse tables
 * Expose curated datasets via robust, versioned APIs consumed by quants and AI agents
 * Optimize workflows to meet aggressive SLAs, embedding observability and automated data quality checks end-to-end
 * Champion Infrastructure-as-Code with Git-driven CI/CD for every data asset
 * Mentor junior engineers and enforce best-in-class coding standards
 * Continuously refine processes to keep our data ecosystem resilient and lightning-fast


## Related Videos

- [For the REST of us: API First and Conway’s Law](https://www.wearedevelopers.com/videos/1932-for-the-rest-of-us-api-first-and-conway-s-law)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)
- [Contract-First Frontend: Scaling Reliable UIs with OpenAPI and AI](https://www.wearedevelopers.com/videos/1995-contract-first-frontend-scaling-reliable-uis-with-openapi-and-ai)
- [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)

## Related Articles

- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)