> Markdown version of [/jobs/ext/124482-lead-engineer-market-data-new](https://www.wearedevelopers.com/jobs/ext/124482-lead-engineer-market-data-new). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Engineer, Market Data New - **Company:** Mio Partners, Inc - **Location:** New York, NY, United States (Remote available) - **Experience:** Expert - **Salary:** $225,000.0 - **Contract:** Permanent contract - **Skills:** Airflow, Amazon Web Services, Amazon S3, Computing Platforms, Batch Processing, Cloud Computing, Computer Programming, Databases, Data as a Services, Data Architecture, Information Engineering, Data Governance, Data Infrastructure, Extract Transform Load (ETL), Data Normalization, Data Security, Database Design, DevOps, Digital Assets, Distributed Data Store, Distributed Systems, Python (Programming Language), Performance Tuning, Software Architecture, Redis, Reference Data, Cloud Services, SQL Databases, Workflow Management Systems, Data Processing, Data Storage Technologies, Caching, Build Management, Core Data, Apache Kafka, Data Management, Data Pipelines - **Published:** May 14, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=6c1244fa99c88f8b ## About the Role Do you have experience in Team management?, * 10-12+ years of experience in data engineering, data architecture, or related fields * Proven experience evaluating and re-architecting data platforms at scale * Strong hands-on experience building distributed data pipelines and systems * Deep expertise in AWS-based data architecture * Strong programming and data engineering skills, including Python, SQL, workflow orchestration tools (e.g., Airflow), and ETL/ELT frameworks * Extensive experience in database design and data modeling, including time-series and financial data, normalized and denormalized schemas, and relational and columnar databases * Experience with caching technologies (e.g., Redis) and performance optimization * Solid understanding of financial markets and asset classes, including fixed income, commodities, equities and derivatives, and digital assets * Experience leading engineering teams and driving architectural decisions * Strong familiarity with market data vendors such as Bloomberg, LSEG, and ICE, * Experience in a multi-strategy hedge fund, asset manager, or leading market data provider (e.g., Bloomberg, LSEG, ICE Data Services) * Familiarity with real-time and streaming architectures (e.g., Kafka, Kinesis) * Experience with data governance, lineage, and data quality frameworks * Experience building canonical data platforms or enterprise data layers Key Competencies * Strong architectural vision with hands-on execution capability * Deep expertise in data modeling and distributed system design * Ability to evaluate and select appropriate tools and technologies * Strong leadership, mentoring, and team-building skills * High degree of ownership and accountability Applicants must be authorized to work in the U.S. without the need for employer-sponsored work authorization, now or in the future. ## Description MIO is seeking a Lead Engineer to drive the evolution of our market data platform. This role sits within the Research & Investment Technology team and reports directly to the Director of Research & Investment Technology. This is a senior, hands-on leadership role responsible for assessing the current architecture and leading the design and build-out of a next-generation, scalable data platform. You will own the end-to-end ingestion, modeling, and distribution of market data across multiple vendors (e.g., Bloomberg, LSEG, ICE), while guiding architectural decisions, mentoring engineers, and establishing best practices across data engineering and platform design. Primary responsibilities Architecture Review & Platform Build-Out * Assess the current market data architecture, identify gaps, and define a target-state architecture in collaboration with the Director of Research & Investment Technology * Lead the design and implementation of a scalable, resilient, and extensible data platform * Establish architectural principles, standards, and best practices across data engineering * Drive re-architecture initiatives to improve performance, scalability, and maintainability Technology & Tooling Leadership * Lead evaluation and selection of core data platform tools and frameworks, including ETL/ELT pipelines, workflow orchestration (e.g., Airflow), data storage (lakes, warehouses), and caching layers (e.g., Redis) * Make build vs. buy decisions and define the long-term data technology stack * Standardize tooling and promote engineering best practices across the team Data Pipeline Development (Hands-On) * Architect and build robust ETL/ELT pipelines for ingesting and processing data from multiple vendors (e.g., Bloomberg, LSEG, ICE, etc.) * Design workflows for data normalization, symbology mapping, enrichment, and distribution * Implement monitoring, alerting, and failure recovery mechanisms * Work hands-on with large-scale financial datasets Data Modeling & Database Design * Lead the design of scalable data models for market and reference data * Define canonical data models and schema standards across asset classes * Optimize database design for performance, flexibility, and analytical use cases * Design systems to handle vendor-specific schemas, symbology mapping, and entitlements Caching & Performance Optimization * Design and implement caching strategies (e.g., Redis) to support low-latency data access * Optimize data access patterns and overall system performance * Balance real-time and batch processing requirements Cloud & Infrastructure (AWS) * Partner with DevOps to design and manage cloud-native data platforms using AWS services (e.g., S3, Lambda, Glue, EMR, Redshift, ECS/EKS) * Optimize infrastructure for cost, performance, and scalability Team Leadership & Mentorship * Lead and mentor a team of data engineers, setting technical direction and standards * Guide the team on tool selection, architectural decisions, and implementation approaches * Conduct code and design reviews with a focus on scalability and maintainability * Foster a culture of ownership and engineering excellence ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Reducing LLM Calls with Vector Search Patterns - Raphael De Lio (Redis)](https://www.wearedevelopers.com/videos/1714-reducing-llm-calls-with-vector-search-patterns-raphael-de-lio-redis) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) - [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment) ## Related Articles - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Best Companies to work for in London: Top 25 Companies in 2023](https://www.wearedevelopers.com/magazine/187-best-companies-to-work-for-in-london-top-25-companies-in-2023) - [The Biggest German Tech Companies](https://www.wearedevelopers.com/magazine/424-the-biggest-german-tech-companies) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [7 Most Popular Web Developer Jobs in Europe](https://www.wearedevelopers.com/magazine/163-7-most-popular-web-developer-jobs-in-europe)