Lead Data Engineer

Selby Jennings
New York, NY, United States
6 days ago
Apply on www.efinancialcareers.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Airflow Amazon Web Services Big Data Code Review Computer Programming Databases Data Architecture Data Infrastructure Data Integrity Data Systems
+13 more
Data Warehousing Python (Programming Language) Meta-Data Management NoSQL Service-Oriented Architecture SQL Databases Workflow Management Systems Cloud Platform System Large Language Models Snowflake IT Architecture Backend Data Management

Job description

Responsibilities Lead the development of cloud-based data platforms, pipelines, and data products leveraging Python, SQL, Snowflake, and AWS. Build scalable solutions for a variety of data sources, including market, alternative, and enterprise datasets. Enhance the firm’s data platform through APIs, automation, metadata management, and emerging AI-driven capabilities. Improve data reliability through quality controls, monitoring, testing, and operational best practices. Troubleshoot complex data issues and implement long-term solutions to improve platform stability. Design efficient data models and datasets that support analytics, reporting, and quantitative research. Collaborate with investment, research, and technology teams to deliver scalable data solutions. Provide technical leadership through architecture guidance, code reviews, mentorship, and engineering best practices. Drive projects from design through production while influencing the future direction of the data platform.

Requirements

Opportunity to mentor and potentially lead a growing team of engineers. Qualifications Experience building and supporting enterprise-scale data platforms and pipelines. Strong programming skills in Python and SQL. Expertise with Snowflake or a similar modern cloud data warehouse. Hands-on experience designing and deploying solutions within AWS. Experience with workflow orchestration tools such as Airflow. Knowledge of relational and NoSQL database technologies. Strong understanding of data modeling, data architecture, and large-scale data processing. Proven ability to lead technical initiatives and deliver complex projects. Preferred Qualifications Experience with Go or other backend development languages. Background in platform engineering or service-oriented architectures. Exposure to AI/LLM-powered data solutions and automation. Experience within financial services, investment management, trading, or market data environments. Track record of building highly reliable and scalable data systems.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.efinancialcareers.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

1:52 min

Structuring and scaling the backend engineering team

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · World Congress 2024

1:12 min

Choosing TypeScript for complex backend applications

Maximilian Otto Maximilian Otto · World Congress 2024

Videos

See all

Related articles

See all