> Markdown version of [/jobs/ext/2198401-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/2198401-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Data Engineer - **Company:** Balyasny Asset Management L.P. - **Location:** Chicago, IL, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Airflow, Amazon Web Services, Data Analysis, Microsoft Azure, Cloud Computing, Code Review, Information Engineering, Data Security, Data Systems, Data Warehousing, Python (Programming Language), Metadata, NoSQL, Operational Databases, Cloud Services, Standard Sql, SQL Databases, Google Cloud, Data Ingestion, Delivery Pipeline, Large Language Models, Snowflake - **Published:** August 23, 2026 - **Apply:** https://www.dice.com/job-detail/74145344-d444-4075-9697-6e8d04236f6e ## About the Role Significant experience building and operating production data platforms, pipelines, and analytics-ready data products. Strong Python and SQL skills, with experience across relational and NoSQL data systems. Deep experience with Snowflake or comparable modern cloud data warehouses. Strong hands-on experience with AWS data and cloud services, including designing secure, scalable, and cost-effective production architectures. Experience designing and orchestrating production workflows with Airflow or comparable tools. Cloud infrastructure experience in AWS, Azure, or Google Cloud. Strong understanding of data modeling, large-scale dataset performance, time-series data, and temporal-query patterns. Demonstrated ability to lead technical projects end-to-end, make sound architectural decisions, and improve existing complex systems. A track record of mentoring engineers and communicating effectively with both technical and business stakeholders. Nice to Have Experience with Go and service-oriented platform development. Experience applying AI/LLM capabilities to data engineering workflows. Financial-services or market-data experience. ## Description We are seeking a hands-on Senior / Lead Data Engineer to provide technical leadership for the platforms, pipelines, and data products that power analytics, applications, and investment decision-making across the firm. You will architect scalable, cloud-first data solutions; set engineering standards; and lead small teams through delivery of reliable, analytics-ready datasets and services. This role combines deep technical execution with mentorship, cross-functional partnership, and ownership of complex data initiatives. It offers the opportunity to take on people-management responsibilities over time. What You'll Do Lead the design and delivery of scalable ingestion pipelines, data models, and platform services using Python, SQL, Snowflake, and AWS. Architect reliable solutions for structured, unstructured, market, and alternative datasets, with particular focus on performance, lineage, usability, and operational resilience. Drive the evolution of the Data Acquisition Platform, including APIs, services, plugins, and AI-enabled workflows for onboarding, pipeline creation, metadata generation, and natural-language data access. Establish and improve automated data-quality frameworks covering completeness, freshness, schema integrity, reconciliations, and business-rule validation. Own technical standards for testing, observability, alerting, incident response, and production support across a large and growing dataset estate. Lead root-cause analysis for complex, time-sensitive data incidents and drive durable corrective actions. Mentor engineers through design reviews, code reviews, pairing, and technical coaching; help shape team practices and engineering culture. Partner directly with Analysts, Quants, Portfolio Managers, and external data providers to translate requirements into robust end-to-end data solutions. Evangelize data engineering best practices and influence technical direction across partner teams. Potentially manage a small team, including prioritization, delivery planning, feedback, and career development. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [A Data Mesh needs Open Metadata](https://www.wearedevelopers.com/videos/505-a-data-mesh-needs-open-metadata) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Crafting Custom Frameworks with Rust: A Deep Dive into Procedural Macros](https://www.wearedevelopers.com/videos/849-crafting-custom-frameworks-with-rust-a-deep-dive-into-procedural-macros) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production](https://www.wearedevelopers.com/magazine/115-mlops-deploying-maintaining-and-evolving-machine-learning-models-in-production)