> Markdown version of [/jobs/ext/1389207-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/1389207-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** fairlife, LLC - **Location:** Chicago, IL, United States - **Experience:** Expert - **Salary:** $110,000.0 - $125,000.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Application Performance Management, Automation of Tests, Microsoft Azure, Software as a Service, Code Review, Information Engineering, Data Warehousing, Dimensional Modeling, Python (Programming Language), Package Management Systems, Azure Active Directory, Kusto Query Language, Search Technologies, SQL Databases, Data Streaming, YAML, Azure Service Bus, Data Server Interface, Azure Data Factory, Apache Spark, Git, Data Lakes, Information Technology, Key Vault, Databricks - **Published:** July 22, 2026 - **Apply:** https://jobs.localjobnetwork.com/apply/add/87795475/1 ## About the Role * Bachelor's degree in computer science, engineering, or related field AND 5+ years of data engineering experience (manufacturing/CPG preferred) * Expert-level SQL and strong Python (building shared libraries and frameworks, not just scripts); hands-on Spark/PySparkfor large-scale transformation * Strong grounding in data warehousing and dimensional modeling (star schemas, Kimball) * Proficiency with Azure data services such as SQL databases, Event Hubs, Functions, Data Factory, Key Vault, and Microsoft Entra * Experience with Azure DevOps or similar: Git, YAML CI/CD pipelines, artifact/package management, and disciplined code review practices * Lakehouse experience (Delta Lake, medallion architecture) in Fabric or Databricks preferred * Working knowledge of KQL (Azure Data Explorer,Eventhouse, or Application Insights) a plus * Exposure to RAG/semantic search or MCP tool integrations a plus * Experience with manufacturing/factory data (MES, historians,IIoTstreaming) a plus * Excellent communication skills, comfortable engaging non-technical stakeholders * Detail-oriented self-starter with a growth mindset and ability to handle ambiguity * A natural team player with a habit of helping, documenting, and sharing ## Description * Design, implement, and operationalize batch and streaming data pipelines that integrate enterprise and factory data sources (ERP,IIoT, SaaS applications, APIs) into ourlakehouses * Support development and maintenance of dimensional data models (star schemas) in ourlakehousesthat deliver consistent, well-governed metrics to the business * Build reusable frameworks and shared Python libraries (ingestion patterns, incremental loads, telemetry, alerting) that accelerate the whole team, not just one project * Own the engineering lifecycle end to end: Git branching, pull requests, CI/CD pipelines in Azure DevOps, automated testing, and environment promotion * Monitor, troubleshoot, and optimize solutions for reliability, performance, and cost, building data quality validation and pipeline observability into solutions from the start * Embed security and governance into every solution: identity-based authentication, secret management, access control, and responsible handling of sensitive data * Contribute to our growing AI-facing platform capabilities, including semantic search indexes, AI-ready data interfaces, and agent tooling * Partner with stakeholders across manufacturing and business functions, translating their needs into well-designed solutions and communicating to non-technical audiences * Document, share, and support the technical growth of fellow team members, As our recruitment is primarily handled in-house, we work only occasionally with external agencies, and only those on our existing, pre-approved vendor list. At this time, we are not reviewing or expanding that list. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Best Practices for Using GitHub Secrets](https://www.wearedevelopers.com/videos/1214-best-practices-for-using-github-secrets) - [CI/CD with Github Actions](https://www.wearedevelopers.com/videos/856-ci-cd-with-github-actions) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Stop Committing Your Secrets - GIt Hooks To The Rescue!](https://www.wearedevelopers.com/videos/573-stop-committing-your-secrets-git-hooks-to-the-rescue) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [How Much FAANG Companies Actually Pay Software Engineers in 2025](https://www.wearedevelopers.com/magazine/230-how-much-faang-companies-actually-pay-software-engineers-in-2025)