> Markdown version of [/jobs/ext/3080409-data-engineer](https://www.wearedevelopers.com/jobs/ext/3080409-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** fairlife, LLC - **Location:** Chicago, IL, United States - **Experience:** Expert - **Salary:** $120,000.0 - $140,000.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Application Performance Management, Automation of Tests, Microsoft Azure, Software as a Service, Code Review, Information Engineering, Data Warehousing, Dimensional Modeling, Python (Programming Language), Package Management Systems, Azure Active Directory, Kusto Query Language, Search Technologies, SQL Databases, Data Streaming, YAML, Azure Service Bus, Data Server Interface, Azure Data Factory, Apache Spark, Git, Data Lakes, Pyspark, Information Technology, Key Vault, Databricks - **Published:** September 25, 2026 - **Apply:** https://www.juju.com/job/16_d33f9b372 ## About the Role * Bachelor's degree in computer science, engineering, or related field AND 5+ years of data engineering experience (manufacturing/CPG preferred) * Expert-level SQL and strong Python (building shared libraries and frameworks, not just scripts); hands-on Spark/PySpark for large-scale transformation * Strong grounding in data warehousing and dimensional modeling (star schemas, Kimball) * Proficiency with Azure data services such as SQL databases, Event Hubs, Functions, Data Factory, Key Vault, and Microsoft Entra * Experience with Azure DevOps or similar: Git, YAML CI/CD pipelines, artifact/package management, and disciplined code review practices * Lakehouse experience (Delta Lake, medallion architecture) in Fabric or Databricks preferred * Working knowledge of KQL (Azure Data Explorer, Eventhouse, or Application Insights) a plus * Exposure to RAG/semantic search or MCP tool integrations a plus * Experience with manufacturing/factory data (MES, historians, IIoT streaming) a plus * Excellent communication skills, comfortable engaging non-technical stakeholders * Detail-oriented self-starter with a growth mindset and ability to handle ambiguity * A natural team player with a habit of helping, documenting, and sharing ## Description * Design, implement, and operationalize batch and streaming data pipelines that integrate enterprise and factory data sources (ERP, IIoT, SaaS applications, APIs) into our lakehouses * Support development and maintenance of dimensional data models (star schemas) in our lakehouses that deliver consistent, well-governed metrics to the business * Build reusable frameworks and shared Python libraries (ingestion patterns, incremental loads, telemetry, alerting) that accelerate the whole team, not just one project * Own the engineering lifecycle end to end: Git branching, pull requests, CI/CD pipelines in Azure DevOps, automated testing, and environment promotion * Monitor, troubleshoot, and optimize solutions for reliability, performance, and cost, building data quality validation and pipeline observability into solutions from the start * Embed security and governance into every solution: identity-based authentication, secret management, access control, and responsible handling of sensitive data * Contribute to our growing AI-facing platform capabilities, including semantic search indexes, AI-ready data interfaces, and agent tooling * Partner with stakeholders across manufacturing and business functions, translating their needs into well-designed solutions and communicating to non-technical audiences * Document, share, and support the technical growth of fellow team members ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [CI/CD with Github Actions](https://www.wearedevelopers.com/videos/856-ci-cd-with-github-actions) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)