> Markdown version of [/jobs/ext/2289513-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/2289513-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Zoro Tools, Inc. - **Location:** Chicago, IL, United States - **Experience:** Expert - **Salary:** $112,900.0 - $188,100.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Airflow, Amazon Web Services, Amazon S3, Data Analysis, ARM Architecture, Automation of Tests, Bash Shell, Unix, Databases, Continuous Delivery, Information Engineering, Data Infrastructure, Data Integrity, Relational Databases, Digital Assets, Amazon DynamoDB, Github, Graph Database, Python (Programming Language), Machine Learning, NoSQL, Performance Tuning, Software Tools, Cloud Services, Windows Shell, Scala (Programming Language), Search Technologies, Shell Script, Data Streaming, Unstructured Data, Workflow Management Systems, Data Processing, Test-Driven Development (TDD), GitHub Copilot, Large Language Models, Snowflake, Apache Spark, Containerization, Data Lakes, Gitlab-ci, Kubernetes, Luigi, AWS Glue, Data Management, Functional Programming, Data Pipelines, Serverless Computing, Docker, Jenkins, Databricks - **Published:** August 29, 2026 - **Apply:** https://diversityjobs.com/main/sendform/8/8/28176/1/18127815?backUrl=%2Fcareer%2F18127815%2FSenior-Data-Engineer-Illinois-Chicago ## About the Role * 3+ years of experience in batch and streaming data engineering using Spark, Python, Scala, Snowflake, or Databricks for analytics, data engineering, or machine learning workloads. * 3+ years orchestrating and implementing production pipelines with workflow tools such as Databricks Workflows / Lakeflow Jobs, Apache Airflow, Luigi, or similar orchestration platforms. * Hands-on Databricks platform experience in a central data platform or data engineering enablement role, including notebooks/repos, Delta Lake, Unity Catalog, Databricks Runtime, job/serverless/cluster compute, workflow monitoring, cost and performance optimization, and production support of user requests. * Experience or strong working familiarity with Snowflake AI and Cortex capabilities such as Cortex Analyst, Cortex Search, Cortex Agents, Cortex Code / Snowflake CoCo, Cortex Sense, AISQL / AI functions, semantic models, and AI-enabled search, retrieval, or agent patterns. * Comfort working with AI-assisted developer and agent tools such as Claude, Claude CLI, GitHub Copilot, or similar tools; understanding of emerging multi-agent system patterns, including context management, tool use, orchestration, guardrails, testing, observability, and secure enterprise adoption. * 5+ years of experience preparing structured and unstructured data for data science, analytics, machine learning, or AI-enabled applications. * 4+ years of experience with containerization and orchestration technologies such as Docker and Kubernetes; experience with shell scripting in Bash, Unix, or Windows shell is preferred. * Experience working with a variety of databases, including but not limited to vector databases, graph databases, relational databases, and NoSQL stores. * Experience using machine learning or AI in data pipelines to discover, classify, enrich, standardize, and clean data. * Experience implementing CI/CD with automated testing in Jenkins, GitHub Actions, GitLab CI/CD, or similar tooling. * Familiarity with AWS or other cloud services such as AWS Glue, Athena, Lambda, S3, and DynamoDB. * Demonstrated experience implementing the data management lifecycle using data quality functions such as standardization, transformation, rationalization, linking, matching, monitoring, and stewardship. ## Description In this role, you will design and operate the pipelines, data assets, semantic models, search and retrieval layers, and platform patterns that make trusted data available for analytics, AI agents, and operational decision-making. You will partner with domain experts and with AI, Platform, and Business Analytics teams to turn business problems into scalable data and AI-enablement solutions. You are a thoughtful technical leader who enjoys investigating business needs, building production-grade systems, and teaching other teams how to adopt the capabilities and products you create. You Will * As the senior technical engineer, design and implement highly efficient, reusable, and scalable data processing systems and pipelines across the tech stack, including Kubernetes, Databricks, Snowflake, and related cloud services. * Help define platform patterns for AI-ready data products, including governed data assets, semantic models, vector and search capabilities, retrieval patterns, and integration points for Snowflake, Databricks, and other AI-enabled workflows. * Support Snowflake AI initiatives by evaluating, implementing, and operationalizing capabilities such as Cortex Analyst, Cortex Search, Cortex Agents, Cortex Code, Cortex Sense, and related AI/LLM-enabled data engineering features. * Support Databricks requests from data engineering and analytics teams, including job orchestration, reusable pipeline patterns, performance tuning, production troubleshooting, workspace standards, and best-practice guidance. * Use and evaluate AI-assisted engineering tools such as Claude, Claude CLI, GitHub Copilot, and related agentic tooling to improve delivery while maintaining secure, reviewed, and reliable engineering practices. * Design with test-driven development and implement technical solutions to ensure data reliability, accuracy, observability, and operational resilience. * Develop data models and mappings, build new data assets required by users, and perform exploratory data analysis on existing products and datasets. * Educate data engineering teams in adopting new data patterns, platform capabilities, AI-enablement approaches, and tools. * Understand trends and emerging technologies, including the shift toward multi-agent engineering environments, and evaluate the performance and applicability of potential tools for Grainger requirements. * Work within an Agile delivery / Kanban methodology to deliver product increments in iterative cycles. * Work with product and business partners to define roadmap, communication, architecture, adoption plans, and support models. * Mentor junior team members and help raise the technical bar for data engineering practices across the organization. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [WeAreDevelopers LIVE - Node and Package Security](https://www.wearedevelopers.com/videos/2138-wearedevelopers-live-node-and-package-security) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [NoSQL Data Modeling for Front-end Developers](https://www.wearedevelopers.com/videos/297-nosql-data-modeling-for-front-end-developers) - [The Time Paradox: Building Timezone-Safe Python/Django Applications](https://www.wearedevelopers.com/videos/1915-the-time-paradox-building-timezone-safe-python-django-applications) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)