> Markdown version of [/jobs/ext/2720836-data-engineer](https://www.wearedevelopers.com/jobs/ext/2720836-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Arrive Logistics - **Location:** Chicago, IL, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Sql Data Warehouse, Artificial Intelligence, Airflow, ARM Architecture, Audit Trail, Microsoft Azure, BigQuery, Computer Programming, Continuous Integration, Data Validation, Information Engineering, Data Governance, Data Security, Data Systems, Data Warehousing, Cursor (Graphical User Interface Elements), Monitoring of Systems, Python (Programming Language), Machine Learning, Enterprise Messaging Systems, Role-Based Access Control, Power BI, SQL Databases, Systems Integration, Data Processing, Snowflake, Prompt Engineering, Event Driven Architecture, Information Technology, Real Time Data, Apache Kafka, Machine Learning Operations, Domain Driven Design, Data Pipelines, Databricks, Microservices - **Published:** September 4, 2026 - **Apply:** https://startup.jobs/senior-data-engineer-arrive-logistics-9021954 ## About the Role * Bachelor's degree in Computer Science, Engineering, or a related field or equivalent professional experience. * 5+ years experience in data engineering. * Expert proficiency in SQL and strong programming skills in Python. * Proven experience building and orchestrating data pipelines using dbt and Airflow * Hands-on experience developing data solutions in a major cloud environment, with a strong preference for Microsoft Azure. * Solid understanding of BI-tooling integrations with a cloud data warehouse, with a strong preference for PowerBI * Solid understanding of event-driven architecture and the use of messaging systems like Kafka to enable real-time data flow. * Experience with a modern cloud data warehouse like Snowflake, Databricks, BigQuery, or Redshift. * Familiarity with CI/CD, microservice architecture, domain driven design, data contracts * Solid understanding with best practices around data security/privacy, role-based access control * Experience with machine learning concepts, frameworks, and infrastructure * Excellent written and oral communication and presentation skills ## Description * Design, build, and optimize robust, scalable, and reliable data pipelines to ingest and process data from a wide variety of sources. * Develop and maintain our data warehousing solutions (e.g. Snowflake), including maintenance of an advanced RBAC model to ensure data governance throughout all data tooling. * Ensure data quality and integrity by implementing data validation frameworks, monitoring systems, and anomaly detection protocols. * Architect and manage cloud-based data infrastructure. * Orchestrate batch machine learning pipelines. Work closely with data scientists to orchestrate code based on data science and product requirements, getting alignment on optimizations when necessary. * Collaborate with stakeholders, including data scientists, analysts, and product managers to understand data requirements and deliver actionable solutions. * Improve performance, efficiency and optimize cost of existing data systems and processes. * Work alongside Data and Engineering leadership to weigh tradeoffs in build vs buy decisions and tradeoffs in product roadmap vs technical initiatives. * Work with internal software engineering teams to define architectures and best practices for ingesting data into the data warehouse and making aggregated data and metrics from the data warehouse available to our production applications. * Interact with vendors to craft the adoption of new technology and infrastructure for the team. * Designs, develops, and evaluates AI agents and reusable skill libraries to drive developer productivity and automate team workflows - including prompt engineering, tool integration, and performance evaluation using platforms such as Snowflake Cortex AI and LangGraph. * Architects and governs secure integrations between enterprise AI tools (Claude, Cursor, Gemini, Slack, etc.) and the data warehouse, ensuring data access controls, auditability, and compliance standards are maintained across the AI toolchain. * Take part in an on-call rotation. Work with Engineering leadership to define SLAs and alerting policies for our systems. * Lead and participate in incident management, ensuring clear and timely communication with stakeholders. * Write new and enhance existing technical and functional documentation on Data Engineering-owned systems and standards. Proactively address gaps in existing team standards, SLAs, operating principles, and documentation and work with leadership to scope and implement improvements in these areas. * Be a leader, mentor, and subject matter expert for the team, stakeholders, and peers. Foster a collaborative environment that drives solutions forward at a larger scope. ## Related Videos - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Beyond Dashboards: Fixing Text-to-SQL with Semantic RAG](https://www.wearedevelopers.com/videos/2036-beyond-dashboards-fixing-text-to-sql-with-semantic-rag) - [Making Data Warehouses fast. A developer's story.](https://www.wearedevelopers.com/videos/302-making-data-warehouses-fast-a-developer-s-story) - [Data Analytics with Microsoft Fabric: End-to-End Use Case with Data Agents](https://www.wearedevelopers.com/videos/1547-data-analytics-with-microsoft-fabric-end-to-end-use-case-with-data-agents) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)