> Markdown version of [/jobs/ext/623998-data-engineer](https://www.wearedevelopers.com/jobs/ext/623998-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** iManage LLC - **Location:** Chicago, IL, United States - **Experience:** Expert - **Salary:** $120,000.0 - $160,000.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Agile Methodology, Artificial Intelligence, Continuous Integration, Information Engineering, Data Governance, Extract Transform Load (ETL), Software Debugging, Github, Machine Learning, Systems Development Life Cycle, Power BI, Salesforce.Com, Enterprise Data Management, Datadog, Data Ingestion, Apache Spark, Data Lakes, Pyspark, Information Technology, Collibra, Apache Kafka, Zendesk, Terraform, Stream Processing, Databricks - **Published:** June 12, 2026 - **Apply:** http://imanagecom.applytojob.com/apply/jobs/details/wQQWe8YUOB ## About the Role * A Bachelor's degree or higher in Computer Science or equivalent field. * 5-7 years of experience in data engineering, with a strong track record building and operating production-grade pipelines. * Hands-on production experience with Databricks, Delta Lake, and medallion architecture. * Familiarity with Terraform for infrastructure as code. * An understanding of CI/CD practices, specifically using GitHub Actions and Databricks Asset Bundles (DABs) for pipeline deployment and automation. * A deep expertise in PySpark. You know how to tune, debug, and scale distributed workloads at scale. * Strong data modeling skills, including building star schemas in gold layers to support AI, analytical, and reporting workloads. * A strong engineering mindset. You enjoy independently working through hard problems and are equally comfortable walking the team through how you got there. * Comfort working across organizational boundaries with data analysts, data scientists, and business stakeholders. * A passion to understand data requirements and deliver scalable, robust solutions that meet those requirements. * A passion to be a thought leader and work collaboratively within a team. * A creative mindset with a desire to explore new technologies and create innovative solutions. Bonus Points If I Have... * Experience with one or more tools for real-time data streaming, such as Microsoft Event Hub or Apache Kafka. * Experience with platform migrations, particularly Synapse to Databricks or similar Lakehouse transitions. * Exposure to data governance, lineage, or observability tooling such as Informatica and Collibra. ## Description iManage runs on data. iMData, our Enterprise Data Platform, is the engine that powers business decisions across the company. We're looking for a Senior Data Engineer to join this team and own the platform and pipelines that keep that engine running. As a Senior Data Engineer on the Enterprise Data team, you own the technical side of the iMData platform. You are excited about the big picture of how our data can work together to deliver incredible insights, not just about point-in-time data ingestion. You are passionate about mentoring junior team members and helping them grow. You're comfortable engaging directly with business stakeholders, gathering requirements firsthand, and crafting solutions that deliver critical data to best meet their requirements. You're a self-starter who can independently take an ambiguous problem, break it down, and drive it to completion. You'll partner with your manager and Machine Learning Engineers to architect, design and build our Databricks data platform and our Databricks MCP connector. iM Responsible For… * Using PySpark to extract, transform, and load data into our Enterprise Data Platform using a medallion architecture. * Designing gold layer star schemas to support AI, analytical, and reporting workloads. * Serving as a technical lead and mentor for junior and mid-level data engineers on the team. * Defining and advocating for engineering best practices: code standards, testing, documentation, and pipeline design patterns. * Learning and using system-specific APIs to extract data from a wide-variety enterprise SaaS applications, including Salesforce and Zendesk. * One time migration of pipelines, Spark notebooks, triggers, data models, and Power BI dashboards from Microsoft Synapse to Azure Databricks. * Gathering data requirements from various business stakeholders and translating these requirements into deliverables which provide optimum value to the business. * Working in an agile fashion aligned with our team Agile Methodologies. * Applying best practices to ensure the security and privacy of the data repositories. * Developing CI/CD workflows to enhance our SDLC. * Maintaining and improving our Infrastructure as Code using Terraform. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [The OpenTelemetry mistakes I keep seeing (and how to stop making them)](https://www.wearedevelopers.com/videos/100158-the-opentelemetry-mistakes-i-keep-seeing-and-how-to-stop-making-them) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)