> Markdown version of [/jobs/ext/1663016-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/1663016-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Eliassen Group - **Location:** Chicago, IL, United States - **Experience:** Expert - **Salary:** $145,600.0 - $166,400.0 - **Contract:** Permanent contract - **Skills:** Agile Methodology, Airflow, Amazon Web Services, Microsoft Azure, Big Data, Cloud Computing, Cloud Computing Security, Cloud Database, Code Review, Continuous Integration, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Data Security, Data Sharing, Data Warehousing, Relational Databases, Dimensional Modeling, Distributed Computing Environment, Distributed Data Store, Distributed Systems, Python (Programming Language), Key Management, Performance Tuning, Scrum Methodology, Zero Trust Network Access, Scala (Programming Language), Software Engineering, SQL Databases, Software Testing Automation Framework, Data Streaming, Tokenization, Workflow Management Systems, Privacy Controls, Data Processing, Data Classification, Sql Optimization, Grafana, Apache Spark, Git, Data Lakes, Software Version Control, Data Pipelines, Serverless Computing, Docker, Databricks - **Published:** July 23, 2026 - **Apply:** https://www.juju.com/job/00000000gilixb ## About the Role + 5+ years of data engineering with strong Scala and Apache Spark on AWS and/or GCP. + Strong Python for pipelines, tooling, automation, and infrastructure modules. + Advanced SQL across RDBMS, cloud data warehouses, and lakehouse platforms with TB-scale datasets. + Designing and maintaining batch and streaming data pipelines. + Data warehousing, dimensional modeling, data quality, partitioning, and performance optimization. + Distributed processing and modern lakehouse architectures such as Databricks, Delta Lake, or Apache Spark. + Operating distributed data platforms at scale. + Workflow orchestration with Airflow, Databricks Workflows, AWS Step Functions, or equivalent. + Source control with Git and test automation frameworks. + Cloud-native development on AWS and/or GCP. + Software engineering practices including CI/CD, code reviews, observability, and production support. + Ownership of features and pipelines with cross-team collaboration and mentoring. + Trusted environment execution with clean rooms or secure data-sharing platforms handling PII and regulated data. + Fine-grained access controls, governance policies, and policy-based enforcement for sensitive datasets. + Privacy-preserving techniques such as tokenization, pseudonymization, aggregation-before-export, and differential privacy concepts. + Experience with clean-room, measurement, attribution, audience analytics, or privacy-preserving reporting solutions. + Understanding of trust boundaries, secure data-sharing patterns, and zero-trust principles. + Encryption, key management, and secure handling of sensitive data with cloud-native services. + Observability and alerting to detect anomalous data movement and potential leakage events. + Strong understanding of cloud-native security and governance. + Good to have: Databricks, AWS Clean Rooms, advertising measurement platforms, collaboration with Security/Privacy/Risk/Compliance, ELK/Grafana/OpenTelemetry, Docker and Kubernetes, lineage and governance tooling, and documenting data contracts and flows. + Strong written and verbal English communication skills. + Experience with Agile or SCRUM in cross-functional product teams. _Recruitment Transparency Notice_ ## Description Our client seeks a Senior Data Engineer to design, build, and operate large-scale data processing for attribution, measurement, forecasting, and privacy-preserving analytics. You will develop Scala and Spark solutions on cloud platforms, implement governance and privacy controls, and partner with cross-functional teams to deliver secure, reliable data products., + Develop and optimize large-scale data processing solutions using Scala, Spark, and SQL on modern data platforms. + Build and operate trusted data pipelines across secure cloud environments such as AWS, GCP, or Azure. + Partner with Product, Data Science, Security, Privacy, and Platform Engineering to deliver privacy-preserving features. + Build, schedule, and maintain scalable batch and streaming data workflows with orchestration frameworks. + Implement data classification, access controls, and privacy-preserving techniques aligned to compliance requirements. + Contribute to clean-room and trusted data-sharing environments with approved aggregated outputs. + Create observability, monitoring, and operational tooling for reliability and compliance. + Troubleshoot complex performance and pipeline issues across distributed systems. + Contribute to technical design, best practices, and operational excellence. + Mentor junior engineers and perform thorough code reviews. + Continuously improve attribution, measurement, forecasting, and privacy-preserving analytics capabilities. + Operate pipelines within trusted environments, clean rooms, or secure data-sharing platforms across cloud and on-premises. + Apply access controls, data classification, lineage, and governance for PII, PCI, and confidential signals. + Follow data handling standards with Security, Privacy, and Compliance teams to keep sensitive data within trust boundaries. + Enforce aggregation, anonymization, tokenization, and approved outputs for data leaving trusted environments. + Build monitoring and alerting to detect anomalous data movement and policy violations. + Apply privacy-preserving computation when outputs cross trust boundaries, including aggregation-before-export, pseudonymization, tokenization, differential privacy concepts, and privacy-aware reporting. + Implement encryption, key management, and secure handling with cloud-native security services. + Document trust boundaries, data contracts, lineage, and permitted data movement. + Support audits, compliance requirements, governance reviews, and secure data-sharing initiatives. + Participate in architecture and design reviews to embed governance, privacy, lineage, and trust-boundary requirements. + Contribute to engineering standards for secure data processing and trusted platform operations. ## Related Videos - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [5 steps for running a Kubernetes environment at scale](https://www.wearedevelopers.com/videos/88-5-steps-for-running-a-kubernetes-environment-at-scale) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)