Senior Data Engineer
Publicis Groupe
Chicago, United States of America
3 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
$ 104KJob location
Chicago, United States of America
Tech stack
Sql Data Warehouse
Amazon Web Services (AWS)
Big Data
Cloud Database
Code Review
Continuous Integration
Information Engineering
Data Governance
ETL
Data Migration
Relational Databases
Python
Performance Tuning
Query Optimization
Cloud Services
SQL Databases
Data Processing
Sql Optimization
Spark
GIT
Containerization
Information Technology
Amazon Web Services (AWS)
Software Version Control
Data Pipelines
Redshift
Databricks
Job description
- Design, build, and maintain scalable ETL and ELT pipelines based on business requirements, user stories, and architectural standards.
- Assemble, transform, and manage large, complex datasets using cloud-native technologies (AWS, Databricks, Amazon Redshift) and SQL-based processing.
- Design and maintain relational data models to support analytics, reporting, and downstream consumption.
- Lead performance, reliability, and scalability efforts across the data platform, including monitoring, tuning, and optimization of pipelines and workloads.
- Develop and maintain Databricks solutions leveraging Spark, Delta Tables, and managed workflows (jobs, orchestration).
- Implement data governance and access controls using Unity Catalog and platform best practices.
- Use Git-based version control to manage code, support peer collaboration, and enable CI/CD workflows.
- Lead and support data platform migrations into Databricks, including legacy warehouse modernization and pipeline refactoring.
- Mentor and train junior data engineers through code reviews, technical coaching, and knowledge sharing.
- Create clear, accurate, and maintainable technical documentation.
- Participate in on-call rotation and provide escalation support for production issues as needed.
Requirements
- Bachelor's degree in Information Technology, Computer Science, Engineering, or a related field.
- 4+ years of experience in data engineering or a related role.
- Strong hands-on experience with ETL/ELT frameworks and cloud data platforms (e.g., Databricks, AWS Glue, Amazon Redshift).
- Strong experience with relational databases and advanced SQL, including schema design, joins, window functions, performance tuning, and query optimization-particularly in Amazon Redshift or comparable cloud data warehouses.
- Proficiency in Python for data processing, automation, and pipeline development.
- Deep hands-on experience with Databricks, including Spark optimization, Delta Tables, and Unity Catalog.
- Experience migrating data pipelines and workloads into Databricks from legacy or cloud data warehouse platforms (plus).
- Databricks certifications (e.g., Data Engineer Associate or Professional) a plus.
- Proficiency with Git and version control best practices in a collaborative development environment.
- Proven ability to mentor junior engineers and promote engineering best practices across the team.
- Excellent communication skills, with the ability to clearly explain technical concepts to technical and non-technical stakeholders.
- Strong customer service mindset with the ability to translate business needs into reliable, scalable data solutions.
- Highly organized, self-motivated, and able to manage multiple priorities in a fast-paced environment.
- Digital media or ad tech experience, especially in data-centric roles, is a plus