> Markdown version of [/jobs/ext/1727102-manager-data-engineering](https://www.wearedevelopers.com/jobs/ext/1727102-manager-data-engineering). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Manager, Data Engineering - **Company:** Publicis Groupe - **Location:** New York, NY, United States - **Experience:** Experienced - **Salary:** $88,540.0 - **Contract:** Temporary contract - **Skills:** Amazon Web Services, Data Analysis, Computing Platforms, Automation of Tests, Microsoft Azure, Big Data, Code Review, Data Architecture, Information Engineering, Extract Transform Load (ETL), Data Security, Data Warehousing, Database Queries, Distributed Data Store, Python (Programming Language), Performance Tuning, Query Optimization, Power BI, User Defined Functions, DataOps, SQL Stored Procedures, SQL Databases, Tableau (Software), Software Organization, Snowflake, Apache Spark, Database Performance, Git, Data Lakes, Pyspark, Data Lineage, Star Schema, Front End Software Development, Restful APIs, Data Pipelines, Databricks - **Published:** July 14, 2026 - **Apply:** https://www.manhattanjobs.com/job.asp?id=3319201805&tx=FJ1512FFK&pt=1&aff=0B19D771-A501-4A5E-8338-2A822B784D54&utm_source=Job%20Feed&utm_medium=textkernel&utm_campaign=DE&utm_term=0B19D771-A501-4A5E-8338-2A822B784D54 ## About the Role Our team is looking for a high-performing Data Engineer who will be responsible for the design, development, implementation and on-going support of a data driven software platform. You enjoy and thrive in a fast-paced environment on multiple projects simultaneously, including both enhancements as well as new project development. The candidate must be a self-starter with a sense of urgency and a commitment to quality and professionalism., * 5+ years of professional experience in Data Engineering. * 5+ years of advanced SQL development writing complex queries, CTEs, window functions, stored procedures, and performance tuning. * 4+ years of experience with Snowflake, designing and creating objects and optimizing for best performance * 3+ years of experience with Databricks and PySpark building scalable distributed data pipelines. * Strong Python programming skills for data engineering and automation. * Experience designing high-performance ELT/ETL pipelines processing large-scale datasets. * Strong understanding of dimensional data modeling, data warehousing concepts, and lakehouse architecture. * Strong understanding of data quality, testing, monitoring, and observability. * Experience working with Git and modern software development practices. * Excellent analytical, troubleshooting, and performance tuning skills. * Strong communication and collaboration skills with both technical and non-technical stakeholders. * Ability to manage multiple priorities in a fast-paced environment. Preferred Experience * Strong experience with Snowflake as an enterprise data warehouse. * Experience building scalable data pipelines using Databricks and Apache Spark (PySpark). * Experience with Delta Lake, Unity Catalog, and modern lakehouse architectures. * Experience with Business Intelligence tools such as Tableau or Power BI. * Experience integrating REST APIs and third-party data sources. * Experience supporting analytics and data science teams. * Experience with CI/CD pipelines and Git-based development workflows. * Experience with cloud platforms (AWS, Azure, or GCP) is preferred, with AWS experience considered a plus rather than a primary requirement. ## Description * Analyze complex and ambiguous business requirements and partner with product, analytics, and engineering teams to design scalable data solutions. * Design, develop, and optimize complex SQL transformations and data pipelines in Snowflake and Databricks. * Build and maintain high-performance ELT/ETL pipelines using PySpark, SQL, and Python for large-scale data processing. * Develop advanced Snowflake database objects including: Stored Procedures, User Defined Functions (UDFs), Views, Tasks, Streams, Dynamic Tables * Design scalable data models (fact/dimension, star schema, normalized) to support reporting, analytics, and downstream applications. * Optimize Snowflake warehouse performance through query tuning, clustering, partitioning strategies, and cost optimization. * Design, build, test, monitor, troubleshoot, and maintain robust data pipelines in Databricks using Delta Lake and PySpark. * Ensure data quality through validation frameworks, automated testing, monitoring, and alerting. * Troubleshoot data pipeline and database performance issues, perform root cause analysis, and implement long-term solutions. * Collaborate with frontend, analytics, and data science teams to deliver trusted datasets and optimize data access patterns. * Develop reusable SQL frameworks and coding standards to improve maintainability and consistency. * Create technical documentation, data lineage, and knowledge transfer materials. * Participate in code reviews and promote SQL, PySpark, and data engineering best practices. * Serve as an escalation point for production issues and provide technical leadership for complex data initiatives. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Highest Paying Tech Companies in Europe](https://www.wearedevelopers.com/magazine/162-highest-paying-tech-companies-in-europe)