> Markdown version of [/jobs/ext/1315769-data-engineer-periscope](https://www.wearedevelopers.com/jobs/ext/1315769-data-engineer-periscope). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - Periscope - **Company:** Periscope By Mckinsey - **Location:** United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Airflow, Microsoft Azure, Big Data, Cloud Computing, Cloud Engineering, Continuous Integration, Information Engineering, Data Governance, Extract Transform Load (ETL), Apache Hive, Python (Programming Language), SQL Databases, Software Organization, Azure Data Factory, Apache Spark, Modularization, Information Technology, Data Management, Code Restructuring, Data Pipelines, Serverless Computing, Databricks - **Published:** July 17, 2026 - **Apply:** https://www.dice.com/job-detail/ab6b904e-eebd-4329-abd5-70ac3272e171 ## About the Role Do you want to do work that matters, alongside supportive leaders who will help you grow faster than you ever thought possible? Are you a creative problem-solver who is energized by challenges? You've come to the right place., * Bachelor's or master's degree in computer science, engineering or a related field * 6+ years of experience in data engineering, with a strong background in big data technologies * Proficiency in Databricks on Azure, Spark, Python, and Spark SQL * Extensive experience with Delta Live Tables, Unity Catalog, Delta Sharing, and SQL Warehouse (server and serverless) * Experience in handling large data volumes and orchestrating automated ETL using Azure Data Factory, Airflow / data pipelines using CI/CD and Cloud Technologies * Development efficiency leveraging AI framework technologies * Demonstrated ability to optimize performance and cost in large-scale data environments * Proven track record of leading projects independently and mentoring junior team members * Experience with cloud platforms, particularly Azure, and a solid understanding of cloud-native architectures * Experience adopting software development best practices (e.g., modularization, testing, refactoring, etc.) * Experience with data governance, security, and compliance in a cloud environment * Familiarity in understanding BI framework Please review the additional requirements regarding essential job functions of McKinsey colleagues. Our unwavering commitment to integrity drives everything we do, guiding us to always act in the best interests of our clients, our people, and the communities we serve. ## Description You will be a core member of Periscope's technology team with responsibilities that range from developing and deploying our core enterprise products to ensuring that McKinsey's craft and expertise remain on the leading edge of technology. In this role you will design, develop, and maintain scalable data pipelines and systems using Databricks on Azure (among other environments). You will implement and optimize ETL processes with a focus on performance, cost-efficiency, and reliability. You will utilize advanced Databricks technologies (DLT, Unity Catalog, Delta Sharing, SQL Warehouse) to enhance data management and sharing capabilities. You will be leading and executing data engineering projects from inception to completion, ensuring timely delivery and high quality while you continuously monitor, troubleshoot, and improve data pipelines and workflows to ensure optimal performance and cost-effectiveness. You will collaborate with cross-functional teams to understand data needs and deliver solutions that meet business requirements, mentor, and educate junior engineers on best practices, emerging technologies, and efficient data engineering techniques. You will also work with client facing teams to help solve and deploy client specific solutions that integrate into the client's internal systems. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)