> Markdown version of [/jobs/ext/1794153-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/1794153-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Lead Data Engineer

- **Company:** Mastercard
- **Location:** Miami, FL, United States
- **Experience:** Expert
- **Salary:** $140,000.0 - $231,000.0
- **Contract:** Permanent contract
- **Skills:** Airflow, Amazon Web Services, Amazon S3, Apache HTTP Server, Automation of Tests, Cloud Computing, Cloud Engineering, Cyber Security, Continuous Integration, Data Architecture, Information Engineering, Data Governance, Data Infrastructure, DevOps, Distributed Computing Environment, Meta-Data Management, Cloud Services, Apache Spark, Build Management, Pyspark, Cloudwatch, Data Pipelines
- **Published:** July 16, 2026
- **Apply:** https://mastercard.wd1.myworkdayjobs.com/CorporateCareers/job/Miami-Florida/Lead-Data-Engineer_R-282473

## About the Role

The ideal candidate is a hands-on engineer who thrives in modern Lakehouse architecture, large-scale pipeline development and analytical mindset., * 8+ years of experience in data engineering, data platform development, or related technical roles.

 * Leading design and implementation of scalable enterprise data solutions and reusable engineering frameworks
 * Knowledge of data mesh or data product architectures in enterprise settings.
 * Advanced hands-on experience with Apache Spark (PySpark) and distributed data processing at enterprise scale.
 * Deep hands-on experience with Apache Iceberg or similar open table formats
 * Solid understanding of CI/CD pipelines, infrastructure-as-code and DevOps practices.
 * Experience with data governance, data quality frameworks, and metadata management tools.
 * Strong experience with AWS Cloud services, including services such as Amazon S3, EMR, Glue, Lambda, ECS/EKS, and CloudWatch for developing, deploying, and managing cloud-native data solutions.

## Description

We are seeking a Lead Data Engineer with expertise in Apache Spark, Apache Iceberg, Apache Airflow, and AWS to design and build the next generation of our finance data platform. You will own finance-focused data products while contributing to foundational platform capabilities and engineering standards that scale across the enterprise., Data Products

 * Design, develop, and maintain data products
 * Ensure data products meet quality, auditability, lineage, and compliance standards

Platform Engineering & Framework Development

 * Build reusable data engineering frameworks and accelerators used across multiple teams
 * Develop standardized patterns for ingestion, transformation, orchestration, monitoring, and data quality
 * Establish and enforce best practices for Spark, Iceberg, Airflow, and cloud-native engineering
 * Drive adoption of self-service platform capabilities and common engineering standards
 * Build and optimize Apache Iceberg-based lakehouse solutions for analytical and operational workloads

Cloud Engineering

 * Build cloud-native solutions on AWS - S3, EMR, Glue, Lambda, ECS/EKS, CloudWatch
 * Implement CI/CD pipelines, automated testing, and Infrastructure-as-Code, All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
 * Abide by Mastercard's security policies and practices;
 * Ensure the confidentiality and integrity of the information being accessed;
 * Report any suspected information security violation or breach, and
 * Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)
- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [Why Attend a Developer Event in 2026?](https://www.wearedevelopers.com/magazine/688-why-attend-a-developer-event-in-2026)