Lead Data Engineer

Mastercard
Miami, FL, United States
29 days ago
Apply on mastercard.wd1.myworkdayjobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$140,000.0 - $231,000.0
Working hours
Regular working hours

Tech stack

Airflow Amazon Web Services Amazon S3 Apache HTTP Server Automation of Tests Cloud Computing Cloud Engineering Cyber Security Continuous Integration Data Architecture Information Engineering Data Governance
+10 more
Data Infrastructure DevOps Distributed Computing Environment Meta-Data Management Cloud Services Apache Spark Build Management Pyspark Cloudwatch Data Pipelines

Job description

We are seeking a Lead Data Engineer with expertise in Apache Spark, Apache Iceberg, Apache Airflow, and AWS to design and build the next generation of our finance data platform. You will own finance-focused data products while contributing to foundational platform capabilities and engineering standards that scale across the enterprise., Data Products

  • Design, develop, and maintain data products
  • Ensure data products meet quality, auditability, lineage, and compliance standards

Platform Engineering & Framework Development

  • Build reusable data engineering frameworks and accelerators used across multiple teams
  • Develop standardized patterns for ingestion, transformation, orchestration, monitoring, and data quality
  • Establish and enforce best practices for Spark, Iceberg, Airflow, and cloud-native engineering
  • Drive adoption of self-service platform capabilities and common engineering standards
  • Build and optimize Apache Iceberg-based lakehouse solutions for analytical and operational workloads

Cloud Engineering

  • Build cloud-native solutions on AWS - S3, EMR, Glue, Lambda, ECS/EKS, CloudWatch
  • Implement CI/CD pipelines, automated testing, and Infrastructure-as-Code, All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
  • Abide by Mastercard’s security policies and practices;
  • Ensure the confidentiality and integrity of the information being accessed;
  • Report any suspected information security violation or breach, and
  • Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.

Requirements

The ideal candidate is a hands-on engineer who thrives in modern Lakehouse architecture, large-scale pipeline development and analytical mindset., * 8+ years of experience in data engineering, data platform development, or related technical roles.

  • Leading design and implementation of scalable enterprise data solutions and reusable engineering frameworks
  • Knowledge of data mesh or data product architectures in enterprise settings.
  • Advanced hands-on experience with Apache Spark (PySpark) and distributed data processing at enterprise scale.
  • Deep hands-on experience with Apache Iceberg or similar open table formats
  • Solid understanding of CI/CD pipelines, infrastructure-as-code and DevOps practices.
  • Experience with data governance, data quality frameworks, and metadata management tools.
  • Strong experience with AWS Cloud services, including services such as Amazon S3, EMR, Glue, Lambda, ECS/EKS, and CloudWatch for developing, deploying, and managing cloud-native data solutions.

Benefits & conditions

In line with Mastercard’s total compensation philosophy and assuming that the job will be performed in the US, the successful candidate will be offered a competitive base salary and may be eligible for an annual bonus or commissions depending on the role. The base salary offered may vary depending on multiple factors, including but not limited to location, job-related knowledge, skills, and experience. Mastercard benefits for full time (and certain part time) employees generally include: insurance (including medical, prescription drug, dental, vision, disability, life insurance); flexible spending account and health savings account; paid leaves (including 16 weeks of new parent leave and up to 20 days of bereavement leave); 80 hours of Paid Sick and Safe Time, 25 days of vacation time and 5 personal days, pro-rated based on date of hire; 10 annual paid U.S. observed holidays; 401k with a best-in-class company match; deferred compensation for eligible roles; fitness reimbursement or on-site fitness facilities; eligibility for tuition reimbursement; and many more. Mastercard benefits for interns generally include: 56 hours of Paid Sick and Safe Time; jury duty leave; and on-site fitness facilities in some locations.

Pay Ranges Miami, Florida: $140,000 - $231,000 USD

About the company

Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on mastercard.wd1.myworkdayjobs.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · World Congress 2026 Europe

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:14 min

Structuring career paths and localized data architectures

Ulrich Wurstbauer +1 · LIVE

3:18 min

Scaling global network engineering through DevOps culture

Stuart Clark · LIVE

Videos

See all

Related articles

See all