> Markdown version of [/jobs/ext/2735893-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/2735893-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Mastercard - **Location:** O'Fallon, MO, United States - **Experience:** Expert - **Salary:** $115,000.0 - $184,000.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Artificial Intelligence, Amazon Web Services, Business Analytics Applications, Big Data, Cloud Computing, Cyber Security, Information Systems, Information Engineering, Data Governance, Data Integrity, Extract Transform Load (ETL), Data Warehousing, Distributed Computing Environment, Apache Hadoop, Python (Programming Language), PostgreSQL, Machine Learning, Oracle (Applications), Pattern Recognition, Tensorflow, Scala (Programming Language), SQL Databases, Enterprise Data Management, Data Processing, Sql Optimization, Pytorch, Apache Spark, Deep Learning, Generative AI, Containerization, Data Lakes, Information Technology, Apache Nifi, Data Management, Data Pipelines, Databricks - **Published:** September 5, 2026 - **Apply:** https://www.wayup.com/i-j-Senior-Data-Engineer-Mastercard-949339264044527/ ## About the Role Essential Knowledge, Skills, and Experience * Have advanced experience designing and developing scalable data pipelines using Spark, Scala, Python, Java, Databricks, and AWS Services. * Possess strong expertise in data engineering, data quality frameworks, data warehousing, ETL/ELT processes, Nifi and large-scale distributed data processing environments. * Demonstrate advanced SQL skills and experience working with technologies such as Oracle, PostgreSQL, Iceberg, Ozone, Hadoop, and object storage platforms. * Have experience implementing data quality controls, validation frameworks, observability, monitoring, and incident resolution processes to improve data reliability and trust. * Be a strong communicator and collaborator, capable of working effectively with Data Strategists, Data Stewards, Product Owners, Architects, and Engineering teams to deliver business outcomes. * Desirable or Additional Capabilities * Experience applying Artificial Intelligence (AI), Machine Learning (ML), statistical modeling, and anomaly detection techniques to data quality, monitoring, and operational efficiency use cases. * Familiarity with Deep Learning concepts, predictive analytics, pattern recognition, and AI/ML frameworks such as TensorFlow, PyTorch, or similar technologies. * Experience leveraging Generative AI and AI-assisted development tools to improve engineering productivity, automate processes, accelerate delivery, and enhance solution quality. * Demonstrate intellectual curiosity, a growth mindset, and a passion for continuous learning, innovation, and evaluating emerging technologies to solve complex business and data challenges. Education * Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, Mathematics, or a related technical field, or equivalent practical experience. * Relevant cloud, data engineering, big data, AI/ML, or analytics certifications are a plus. ## Description * Design, develop, and maintain scalable, high-performance data pipelines using Spark, Scala/Python/Java, Databricks, Hadoop, and cloud-native technologies to support enterprise data and analytics platforms. * Partners with Data Strategists, Data Stewards, Product Owners, Architects, and Engineering teams to solve complex data challenges and deliver enterprise data quality and data engineering solutions. * Implement and support data quality frameworks, validation controls, monitoring, observability, and automated remediation capabilities to improve data trust, reliability, and business outcomes. * Develop and optimize data processing solutions using AWS services, SQL, data warehouses, and data lakes while ensuring performance, scalability, security, and operational excellence. * Apply AI/ML techniques, anomaly detection, predictive analytics, and statistical modeling to enhance data quality monitoring, intelligent threshold recommendations, alert reduction, and root cause analysis. * Perform production support, troubleshoot complex data issues, conduct root cause analysis, and independently resolve incidents while maintaining platform stability and service reliability. * Contribute to architecture, engineering standards, and continuous innovation by evaluating emerging technologies, Generative AI capabilities, and best practices that improve data quality, developer productivity, and operational efficiency. All About You, All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must: + Abide by Mastercard's security policies and practices; + Ensure the confidentiality and integrity of the information being accessed; + Report any suspected information security violation or breach, and + Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Machine learning in the browser with TensorFlowjs](https://www.wearedevelopers.com/videos/155-machine-learning-in-the-browser-with-tensorflowjs) - [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Developing an AI.SDK](https://www.wearedevelopers.com/videos/198-developing-an-ai-sdk) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)