> Markdown version of [/jobs/ext/2373255-data-engineer](https://www.wearedevelopers.com/jobs/ext/2373255-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** SMBC Group - **Location:** United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Data Analysis, Microsoft Azure, Cloud Engineering, Information Systems, Continuous Integration, Information Engineering, Data Governance, Data Infrastructure, Extract Transform Load (ETL), Distributed Computing Environment, Github, Python (Programming Language), Machine Learning, SQL Azure, Performance Tuning, SQL Databases, Azure Data Factory, Data Lakes, Pyspark, Information Technology, Data Lineage, Data Management, Machine Learning Operations, Restful APIs, Data Pipelines, Serverless Computing, Databricks - **Published:** August 12, 2026 - **Apply:** https://www.dice.com/job-detail/ec1e0138-3b69-4dd3-8162-97c72565531e ## About the Role * Bachelor's or Master's degree in Computer Science, Engineering, Data Science, Information Systems, or a related field. * 7+ years of experience in Data Engineering, Data Platform Development, or Analytics Engineering. * Strong hands-on experience with: Azure Data Factory, Databricks, PySpark, Python, SQL, Delta Lake, GitHub and CI/CD Experience building cloud-native and distributed data processing solutions. Strong understanding of ETL/ELT architectures, data modeling, data governance, and data quality frameworks. Knowledge of AI/ML concepts, machine learning lifecycle management, and model operationalization. Excellent analytical, problem-solving, communication, and stakeholder management skills. Preferred Qualifications * Experience supporting CCAR, FR Y-14 Regulatory Reporting, Stress Testing, Capital Planning, Risk Management, or Finance Technology initiatives. * Experience developing solutions for: * Data sourcing and reconciliation * Model execution platforms * Data adjustments and result overlays * Attestation and workflow management Experience with MLflow, Databricks Workflows, Azure Data Factory, Azure SQL, Azure Functions, REST APIs, and Azure Cloud Services. Experience migrating analytical models from R to Python and deploying AI/ML solutions into production. Knowledge of model governance, model risk management, audit controls, and regulatory compliance requirements. Experience working in highly regulated financial services environments with strong governance and audit requirements. ## Description SMBC is driving a major Digital Transformation initiative across its Americas Division, with a strong focus on modernizing technology platforms, enhancing data-driven decision-making, and supporting business growth. As part of this transformation, we are seeking a talented Data Engineer to join the Regulatory Reporting & CCAR Technology Team . The Data Engineer will be responsible for developing scalable data platforms on Databricks that support end-to-end data sourcing, CCAR model execution, data adjustments, result overlays, and attestation workflows. This role requires strong expertise in Databricks, PySpark, Python, and AI/ML technologies to build robust, auditable, and regulatory-compliant solutions. The individual will collaborate closely with Finance, Risk, Data Management, and Model Development teams to deliver innovative data engineering solutions that enhance regulatory reporting processes and operational efficiency., * Design, develop, and support scalable data pipelines using Databricks, PySpark, Python, SQL, and Delta Lake. * Build and maintain data sourcing and ingestion frameworks for CCAR, Stress Testing, and Regulatory Reporting. * Develop and support platforms for CCAR model execution, including PPNR, Balance Sheet, RWA, and other risk models. * Implement data quality controls, reconciliation processes, lineage tracking, and audit capabilities. * Develop solutions for data adjustments, management overlays, business overrides, and exception management workflows. * Build and enhance attestation, approval, and sign-off workflows for regulatory reporting governance. * Partner with Finance, Risk, and Regulatory Reporting stakeholders to deliver business-critical solutions. * Leverage AI/ML capabilities for data quality monitoring, anomaly detection, intelligent automation, and operational insights. * Support CI/CD, production releases, troubleshooting, performance tuning, and operational support activities. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [Hacking MSSQL on Cloud. All of them. How I became sysadmin on Azure, AWS, GCP and Alibaba.](https://www.wearedevelopers.com/videos/100339-hacking-mssql-on-cloud-all-of-them-how-i-became-sysadmin-on-azure-aws-gcp-and-alibaba) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)