> Markdown version of [/jobs/ext/735440-senior-principal-databricks-platform-engineering-lead-python](https://www.wearedevelopers.com/jobs/ext/735440-senior-principal-databricks-platform-engineering-lead-python). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Principal - Databricks Platform Engineering Lead (Python) - **Company:** JPMorgan Chase & Co. - **Location:** Jersey City, NJ, United States - **Experience:** Expert - **Salary:** $232,750.0 - $325,000.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Agile Methodology, Artificial Intelligence, Amazon Web Services, Business Analytics Applications, Software Applications, JIRA, Unit Testing, Big Data, Software Quality, Code Review, Data Infrastructure, Data Systems, Software Debugging, Distributed Systems, Github, Python (Programming Language), Network Control, Scrum Methodology, Systems Development Life Cycle, Software Engineering, Toolchain, Cloud Platform System, Apache Spark, AWS Lambda, Data Lakes, Infrastructure Automation Frameworks, Production Code, Data Analytics, Bitbucket, Data Management, Terraform, Artificial Intelligence Markup Language (AIML), Software Version Control, Data Pipelines, Jenkins, Databricks - **Published:** June 29, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=7ef28014a74af792 ## About the Role Do you have experience in Version control?, * Formal training or certification on software engineering concepts and 10+ years applied experience * Expert-level proficiency in Databricks platform administration, AWS networking, and infrastructure-as-code with Terraform * Hands-on experience with Python application program development with use of automated unit testing * Hands-on practical experience delivering system design, application development, testing, and operational stability * Hands-on practical experience with terraform development and understanding of terraform enterprise * Hands-on experience with GitHub / Bitbucket code versioning tool, Jenkins build tool and pypi / maven artifactory integrations * Experience in managing product release lifecycle at enterprise level. * Demonstrated experience designing and scaling agentic AI-enabled development patterns (using enterprise-authorized tools within the work environment) across teams/functions, including establishing governance for human-in-the-loop validation, traceability/auditability, and secure handling of sensitive inputs/outputs. * Strong understanding of responsible AI use and control expectations at scale, including security/resiliency implications, data sensitivity, and risk-based governance; ability to advise senior leaders on safe adoption, reuse, and measurable outcomes. Preferred qualifications, capabilities, and skills * Strong knowledge of distributed compute frameworks like Spark and how platform-level configurations impact workload performance and reliability * Experience with Agile development processes, as needed (SCRUM/KANBAN) using JIRA. * Experience in Data pipelines using Spark ## Description Join JPMorgan Chase as a Senior Principal Software Engineer where you will own the Databricks platform architecture on AWS, build Terraform/Python automation, mentor teams, and drive high-impact data innovation. The Chief Data & Analytics Office (CDAO) at JPMorgan Chase is responsible for accelerating the firm's data and analytics journey. This includes ensuring the quality, integrity, and security of the company's data, as well as leveraging this data to generate insights and drive decision-making. The CDAO is also responsible for developing and implementing solutions that support the firm's commercial goals by harnessing artificial intelligence and machine learning technologies to develop new products, improve productivity, and enhance risk management effectively and responsibly. As a Senior Principal Software Engineer at JPMorganChase in Corporate - AIML Data Platforms and the Chief Data & Analytics team, you will bring your deep expertise in Databricks and large-scale data engineering. In this role you will drive the architecture, design, and implementation of advanced data solutions, leveraging Databricks and related technologies to enable business insights and innovation, * Leads the design, build, and troubleshooting of a scalable Databricks/Spark data platform and analytics workloads across cloud environments. * Develops and maintains secure, production-grade Python code; perform code reviews, debugging, and engineering quality improvements across the team. * Owns delivery of scalable data pipelines and analytics solutions on Databricks, applying strong distributed computing and performance troubleshooting practices. * Designs and develops infrastructure automation for the Databricks control plane, including workspace provisioning, account configuration, onboarding/offboarding, and Delta Sharing using Terraform, AWS, and Python Lambdas. * Develops secure, high-quality production code across Terraform modules, Python Lambda functions, and control plane services while reviewing and debugging code across the team. * Leads the architecture of scalable Databricks platform infrastructure, including workspace automation, AWS networking, and control plane APIs enabling self-service for downstream teams. * Solves the companies most challenging cloud data platform problems by building innovative technical solutions around Data Lake Tools. * Identifies opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems * Mentor and guide technical teams, fostering a culture of continuous learning and excellence in software engineering practices * Sets strategy and operating standards for agentic AI-enabled engineering across a portfolio (using enterprise-authorized tools within the work environment) to drive measurable improvements in delivery speed, reliability, and code quality (e.g., AI-orchestrated SDLC/TLM automation, release readiness gating, incident triage/root-cause acceleration, and large-scale refactoring/test modernization), while defining guardrails for validation, security, resiliency, and reuse across teams and functions. * Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation at scale., Our professionals in our Corporate Functions cover a diverse range of areas from finance and risk to human resources and marketing. Our corporate teams are an essential part of our company, ensuring that we're setting our businesses, clients, customers and employees up for success. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [The Road to MLOps: How Verivox Transitioned to AWS](https://www.wearedevelopers.com/videos/1050-the-road-to-mlops-how-verivox-transitioned-to-aws) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [Collaboration Quantified: Lessons from Open Source Developer Networks](https://www.wearedevelopers.com/videos/1422-collaboration-quantified-lessons-from-open-source-developer-networks) - [Enterprise-Cloud-Native - Fast-Paced Development & Deployment in a Highly Secure Banking Environment](https://www.wearedevelopers.com/videos/671-enterprise-cloud-native-fast-paced-development-deployment-in-a-highly-secure-banking-environment) - [Our GitOps approach for deploying an Identity Provider and an API Gateway in a SaaS company](https://www.wearedevelopers.com/videos/776-our-gitops-approach-for-deploying-an-identity-provider-and-an-api-gateway-in-a-saas-company) ## Related Articles - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)