> Markdown version of [/jobs/ext/2258829-software-engineer-ii-databricks](https://www.wearedevelopers.com/jobs/ext/2258829-software-engineer-ii-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer II - Databricks

- **Company:** Databricks, Inc.
- **Location:** Petersfield, UK
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Airflow, Amazon Web Services, Amazon S3, Automation of Tests, Unit Testing, Microsoft Azure, Cloud Storage, Code Generation, Software Quality, Continuous Integration, Information Engineering, Data Governance, Extract Transform Load (ETL), Payment Systems, Python (Programming Language), Key Management, Metadata, Performance Tuning, Software Tools, Cloud Services, Secure Coding, Software Engineering, SQL Databases, Data Streaming, Toolchain, Azure Data Factory, Apache Spark, Data Lakes, Pyspark, Git Flow, Deployment Automation, Software Coding, Code Restructuring, Data Pipelines, Databricks
- **Published:** August 26, 2026
- **Apply:** https://www.apply4u.co.uk/jobs/software-engineer-ii-databricks/45146566

## About the Role

enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation Required qualifications, skills and capabilities Experience with building data pipelines on Databricks and/or Apache Spark in production. Strong coding skills in Python (PySpark) and SQL (Scala a plus). Hands-on experience with Delta Lake (MERGE/UPSERT patterns, schema evolution, partitioning, Z-ORDER, OPTIMIZE/VACUUM). Experience with orchestration and scheduling (Databricks Workflows, Airflow, Azure Data Factory, etc.). Familiarity with cloud data platforms ( AWS/Azure/GCP ) and storage (S3/ADLS/GCS). Solid understanding of data engineering fundamentals: data modeling, ETL/ELT patterns, reliability, observability, and performance tuning. Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, testing, troubleshooting, or documentation) with demonstrated ability to critically evaluate and

## Description

hackajob is partnering directly with JPMorganChase to hire for this role. JOB DESCRIPTION As a Software Engineer II at JPMorgan Chase within our Corporate Investment Bank , Payments Technology team, you'll design, build, and operate scalable data pipelines and analytics workloads on the Databricks Lakehouse platform. We're looking for a Databricks Engineer to design, build, and operate scalable data pipelines and analytics workloads on the Databricks Lakehouse platform. You'll partner with data analysts, data scientists, and application teams to deliver trusted datasets, performant ETL/ELT pipelines, and well-governed data products. Job responsibilities Design and implement batch and streaming data pipelines using Databricks (Spark), Delta Lake , and orchestrators (e.g., Workflows , Airflow, ADF). Develop and optimize Spark jobs (PySpark/Scala) and SQL transformations for performance, reliability, and cost efficiency. Build and maintain curated data models (bronze/silver/gold), data
quality checks, and automated testing. Implement CI/CD for notebooks and code (Git-based workflows), and automate deployments across environments. Manage and tune Databricks clusters, jobs, and configurations monitor production workloads and resolve incidents. Integrate multiple data sources (cloud storage, relational DBs, APIs, event streams) and implement robust ingestion patterns. Apply data governance and security best practices (access controls, secrets management, lineage/metadata, auditing). Create clear documentation for pipelines, data contracts, and operational runbooks. Leverages enterprise-authorized AI coding assist tools within the work environment to improve code quality, delivery speed, and productivity (e.g., code generation/refactoring, unit test creation, documentation), while validating outputs through peer review, automated testing, and secure coding standards. Applies knowledge of tools within the Software Development Life Cycle toolchain, including


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)