> Markdown version of [/jobs/ext/3167061-software-developer](https://www.wearedevelopers.com/jobs/ext/3167061-software-developer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Software Developer - **Company:** scrumconnect ltd - **Location:** Newcastle upon Tyne, UK - **Experience:** Expert - **Salary:** £55,000.0 - £65,000.0 - **Contract:** Permanent contract - **Skills:** Agile Methodology, Airflow, Amazon Web Services, Data Analysis, Application Performance Management, Code Review, Information Engineering, Data Security, DevOps, Python (Programming Language), Scrum Methodology, Secure Coding, Software Engineering, Systems Integration, Workflow Management Systems, Jupyter Notebook, Data Processing, Delivery Pipeline, Apache Spark, Jupyter, Gitlab, Git, Containerization, Code Testing, Terraform, Docker - **Published:** September 10, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=6b9b724cb19954b1 ## About the Role * Experience developing software using Python * Experience with AWS services * Experience with Terraform for infrastructure as code * Experience with Apache Spark for data processing * Experience with Apache Airflow for workflow orchestration * Experience with Docker and containerisation * Experience building and maintaining CI/CD pipelines using GitLab * Experience integrating security scanning tools into development pipelines * Experience with Jupyter Notebooks for data exploration and analysis * Experience integrating with third-party or internal platform products, ideally within a government or DWP context * Understanding of secure coding practices * Experience with Git and Agile methodologies * Strong analytical and problem-solving abilities * Good communication and collaboration skills, * Prior experience working in the public sector * Experience working in regulated or standards-driven environments (e.g., public sector digital services or GDS-aligned projects) * Relevant certifications in AWS, Python, or data engineering, * Strong analytical and problem-solving abilities * Good communication and collaboration skills * Ability to work independently and in team environments * Mentorship and leadership mindset ## Description We are seeking an experienced Software Developer to join our engineering team, working on data engineering and platform solutions. You will design, build, and maintain data pipelines and infrastructure, working closely with wider delivery colleagues to deliver secure, reliable, and scalable services that support critical public sector operations., * Design, develop, and maintain data pipelines and processing workflows using Apache Spark and Python * Build, schedule, and monitor workflow orchestration using Apache Airflow * Develop and maintain infrastructure-as-code using Terraform across AWS environments * Containerise applications and services using Docker * Build and maintain CI/CD pipelines in GitLab, supporting automated build, test, and deployment processes * Integrate security scanning agents into the development and deployment pipeline to ensure code and infrastructure meet security standards * Develop and maintain notebooks (Jupyter) to support data exploration, analysis, and prototyping * Build and maintain integrations with DWP Integration Team products, ensuring reliable and secure data exchange * Collaborate with cross-functional teams including data engineers, DevOps, and product stakeholders * Write clean, maintainable, and well-tested code following best practices * Contribute to system design and architecture decisions * Ensure application performance, scalability, and adherence to security standards * Conduct code reviews and support the development of junior team members * Participate in sprint planning, refinement, and other agile ceremonies