Senior Software Engineer - Data Pipelines

Obsidian Security
Cheltenham, UK
about 2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services Amazon S3 Data Architecture Data Infrastructure Relational Databases Software Design Patterns Programming Tools Distributed Systems Monitoring of Systems Python (Programming Language)
+21 more
PostgreSQL Machine Learning Performance Tuning Redis Prometheus Standard Sql Software Deployment Software Engineering Systems Integration Multithreading Large Language Models Grafana Backend Git Gitlab-ci Solid Principles Apache Kafka Stream Processing Data Pipelines Docker Programming Languages

Requirements

Do you have experience in Software deployment?, * 5-7 years of experience in a software engineering role

  • Proficiency in one or more modern programming languages such as Python, Go, or SQL
  • Experience building backend services, APIs, and multithreaded applications
  • Familiarity with containerization and orchestration technologies such as Docker and Kubernetes
  • Strong knowledge of relational databases (e.g., Postgres)
  • Experience collaborating in team environments and adapting to changing requirements
  • Understanding of software design principles and engineering best practices
  • Experience with cloud platforms (AWS, GCP), object storage (S3), or event/streaming systems (Kafka, Redis)
  • Familiarity with Git for version control and deployment tooling, such as GitLab CI/CD
  • Experience in influencing design patterns based on best practices.
  • Experience assessing alternative data architecture designs to produce accurate and unbiased recommendations.

Desirable Experience

  • Experience with system monitoring and observability tools such as Grafana, Prometheus, or similar platforms
  • Understanding of quality engineering (QE) practices across development and testing lifecycles
  • Exposure to large-scale distributed systems and performance optimisation
  • Experience in forming strong stakeholder relationships to help promote joint working between teams.
  • Experience of working alongside both UK and US development teams.

AI Skills & AI-Native Engineering Expectations: As an AI-forward engineering organization, we expect senior engineers to effectively leverage AI tools and understand foundational AI concepts to enhance development efficiency and build AI-ready systems.

AI Engineering Capabilities:

  • Leverage AI tools effectively to improve development efficiency and build AI-ready systems.
  • Proficient with AI-powered developer tools; able to critically evaluate and refine AI-generated outputs.
  • Strong understanding of core AI/ML concepts (LLMs, embeddings, vector databases, inference, evaluation).
  • Experience integrating AI/ML APIs and building AI-ready data infrastructure (e.g., for RAG).
  • Ensure data quality, governance, observability, reliability, security, and performance in AI-driven systems.

About the company

Obsidian Security is the leading SaaS security platform, trusted by global enterprises like Snowflake, T-Mobile, and Algolia. We protect 200+ organizations across North America, Europe, the Middle East, Southeast Asia, Australia, and New Zealand, including many of the world’s largest Fortune 1000 and Global 2000 companies.

Founded in 2017 and backed by top investors like Greylock, Obsidian was built to close a critical gap: securing SaaS apps where business happens-Microsoft 365, Salesforce, and hundreds more. The company does this by offering a complete SaaS security platform to reduce risk, detect and respond to threats, and prevent breaches at the source. Obsidian was built by leaders who redefined endpoint and identity security at CrowdStrike, Okta, Cylance, and Carbon Black. Now, they’re transforming how SaaS is secured.

With AI driving rapid SaaS growth and complexity, agentic AI tools gain privileged access to sensitive data through integrations, creating new risks most security tools miss. Obsidian uniquely detects anomalous OAuth token activity and manages integration risks. Major announcements are on the horizon. Recognizing that SaaS security needs to evolve, Obsidian enables growing organizations to start with a lightweight, prevention-focused browser extension and expand coverage over time.

With global momentum, a growing partner ecosystem including SentinelOne, Databricks, and Google Cloud, and a major fundraise ahead, Obsidian is scaling rapidly toward long-term growth and IPO readiness.

About the Role - as a Senior Engineer at Obsidian, you’ll:

  • Build or extend data pipelines that power Obsidian’s Agentic AI and supply chain risk products.
  • Maintain, improve, and evolve existing systems to ensure performance, resilience, and scalability
  • Design and implement APIs and backend services, including multithreaded applications
  • Collaborate with product and engineering teams to support key product themes and ensure delivery of high-impact features
  • Apply strong software engineering practices to requirements gathering, system design, and code reviews
  • Contribute to a fast-moving, collaborative environment where adaptability and teamwork are essential.
  • Identify and proliferate best practices in data pipeline design between both the UK and US teams.

What’s in It for You

  • You will have direct impact on the core product used by enterprises worldwide
  • Work alongside a talented, friendly team in a supportive and collaborative culture
  • Grow your skills with opportunities to learn new technologies and engineering practices
  • Be part of an innovative, fast-paced environment where your contributions are valued

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:08 min

Essential engineering roles in the generative AI space

Mary Grygleski Mary Grygleski · LIVE

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

3:55 min

Demonstrating semantic routing thresholds with the Redis vector library

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · WWC 2025

1:31 min

Essential AI and human skills for future teams

Alexander Weißhaupt Alexander Weißhaupt +1 · WWC 2025

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

Videos

See all

Related articles

See all