Backend Cloud Engineer

Data Insights AI Ltd
Edinburgh, United Kingdom
6 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 65K

Job location

Remote
Edinburgh, United Kingdom

Tech stack

Geographic Information Systems
API
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Automation of Tests
Azure
C++
Cloud Computing
Cloud Engineering
Databases
Continuous Integration
Data Integration
Relational Databases
Dependency Injection
DevOps
Distributed Systems
Memory Management
Amazon DynamoDB
Middleware
Github
Graph Theory
Python
PostgreSQL
PostGIS
Redis
Service Development Studio
Session Management
SQLAlchemy
Data Streaming
Data Logging
Amazon Web Services (AWS)
Large Language Models
Concurrency
Prompt Engineering
Caching
AWS Lambda
Backend
Cloudformation
FastAPI
Kubernetes
Amazon Web Services (AWS)
Api Gateway
REST
Terraform
Serverless Computing
Docker
Microservices

Job description

We are building a massively scalable cloud infrastructure designed for data integration and complex digital twins, utilizing cutting-edge graph theory and physics-based modeling., We are looking for an engineer to lead the development of our backend services and Agentic Framework. We don't just "plug tools into an LLM"; we are architecting autonomous systems. While our current stack is Python-based, we value engineers who understand architectural concepts (Async I/O, Distributed Systems, Graph Theory) over specific syntax. If you are a skilled engineer from a different language background (Go, Rust, C++) with the right mindset, we want to hear from you., * Agentic Architecture: Design and maintain our agentic framework (currently using LangGraph). You will move beyond simple prompt engineering to build orchestrators that manage state, context, and complex reasoning loops.

  • Core Service Development: Maintain and expand high-performance REST APIs and calculation engines ensuring clean installation, testing, and modularity.
  • Scalable Cloud Infrastructure: Manage a hybrid architecture of containerized services (e.g. ECS/Fargate) and serverless components (e.g. AWS Lambda), ensuring seamless deployments via IaC.
  • Data & Geospatial Engineering: Optimize complex data flows involving PostgreSQL/PostGIS for vector tiles and geospatial features, alongside Redis for caching and session management.
  • DevOps & Quality: Enforce rigorous CI/CD standards, automated testing (unit/integration), and observability (logging/metrics) to ensure production reliability.

Requirements

Do you have experience in AWS?, Do you have a Master's degree?, Note: Due to the complexity of the domain, there is a strong preference for candidates with a degree in Mathematics or Physics., * Experience building agent architectures from scratch (orchestration, memory management, tool usage), not just consuming APIs.

  • Familiarity with streaming responses and handling LLM integration complexities.
  • Bonus: Experience with LangGraph or similar orchestration tools.
  1. Modern Backend Engineering (Language Agnostic)
  • Strong grasp of Asynchronous I/O and concurrency patterns.
  • Experience designing RESTful APIs with dependency injection and robust middleware (Auth/Validation).
  • Familiarity with modern packaging and dependency management (e.g., Poetry, Docker multi-stage builds).
  1. Database & Mathematics
  • Deep understanding of Relational Databases (PostgreSQL) including migrations and schema management.
  • Comfortable with Geospatial data (GIS, Vector Tiles) and Graph Theory concepts.
  • Ability to implement physics-based calculations and complex analytics pipelines.
  1. Cloud Native Operations (AWS/Azure/GCP)
  • Experience with Container Orchestration (Docker, ECS, or Kubernetes).
  • Familiarity with Serverless architectures (Lambda, API Gateway) and event-driven patterns.
  • Knowledge of Infrastructure as Code (SAM, Terraform, or CloudFormation) for managing resources like DynamoDB and S3.

The Tech Stack (FYI)

  • Language: Python 3.11+ (Async).
  • Frameworks: FastAPI, LangGraph, SQLAlchemy (Async), Pydantic.
  • Infrastructure: AWS (ECS Fargate, Lambda, Cognito, RDS, ElastiCache) - Azure/GCP a plus as well.
  • Data: PostgreSQL (PostGIS), Redis, S3.
  • Tooling: Poetry, Docker, GitHub Actions, Ruff, Make., * AWS Infrastructure: 5 years (preferred)

Benefits & conditions

Job Types: Full-time, Permanent

Pay: £45,000.00-£65,000.00 per year

Benefits:

  • Company pension
  • Employee stock ownership plan
  • Flexitime
  • Health & wellbeing programme
  • Sick pay
  • Work from home

Apply for this position