GenAI Python Developer
Role details
Job location
Tech stack
Job description
If you're a strong Python engineer who's genuinely excited by the possibilities of GenAI in real enterprise environments, this is a brilliant opportunity. You'll be working on a large-scale Generative AI platform that's reshaping how a major global finance services business builds, deploys, and adopts AI across the business.
Expect hands-on engineering, real problem solving, and plenty of collaboration as you help architect, automate, and operationalise LLM-driven services at scale.
What You'll Be Doing:
-
Building backend services and APIs that give secure, governed access to LLM capabilities
-
Developing Python-based GenAI components including prompt orchestration and evaluation tooling
-
Integrating LLMs with enterprise systems, observability layers, and security frameworks
-
Designing and maintaining CI/CD pipelines using Azure DevOps
-
Working closely with platform leads, architects, and SRE teams to ensure stable, scalable operations
-
Supporting benchmarking, evaluation, and experiment tracking to measure LLM performance and cost
-
Contributing to RAG implementations and vector-driven retrieval patterns
-
Helping shape platform patterns, reusable components, and clear documentation
-
Troubleshooting performance issues across distributed systems and cloud services
Requirements
-
5+ years of backend engineering experience, with strong Python at the core
-
Hands-on exposure to GenAI technologies and Large Language Models
-
Practical understanding of LLM evaluation, prompt handling, and operational complexities
-
A DevOps-first approach with experience in CI/CD, observability, and automation (Azure DevOps preferred)
-
Confidence working in regulated enterprise environments with tight security controls
-
Experience integrating AI or ML services into real-world applications
-
Knowledge of authentication, secret management, networking, and model access governance
Bonus Points For:
-
Kong API Gateway, Kong Mesh, Flux CD
-
AWS stack: EC2, EKS, S3, SQS, DynamoDB, Bedrock
-
RESTful API development with FastAPI, microservices, Terraform, GitOps workflows
-
Prompt evaluation tools such as Promptfoo
-
SQL and NoSQL experience: MySQL, PostgreSQL, MongoDB, Cassandra
-
Exposure to RAG patterns and vector search technologies