> Markdown version of [/jobs/ext/2735225-senior-ai-platform-engineer](https://www.wearedevelopers.com/jobs/ext/2735225-senior-ai-platform-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior AI Platform Engineer - **Company:** XTB INVESTING LLC - **Location:** United States (Remote available) - **Experience:** Expert - **Salary:** $25,900.0 - **Contract:** Permanent contract - **Skills:** Clean Code Principles, Java (Programming Language), A/B Testing, Application Programming Interfaces (APIs), Artificial Intelligence, User Authentication, Automation of Tests, Software as a Service, Code Review, Continuous Integration, DevOps, Python (Programming Language), Search Technologies, Software Deployment, Software Engineering, Management of Software Versions, AI Infrastructure, Load Balancing, Retrieval-Augmented Generation, Large Language Models, Multi-Agent Systems, Database Optimization, Prompt Engineering, Caching, Backend, Rate Limiting, Git, Build Management, AI Platforms, Gitlab-ci, Kubernetes, Optimization Algorithms, Api Gateway, GPT, Software Version Control - **Published:** September 5, 2026 - **Apply:** https://arc.dev/remote-jobs/j/redirect/pho6mjcloy ## About the Role * 4+ years as a Platform Engineer, Backend Engineer, or AI Engineer with hands-on platform/service delivery experience. * Strong software engineering fundamentals: proficiency in Python and/or Go/Java, clean code practices, system design. * Production experience with container orchestration (Kubernetes) and ArgoCD for GitOps deployments. * Expert-level knowledge of GitLab CI/CD: designing reliable pipelines, managing deployments, optimizing build efficiency. * Practical experience with LLM frameworks and agentic systems (LangGraph, Pydantic AI, or equivalent). * Working knowledge of RAG systems: vector databases, similarity search, prompt engineering for retrieval-augmented contexts. * Understanding of LLM routing and optimization: cost-aware model selection, latency reduction, multi-model orchestration. * Experience building or managing gateway/proxy infrastructure (API gateways, reverse proxies, load balancing). * Strong foundation in infrastructure-as-code, version control (Git), and CI/CD best practices * Excellent communication: ability to work with AI/ML teams, data engineers, and product managers to translate requirements into platform solutions Nice to have * Experience building prompt management and versioning systems. * Knowledge of semantic caching or prompt optimization techniques. * Experience with multi-tenant SaaS architecture or platform-as-a-service (PaaS) design. * Familiarity with evaluation frameworks for LLM outputs or agentic behavior. * Experience with vector database optimization or semantic search. * Knowledge of advanced deployment patterns (canary, blue-green, A/B testing) for AI services. ## Description We are seeking a Senior AI Platform Engineer with strong platform engineering and DevOps expertise to design, build, and maintain a cutting-edge developer platform that empowers teams to build and deploy AI-driven solutions at scale. This role bridges software engineering excellence with AI tool orchestration, focusing on creating self-service platforms for LLM integration, agentic workflows, and enterprise AI infrastructure., * Design and implement an enterprise AI platform with LLM-based routing, intelligent model selection, fallback strategies, and cost optimization * Build and maintain MCP (Model Context Protocol) gateway infrastructure enabling seamless integration of enterprise tools and internal data with AI agents * Architect LangGraph-based orchestration frameworks for complex agentic workflows, enabling developers to compose multi-step AI applications * Implement RAG (Retrieval-Augmented Generation) platform components: vector search integration, prompt optimization, and chunking strategies * Establish comprehensive observability using Langfuse and similar tools: tracing, cost monitoring, token usage analytics, and LLM quality metrics. * Design and optimize APIs for LLM interactions, enabling developers to access platform capabilities seamlessly. * Build deployment and orchestration pipelines using Kubernetes (K8s) with ArgoCD for GitOps-driven AI service deployments. * Establish CI/CD infrastructure using GitLab CI/CD for automated testing, deployment, and versioning of AI platform components. * Implement security, authentication, and rate limiting for AI endpoints protecting against abuse and ensuring multi-tenant isolation. * Create self-service developer interfaces and documentation enabling non-AI-experts to build sophisticated agentic applications. * Design prompt management and versioning systems, enabling teams to collaborate on prompts and track performance across versions. * Lead technical initiatives, conduct code reviews, mentor engineers, and foster AI-first engineering culture. ## Related Videos - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [ Evaluating AI models for code comprehension](https://www.wearedevelopers.com/videos/1462-evaluating-ai-models-for-code-comprehension) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Coffee with Developers - Maria Apazoglou](https://www.wearedevelopers.com/videos/1209-coffee-with-developers-maria-apazoglou) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) - [AI-Augmented DevOps with Platform Engineering](https://www.wearedevelopers.com/videos/1614-ai-augmented-devops-with-platform-engineering) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path) - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [The Prompt Engineer ✍️](https://www.wearedevelopers.com/magazine/216-the-prompt-engineer)