> Markdown version of [/jobs/ext/2211938-senior-software-engineer-llm-ai-platform](https://www.wearedevelopers.com/jobs/ext/2211938-senior-software-engineer-llm-ai-platform). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# (Senior) Software Engineer - LLM & AI Platform

- **Company:** KI Group
- **Location:** Hofheim am Taunus, Germany
- **Experience:** Expert
- **Salary:** €70,500.0 - €92,500.0
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Encodings, Python (Programming Language), Node.Js, TypeScript, Large Language Models, Backend, Information Technology, Api Design
- **Published:** August 24, 2026
- **Apply:** https://www.xing.com/jobs/bad-homburg-hoehe-senior-software-engineer-llm-ai-platform-157172127

## About the Role

* Absolventen der Informatik, Wirtschaftsinformatik, Data Science oder eines verwandten Studiengangs
 * Erfahrung mit

 * RAG-Pipelines in Produktion - Vector DB, Retrieval, Chunking, Evaluation/Grounding
 * LLM-Frameworks - LangChain / LlamaIndex (o. ä.) für Orchestrierung, Chains/Agents, Tool-Use
 * LLM-Application-Engineering - Prompt-/Context-Engineering, Function-Calling, Agenten-Architekturen
 * Backend - Node/Python (o. ä.), saubere Services, Async, API-Design, Datenmodellierung
 * Frontend - React / TypeScript, baut nutzbare Oberflächen für die KI-Features selbst
 * Daten-Pipelines - Ingestion, Normalisierung, Embeddings über strukturierte und halb-strukturierte Quellen
 * MCP (Model Context Protocol)

Leidenschaftlicher Umgang mit KI-nativen Schnittstellen

## Description

In der Rolle als LLM Application Engineer / Senior Software Engineer übernimmst Du eine zentrale Aufgabe in unserem Dev-Team. Du baust die gemeinsame LLM-Plattform eigenverantwortlich auf - vom PoC bis zur Produktion - und verantwortest zwei Tracks: interne Tools und Kundenprodukte. Dein Schwerpunkt liegt auf dem Anwendungsbau über Foundation Models: RAG, Agents, LangChain/LlamaIndex, Orchestrierung, Prompt-Engineering und Produktintegration.

 * Aufbau der LLM-Plattform-Schicht: Retrieval-Backend, Embedding-Pipeline, API-Design
 * Integration von LLM-APIs (OpenAI, Anthropic, Mistral u. a.) in interne und Kundensysteme
 * Entwicklung von KI-Features: Conversational Analyst, semantische Suche, intelligenter Alert-Feed
 * Implementierung von Agenten-Architekturen und MCP-Schnittstellen für Enterprise-Anbindung
 * Mitarbeit bei der Entwicklung von Prototypen und Proof-of-Concepts für neue KI-Anwendungsfälle


## Related Videos

- [Stop using Node.js like in 2020! What changed and what you can do today with Node.js](https://www.wearedevelopers.com/videos/100011-stop-using-node-js-like-in-2020-what-changed-and-what-you-can-do-today-with-node-js)
- [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock)
- [A Brief History of Data Storage](https://www.wearedevelopers.com/videos/974-a-brief-history-of-data-storage)
- [How E.On productionizes its AI model & Implementation of Secure Generative AI.](https://www.wearedevelopers.com/videos/623-how-e-on-productionizes-its-ai-model-implementation-of-secure-generative-ai)
- [Building AI Applications with LangChain and Node.js](https://www.wearedevelopers.com/videos/1512-building-ai-applications-with-langchain-and-node-js)
- [Stop Using Node.js Like It’s 2020! - Alfonso Graziano](https://www.wearedevelopers.com/videos/1863-stop-using-node-js-like-it-s-2020-alfonso-graziano)

## Related Articles

- [Best Coding Boot Camps in Germany](https://www.wearedevelopers.com/magazine/237-best-coding-boot-camps-in-germany)
- [The Biggest German Tech Companies](https://www.wearedevelopers.com/magazine/424-the-biggest-german-tech-companies)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)