> Markdown version of [/jobs/ext/2685601-software-engineer-ai-applications-llm-rag](https://www.wearedevelopers.com/jobs/ext/2685601-software-engineer-ai-applications-llm-rag). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer - AI Applications (LLM/RAG)

- **Company:** NISH Tech BV
- **Location:** Brussel, Belgium
- **Experience:** Starter
- **Contract:** Permanent contract
- **Skills:** .NET Framework, Application Programming Interfaces (APIs), Artificial Intelligence, Software Applications, Microsoft Azure, C Sharp (Programming Language), Cloud Computing, Cloud Engineering, Computer Programming, Continuous Integration, Monitoring of Systems, Python (Programming Language), Regression Testing, Search Technologies, Software Engineering, Systems Integration, Enterprise Search, Data Logging, Large Language Models, Multi-Agent Systems, Generative AI, Backend, Api Design
- **Published:** September 3, 2026
- **Apply:** https://www.adzuna.be/details/5867413809

## About the Role

Must Have

 * 5+ years of experience as a Software Engineer, preferably in backend or full-stack development.
 * 1-2+ years of experience integrating LLMs or Generative AI services into software applications.
 * Strong programming skills in Python.
 * Practical experience with RAG, embeddings, vector search and retrieval optimization.
 * Experience with MCP, A2A, tool calling or multi-agent workflows.
 * Experience developing maintainable services with testing, logging, CI/CD and deployment practices.
 * Understanding of AI application evaluation, including quality metrics, regression testing and user feedback.
 * Good knowledge of cloud-native application development.
 * Security-conscious approach when working with sensitive or internal data.
 * Ability to clearly communicate technical trade-offs and choose pragmatic solutions.
 * Fluent English and fluent French or Dutch.

Technical Skills

 * Python
 * LLM / Generative AI
 * RAG & Vector Search
 * AI Agents & Tool Calling
 * Backend / API Development
 * Cloud-Native Development
 * CI/CD & Testing
 * AI Evaluation & Observability

Soft Skills

 * Strong analytical and problem-solving skills
 * Pragmatic and solution-oriented mindset
 * Good communication skills
 * Strong collaboration and teamwork
 * Security and quality awareness
 * Ability to explain technical concepts clearly
 * Proactive and adaptable approach

Nice to Have

 * Experience with LangChain, LangGraph or Semantic Kernel.
 * Familiarity with Azure and Microsoft AI ecosystem tools.
 * Experience with .NET / C#.
 * Experience with vector databases or enterprise search platforms.
 * Experience in regulated, security-sensitive or enterprise environments.
 * Experience with AI observability or evaluation tools.

## Description

This is a hands-on engineering position where you will design, develop, test and improve production-quality AI solutions while contributing to technical direction, security and maintainability., * Design and develop AI-powered applications using LLMs, RAG and agentic workflows.

 * Build backend services, APIs and integrations supporting AI applications.
 * Design and optimize retrieval pipelines, including embeddings, vector search, metadata filtering and reranking.
 * Work with LLM APIs and AI orchestration frameworks.
 * Implement testing, evaluation, monitoring and observability for AI applications.
 * Develop safe and practical approaches to tool calling, human-in-the-loop and agentic behaviour.
 * Collaborate with software engineers, product teams and business stakeholders.
 * Evaluate models and frameworks based on quality, cost, latency, security and maintainability.
 * Troubleshoot issues such as hallucinations, poor retrieval, latency and unreliable AI outputs.
 * Contribute to building scalable and production-ready AI solutions.


## Related Videos

- [API Design - Getting Started](https://www.wearedevelopers.com/videos/33-api-design-getting-started)
- [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock)
- [Crypto-secure Data Management with In-Database Blockchain](https://www.wearedevelopers.com/videos/632-crypto-secure-data-management-with-in-database-blockchain)
- [How to Avoid LLM Pitfalls - Mete Atamel and Guillaume Laforge](https://www.wearedevelopers.com/videos/1328-how-to-avoid-llm-pitfalls-mete-atamel-and-guillaume-laforge)
- [Rest API Antipatterns](https://www.wearedevelopers.com/videos/100208-rest-api-antipatterns)
- [Nest.js - TypeScript in the backend can also be clean](https://www.wearedevelopers.com/videos/1033-nest-js-typescript-in-the-backend-can-also-be-clean)

## Related Articles

- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [Best Companies in the Netherlands: Top 25 Companies in 2023 ](https://www.wearedevelopers.com/magazine/193-best-companies-in-the-netherlands-top-25-companies-in-2023)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [How to Find Tech Jobs in Amsterdam](https://www.wearedevelopers.com/magazine/279-how-to-find-tech-jobs-in-amsterdam)
- [Software Developer Salary in The Netherlands [2023]](https://www.wearedevelopers.com/magazine/217-software-developer-salary-in-the-netherlands-2023)