Software Engineer - AI Applications (LLM/RAG)

This is a hands-on engineering position where you will design, develop, test and improve production-quality AI solutions while contributing to technical direction, security and maintainability., * Design and develop AI-powered applications using LLMs, RAG and agentic workflows.

• Build backend services, APIs and integrations supporting AI applications.
• Design and optimize retrieval pipelines, including embeddings, vector search, metadata filtering and reranking.
• Work with LLM APIs and AI orchestration frameworks.
• Implement testing, evaluation, monitoring and observability for AI applications.
• Develop safe and practical approaches to tool calling, human-in-the-loop and agentic behaviour.
• Collaborate with software engineers, product teams and business stakeholders.
• Evaluate models and frameworks based on quality, cost, latency, security and maintainability.
• Troubleshoot issues such as hallucinations, poor retrieval, latency and unreliable AI outputs.
• Contribute to building scalable and production-ready AI solutions.

Must Have

• 5+ years of experience as a Software Engineer, preferably in backend or full-stack development.
• 1-2+ years of experience integrating LLMs or Generative AI services into software applications.
• Strong programming skills in Python.
• Practical experience with RAG, embeddings, vector search and retrieval optimization.
• Experience with MCP, A2A, tool calling or multi-agent workflows.
• Experience developing maintainable services with testing, logging, CI/CD and deployment practices.
• Understanding of AI application evaluation, including quality metrics, regression testing and user feedback.
• Good knowledge of cloud-native application development.
• Security-conscious approach when working with sensitive or internal data.
• Ability to clearly communicate technical trade-offs and choose pragmatic solutions.
• Fluent English and fluent French or Dutch.

Technical Skills

• Python
• LLM / Generative AI
• RAG & Vector Search
• AI Agents & Tool Calling
• Backend / API Development
• Cloud-Native Development
• CI/CD & Testing
• AI Evaluation & Observability

Soft Skills

• Strong analytical and problem-solving skills
• Pragmatic and solution-oriented mindset
• Good communication skills
• Strong collaboration and teamwork
• Security and quality awareness
• Ability to explain technical concepts clearly
• Proactive and adaptable approach

Nice to Have

• Experience with LangChain, LangGraph or Semantic Kernel.
• Familiarity with Azure and Microsoft AI ecosystem tools.
• Experience with .NET / C#.
• Experience with vector databases or enterprise search platforms.
• Experience in regulated, security-sensitive or enterprise environments.
• Experience with AI observability or evaluation tools.

NISH Tech BV is an IT consulting and staffing company connecting highly skilled professionals with leading organizations across Europe. We support our clients with technology, digital transformation, data and enterprise solutions.