> Markdown version of [/jobs/ext/2646920-java-ai-developer-rag-llm](https://www.wearedevelopers.com/jobs/ext/2646920-java-ai-developer-rag-llm). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Java AI Developer (RAG/LLM)

- **Company:** Donato Technologies, Inc
- **Location:** United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Agile Methodology, Artificial Intelligence, Amazon Web Services, Application Performance Management, Microsoft Azure, Continuous Integration, Document Retrieval, Java Platform Enterprise Edition (J2EE), Enterprise Messaging Systems, NoSQL, OpenShift, Standard Sql, Search Technologies, Systems Integration, Google Cloud, Enterprise Software Applications, Large Language Models, Grafana, Prompt Engineering, Spring-boot, Model Validation, Indexer, Git, AI Platforms, Kubernetes, Apache Kafka, Virtual Agents, Nim (Programming Language), Restful APIs, Docker, Jenkins, Microservices
- **Published:** August 7, 2026
- **Apply:** https://www.dice.com/job-detail/610ecff5-d3bd-4f1d-b527-40f6151aab0c

## About the Role

* 10+ years of Java development experience
 * Strong experience with Java 17+ and Spring Boot
 * Hands-on experience building Retrieval-Augmented Generation (RAG) systems
 * Experience with Spring AI, LangChain4j, or similar Java AI frameworks
 * Experience integrating OpenAI, Azure OpenAI, Claude, Gemini, or Llama models
 * Strong knowledge of vector databases such as Pinecone, Milvus, Weaviate, FAISS, or ChromaDB
 * Experience implementing semantic search and document retrieval pipelines
 * Strong REST API and Microservices development experience
 * Experience with Kafka or other messaging platforms
 * Experience with Docker, Kubernetes, and OpenShift
 * Experience with AWS, Azure, or Google Cloud Platform
 * Strong SQL and NoSQL database experience
 * Experience with Git, Jenkins, and CI/CD
 * Experience with Agile development methodologies

Preferred Skills

 * Banking or financial services experience
 * Knowledge of AI agents and autonomous workflows
 * Experience with Spring AI ecosystem
 * Experience implementing enterprise security standards
 * Experience with AI governance and monitoring
 * Knowledge of prompt engineering and model evaluation, * Experience with LangGraph or AI Agent frameworks
 * MCP (Model Context Protocol) implementation experience
 * Knowledge Graph integration
 * AI observability tools (LangSmith, Arize AI, TruLens)
 * NVIDIA NIM or enterprise inference platforms
 * Financial regulatory compliance experience
 * Exposure to Agentic AI architectures

## Description

* Design and develop enterprise Java-based AI applications
 * Build scalable RAG architectures using Java and Spring Boot
 * Integrate LLMs into enterprise applications
 * Develop document ingestion, indexing, and retrieval pipelines
 * Build secure APIs for AI services
 * Optimize retrieval accuracy and response quality
 * Collaborate with architects, ML engineers, and business teams
 * Deploy AI services using containerized cloud platforms
 * Ensure application performance, scalability, and compliance
 * Provide technical leadership and mentor development teams


## Related Videos

- [RAG's Not Dead, You're Just Using It Wrong! - Phil Nash](https://www.wearedevelopers.com/videos/1906-rag-s-not-dead-you-re-just-using-it-wrong-phil-nash)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [Java Meets AI: Empowering Spring Developers to Build Intelligent Apps](https://www.wearedevelopers.com/videos/1554-java-meets-ai-empowering-spring-developers-to-build-intelligent-apps)
- [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews)

## Related Articles

- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [ Dev Digest 213: Petrol Prices, Agentic Workflows, AI Skills and CODE100!](https://www.wearedevelopers.com/magazine/718-dev-digest-213-petrol-prices-agentic-workflows-ai-skills-and-code100)
- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)