> Markdown version of [/jobs/ext/1928598-senior-ai-engineer-agentic-systems](https://www.wearedevelopers.com/jobs/ext/1928598-senior-ai-engineer-agentic-systems). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior AI Engineer - Agentic Systems - **Company:** IBM - **Location:** New York, NY, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Microsoft Azure, Continuous Integration, Memory Management, Azure Machine Learning, Search Technologies, Enterprise Application Integration, Data Logging, Enterprise Software Applications, Large Language Models, Multi-Agent Systems, Prompt Engineering, Generative AI, Operational Systems, Data Management, Machine Learning Operations, Virtual Agents, Microservices - **Published:** August 5, 2026 - **Apply:** https://dejobs.org/x/x/BE9DDD1DF0E345CD9ED131AC530BD6AC/job/ ## About the Role Preferred technical and professional experience Preferred Skills * Experience with agentic frameworks such as LangChain, LangGraph, AutoGen, Semantic Kernel, or CrewAI * Familiarity with vector databases (e.g., Azure AI Search, Pinecone, Weaviate) for RAG implementations * Knowledge of MLOps practices and CI/CD pipelines for AI model deployment and lifecycle management * Experience with enterprise integration patterns and connecting AI solutions to CRMs, ERPs, or data platforms ## Description We are seeking a skilled AI Engineer to join an active enterprise AI engagement in a hands-on, client-facing capacity. This is a senior individual contributor role requiring deep technical proficiency in Agentic AI - you will be expected to operate independently, interact directly with the client, and deliver with minimal oversight. You will be responsible for building, fine-tuning, and operationalizing AI solutions on Azure, with a specific focus on agentic workflows, prompt engineering, RAG pipelines, and production-grade model deployment. The client expects a high-caliber engineer who can perform from day one. What You'll Do Agentic AI Development * Design, build, and deploy agentic AI workflows and multi-agent systems using Azure OpenAI and supporting frameworks * Develop and optimize prompt engineering strategies to maximize model performance and reliability * Build and maintain Retrieval-Augmented Generation (RAG) pipelines that enable grounded, context-aware AI responses * Implement agent orchestration patterns including tool calling, memory management, and human-in-the-loop workflows Client Engagement & Collaboration * Engage directly with client stakeholders to gather requirements, demo capabilities, and walk through technical solutions * Communicate clearly on progress, blockers, and technical tradeoffs - no hand-holding required * Collaborate with architects, data engineers, and business teams to ensure seamless end-to-end integration Engineering & Operationalization * Deploy and manage AI models using Azure ML, Azure AI Studio, or equivalent Azure services * Integrate AI capabilities into enterprise applications via APIs, event-driven pipelines, and microservices * Establish monitoring, evaluation, and feedback loops to ensure ongoing model performance and reliability in production * Ensure solutions meet enterprise standards for security, scalability, and compliance Required technical and professional expertise * 7+ years designing, developing, and deploying scalable AI applications leveraging LLMs, RAG architectures, and agentic AI workflows. * Build and operationalize AI orchestration pipelines using frameworks such as LangChain and LangGraph. * Develop AI agents capable of tool calling, contextual retrieval, memory/state management, multi-agent coordination, and autonomous workflow execution. * Implement MCP (Model Context Protocol) integration patterns to enable secure, modular interoperability between AI agents, enterprise systems, tools, and data sources. * Support the industrialization of AI capabilities through reusable architecture patterns, standardized deployment frameworks, monitoring, testing, evaluation pipelines, and operational support models. * Develop and integrate enterprise-grade APIs, vector databases, workflow platforms, and operational systems into AI-enabled business processes. * Implement AI governance, security, logging, guardrails, and human-in-the-loop controls to support responsible and scalable AI adoption. * Contribute to CI/CD, LLMOps/MLOps, and cloud-native deployment practices supporting enterprise-scale AI delivery. ## Related Videos - [Crypto-secure Data Management with In-Database Blockchain](https://www.wearedevelopers.com/videos/632-crypto-secure-data-management-with-in-database-blockchain) - [Microservices: how to get started with Spring Boot and Kubernetes](https://www.wearedevelopers.com/videos/242-microservices-how-to-get-started-with-spring-boot-and-kubernetes) - [Your imaginations is (no longer) the limit: how Generative AI empowers people to be creative](https://www.wearedevelopers.com/videos/741-your-imaginations-is-no-longer-the-limit-how-generative-ai-empowers-people-to-be-creative) - [Agentic AI - From Theory to Practice: Developing Multi-Agent AI Systems on Azure](https://www.wearedevelopers.com/videos/1532-agentic-ai-from-theory-to-practice-developing-multi-agent-ai-systems-on-azure) - [Build Delightful Mobile Experiences with Kotlin, Realm, and Atlas Device Sync](https://www.wearedevelopers.com/videos/694-build-delightful-mobile-experiences-with-kotlin-realm-and-atlas-device-sync) - [RAG's Not Dead, You're Just Using It Wrong! - Phil Nash](https://www.wearedevelopers.com/videos/1906-rag-s-not-dead-you-re-just-using-it-wrong-phil-nash) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [What is Agentic Programming and Why Should Developers Care?](https://www.wearedevelopers.com/magazine/625-what-is-agentic-programming-and-why-should-developers-care) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts)