Azure OpenAI Engineer

OpenKyber LLC
Atlanta, GA, United States
5 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Working hours
Regular working hours

Tech stack

LangGraph Framework Application Programming Interfaces (APIs) Artificial Intelligence Audit Trail Microsoft Azure Cyber Security Databases Continuous Integration File Systems Github Monitoring of Systems JSON
+52 more
Python (Programming Language) Open Source Technology Operational Databases OpenAI Markdown Prometheus Standard Sql Search Technologies Software Engineering Data Streaming Systems Integration TypeScript Unstructured Data Datadog Pinecone Enterprise Software Applications Cloud Platform System LangChain ReactJS Retrieval-Augmented Generation Large Language Models Claude Code Multi-Agent Systems Prompt Engineering Hallucination Detection Llamaindex Generative AI Backend Agentic-AI Fastapi AI Platforms LangSmith Kubernetes Infrastructure Automation Frameworks Information Technology Low Latency CrewAI Weaviate AutoGen Enterprise Integration Milvus Machine Learning Operations FAISS Claude Asynchronous Programming Artificial Intelligence Governance Restful APIs Semantic Kernel GPT OpenSearch Docker Servicenow

Job description

We are seeking a hands-on Senior Agentic AI Engineer to design, develop and deploy production-grade AI agents and Generative AI solutions for enterprise and mission-critical environments. The engineer will build multi-step agent workflows, integrate Large Language Models with enterprise applications and develop secure MCP servers that connect AI agents with internal databases, APIs, file systems and operational platforms. Key Responsibilities

  • Design and develop enterprise Agentic AI solutions using Claude, OpenAI or open-source Large Language Models.
  • Build multi-agent and multi-step workflows using LangGraph, LangChain, CrewAI, LlamaIndex, Semantic Kernel or similar frameworks.
  • Implement tool-calling, planning, reasoning, reflection, memory, routing and human-in-the-loop workflows.
  • Design and develop MCP servers and clients for secure integration with enterprise applications, databases, APIs and file systems.
  • Develop backend AI services using Python, FastAPI, AsyncIO and Pydantic.
  • Build RAG pipelines covering ingestion, document processing, chunking, metadata filtering, embeddings, retrieval and reranking.
  • Work with vector databases such as Pinecone, Milvus, Weaviate, FAISS, OpenSearch or equivalent platforms.
  • Integrate AI agents with REST APIs, JSON-RPC, Streaming HTTP and server-sent events.
  • Deploy AI services using Docker, Kubernetes and cloud-native platforms.
  • Implement observability using OpenTelemetry, LangSmith, Datadog, Prometheus or similar platforms.
  • Build automated evaluations for accuracy, relevance, hallucination, tool-selection quality, latency, token consumption and cost.
  • Implement AI guardrails, role-based access controls, audit trails, data privacy and responsible AI practices.
  • Troubleshoot production issues across AI agents, MCP servers, enterprise APIs and retrieval pipelines.
  • Collaborate directly with client stakeholders, architects, data engineers, infrastructure teams and product owners.

Requirements

  • 6 12 years of overall software engineering experience.
  • Minimum 2 years of hands-on Generative AI or Agentic AI experience.
  • Advanced proficiency in Python, including asynchronous programming.
  • Strong experience with FastAPI, Pydantic and REST API development.
  • Hands-on experience with LangGraph, LangChain, CrewAI, LlamaIndex, AutoGen or Semantic Kernel.
  • Practical experience building AI agents with tool calling, ReAct patterns and multi-step orchestration.
  • Strong understanding of MCP architecture, including MCP servers, clients, tools and resources.
  • Experience with Claude, OpenAI GPT models, LLaMA, Mistral or similar Large Language Models.
  • Strong experience with RAG, embeddings, semantic search and vector databases.
  • Experience with AWS Bedrock, SageMaker, Azure OpenAI, Azure AI Foundry or comparable cloud AI services.
  • Experience with Docker, Kubernetes, GitHub Actions and CI/CD pipelines.
  • Strong knowledge of SQL, JSON and unstructured data formats such as PDF, Markdown and documents.
  • Experience with prompt engineering, context engineering and structured model outputs.
  • Strong communication, documentation and client-facing abilities.

Preferred Skills

  • Experience with Claude Code or Anthropic APIs.
  • Experience with Agent-to-Agent protocols and multi-agent communication.
  • TypeScript or Node.js development experience.
  • Experience with OpenTelemetry, LangSmith, Weights & Biases or Datadog.
  • Knowledge of MLOps, LLMOps, model monitoring and infrastructure as code.
  • Experience integrating Agentic AI with ServiceNow, infrastructure operations, storage, backup or enterprise workflow systems.
  • Domain experience in insurance, banking, cybersecurity, application modernization or managed infrastructure services.
  • Experience working as a forward-deployed engineer in customer environments.

Education Bachelor’s degree in Computer Science, Artificial Intelligence, Engineering or a related discipline, or equivalent professional experience. For applications and inquiries, contact:hirings@openkyber.com

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Loading talks and stories from around this role…