AI Application Engineer / Architect

Prospect, Inc.
New York, NY, United States
2 days ago
Apply on www.juju.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Working hours
Regular working hours
Job source

Tech stack

LangGraph Framework Artificial Intelligence Microsoft Azure Cloud Computing Continuous Integration DevOps Memory Management Information Retrieval Python (Programming Language) Machine Learning OpenAI Search Technologies
+23 more
Software Engineering Workflow Management Systems Enterprise Search Software Organization Pinecone Spring Cloud Retrieval-Augmented Generation Large Language Models Multi-Agent Systems Prompt Engineering Model Validation Generative AI Agentic-AI Containerization AI Platforms Information Technology Weaviate Azure OpenAI API Machine Learning Operations Azure AI Api Design ChromaDB Microservices

Job description

The ideal candidate possesses deep expertise in AI application architecture, large language models (LLMs), retrieval-augmented generation (RAG), agent orchestration frameworks, and cloud-native development. You will work closely with engineering, product, and business stakeholders to build innovative AI-powered solutions that drive automation, decision-making, and operational efficiency., * Architect, design, and implement scalable AI applications leveraging multi-agent frameworks and agentic workflows.

  • Develop and optimize complex stateful agent orchestration solutions using LangGraph and related LangChain technologies.
  • Design and implement advanced Retrieval-Augmented Generation (RAG) solutions utilizing Azure AI Search for high-quality knowledge retrieval and contextual reasoning.
  • Build intelligent AI systems capable of autonomous decision-making, task planning, memory management, and multi-step execution.
  • Integrate large language models from Azure OpenAI and other AI platforms into enterprise-grade applications.
  • Partner with business stakeholders to gather requirements, define AI use cases, and translate business needs into technical solutions.
  • Drive architecture decisions, governance standards, and best practices for AI application development.
  • Optimize AI application performance, scalability, observability, and security.
  • Collaborate with software engineers, data engineers, and DevOps teams to deliver production-ready AI solutions.
  • Evaluate emerging AI technologies, frameworks, and methodologies to continuously improve platform capabilities.
  • Establish monitoring, testing, and evaluation frameworks for AI applications to ensure quality, reliability, and responsible AI practices.

Requirements

A variety of soft skills and experience may be required for the following role Please ensure you check the overview below carefully., * Bachelor’s degree in Computer Science, Software Engineering, Data Science, or a related field.

  • 5+ years of software engineering experience with at least 2+ years focused on AI/ML application development.
  • Hands-on experience designing and deploying enterprise AI applications.
  • Strong expertise with LangChain, LangGraph, and agent-based AI architectures.
  • Experience implementing RAG solutions using Azure AI Search, vector databases, and semantic search technologies.
  • Proficiency with Python and modern software development practices.
  • Strong understanding of large language models (LLMs), prompt engineering, embeddings, vector search, memory systems, and tool integration.
  • Experience developing cloud-native applications within Microsoft Azure.
  • Knowledge of API design, microservices architecture, containerization, and CI/CD pipelines.
  • Excellent problem-solving, communication, and stakeholder management skills.

Preferred Qualifications

  • Experience with Azure OpenAI Service, Cognitive Services, and other Azure AI offerings.
  • Familiarity with vector databases such as Pinecone, Weaviate, Chroma, or Azure-native vector storage solutions.
  • Experience implementing multi-agent systems, autonomous agents, and workflow orchestration platforms.
  • Knowledge of MLOps, AI observability, and model evaluation frameworks.
  • Experience with enterprise security, compliance, and responsible AI governance. xrbllit
  • Advanced degree in Computer Science, Artificial Intelligence, Machine Learning, or related disciplines.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.juju.com
Prepare application

Good distractions

Loading talks and stories from around this role…