AI Engineer

Alltech Consulting Services
New York, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
$ 146K

Job location

New York, United States of America

Tech stack

API
Artificial Intelligence
Azure
Monitoring of Systems
Python
Regression Testing
Search Technologies
SQL Databases
React
Large Language Models
Multi-Agent Systems
FastAPI
Machine Learning Operations
Virtual Agents
REST
Automation Anywhere
Api Management
Serverless Computing
Docker
Microservices

Job description

We are looking for a highly skilled AI Tech Lead to architect and deliver governed AI, document intelligence, and intelligent automation solutions. The role focuses on designing evidence-grounded agentic workflows that combine LLM reasoning, deterministic validation, human review, and enterprise governance.

Agentic AI & Intelligent Automation

  • Design governed agentic workflows, including single-agent and multi-agent patterns where appropriate.
  • Define the appropriate balance of LLM reasoning, deterministic rules, validation services, and human review based on business risk.
  • Build workflows with confidence handling, exception queues, reviewer actions, risk-aware controls, and traceable decision making.

Document Intelligence & Evidence-Grounded AI

  • Architect evidence-grounded AI workflows for document-heavy Audit, Tax, Advisory, and benefits-administration use cases.
  • Design extraction and decision workflows with source traceability, confidence handling, and reproducible audit artifacts.
  • Ensure AI outputs are explainable and evidence-backed.

Production Engineering & Azure Ownership

  • Own secure Azure production architecture including Entra ID, APIs, Container Apps, Functions, AI Search, observability, and operational readiness.
  • Drive deployment, release controls, rollback readiness, incident diagnosis, and cost optimization.

Evaluation, Governance & Quality

  • Establish evaluation, regression, traceability, and approval mechanisms for prompts, models, configurations, and business-rule changes.
  • Develop benchmark datasets, drift analysis, validation frameworks, and quality gates.

Leadership

  • Translate ambiguous client and SME needs into scoped technical designs, delivery plans, acceptance criteria, and risk decisions.
  • Lead client-facing technical discovery and mentor engineers through design, implementation, testing, and production support.

Requirements

  • Azure OpenAI, RAG, Azure AI Search, Azure Document Intelligence
  • Python, FastAPI, REST APIs, SQL, Microservices
  • Azure Container Apps, Azure Functions, API Management, Entra ID, Docker
  • LLMOps, evaluation, regression testing, monitoring and observability
  • React integration, MCP concepts, coding agents (Codex, Claude Code)
  • Audit, Tax, Advisory, Benefits Administration domain experience

Apply for this position