Sr. AI Engineer

Elevate Digital
New York, NY, United States
2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Compensation
$208,000.0
Working hours
Regular working hours
Job source

Tech stack

Clean Code Principles Java (Programming Language) Application Programming Interfaces (APIs) Artificial Intelligence Databases Continuous Integration Data Validation Data Governance Github Python (Programming Language) PostgreSQL Enterprise Messaging Systems
+17 more
Microsoft SQL Server Open Source Technology Regression Testing Software Engineering SQL Databases Systems Integration Enterprise Data Management Datadog Data Logging Enterprise Software Applications Retrieval-Augmented Generation Large Language Models Prompt Engineering Build Tools Azure AKS Restful APIs GPT

Job description

We’re looking for an AI Engineer who can design and implement LLM-powered agents that integrate with internal systems to automate operational workflows. This isn’t a research role-it’s a building role. You’ll work at the intersection of software engineering and applied AI, creating reliable, observable, production-grade automations that teams across Operations and Finance can trust and use daily.

You’ll build agents that interact with enterprise data sources and APIs, design tool-use integrations via MCP servers, implement guardrails and human-in-the-loop patterns, and ensure that everything you ship is auditable and operationally sound.

This role begins as a consulting engagement with a right-to-hire path.

What You’ll Do

· Design and implement LLM-powered agents that automate operational workflows-from document processing to data validation to exception handling.

· Build tool-use integrations: connect agents to internal APIs, databases, and enterprise systems via MCP servers and structured tool definitions.

· Implement guardrails, validation layers, and human-in-the-loop patterns that ensure correctness and maintain trust in automated outputs.

· Partner with business stakeholders to identify high-value automation opportunities and translate them into scoped, deliverable agent workflows.

· Design for observability: structured logging, decision traces, cost tracking, and clear “what happened / why” visibility for every agent action.

· Build reusable patterns and frameworks for agent development-prompt management, evaluation harnesses, context assembly, and output validation.

· Stay current on LLM capabilities, API patterns, and tooling (Claude, GPT, open-source models) and make pragmatic recommendations on model selection and architecture.

· Collaborate with the architecture and engineering teams to ensure AI components integrate cleanly with the broader platform (auth, audit, data governance).

Requirements

Do you have experience in Systems integration?, **Must be able to work onsite in NY 3 days a week (Tues-Thurs)

Must be able to work with no sponsorship

Top Skills

Python and Java, building LLM agents, MCP servers, and tool-use integrations against enterprise datasources and APIs.

Nice to haves

Funding and/or Finance domain experience highly preferred., · 7+ years of software engineering experience, with at least 2 years of hands-on work building LLM-based applications or AI-powered automation in production.

· Strong proficiency in Python and Java, with experience building production services (not just notebooks and prototypes).

· Hands-on experience with LLM APIs (Claude, OpenAI, or similar), including prompt engineering, function/tool calling, structured outputs, and context management.

· Experience building LLM agents with tool-use capabilities-MCP servers, function calling, API orchestration, and multi-step workflows.

· Strong understanding of AI safety and reliability patterns: output validation, hallucination mitigation, cost controls, rate limiting, and audit trails.

· Practical knowledge of enterprise data sources and integration patterns (REST APIs, SQL databases, messaging systems).

· Excellent engineering fundamentals: clean code, testing discipline, observability, and production-readiness.

· Strong communication skills; you can explain AI capabilities and limitations to non-technical stakeholders with clarity and honesty.

Nice to Have

· Experience with RAG (Retrieval-Augmented Generation) pipelines, vector databases, and document processing at scale.

· Familiarity with evaluation frameworks for LLM outputs (automated scoring, human-in-the-loop review, regression testing).

· Experience in financial services, operations, or control-oriented domains where accuracy and auditability are non-negotiable.

· Exposure to workflow orchestration (Temporal or similar) for managing multi-step agent processes.

Tech Environment

· Python and Java as primary languages.

· LLM APIs: Claude (Anthropic), with exposure to other providers as needed.

· MCP servers for tool-use integration; REST APIs for enterprise system connectivity.

· AKS, PostgreSQL, SQL Server, and enterprise data stores.

· GitHub Actions for CI/CD; observability tooling for agent monitoring.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

40 sec

Generative pre-trained transformer models powering code completions

lgonta lgonta +1 · WWC 2024

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · WWC 2023

5:34 min

Managing token budgets and enterprise usage of coding agents

Chris Heilmann +2 · LIVE

1:49 min

Augmenting junior and principal engineering roles with AI

Neel Sundaresan Neel Sundaresan +1 · WWC Europe 2026

51 sec

Assessing GPT-4o performance for pull request feedback

Merrill Lutsky Merrill Lutsky · WWC 2025

2:14 min

Exploring internal AI product initiatives and global engineering roles

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all