> Markdown version of [/jobs/ext/225690-sr-ai-engineer](https://www.wearedevelopers.com/jobs/ext/225690-sr-ai-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Sr. AI Engineer - **Company:** Elevate Digital - **Location:** New York, NY, United States - **Experience:** Expert - **Salary:** $208,000.0 - **Contract:** Permanent contract - **Skills:** Clean Code Principles, Java (Programming Language), Application Programming Interfaces (APIs), Artificial Intelligence, Databases, Continuous Integration, Data Validation, Data Governance, Github, Python (Programming Language), PostgreSQL, Enterprise Messaging Systems, Microsoft SQL Server, Open Source Technology, Regression Testing, Software Engineering, SQL Databases, Systems Integration, Enterprise Data Management, Datadog, Data Logging, Enterprise Software Applications, Retrieval-Augmented Generation, Large Language Models, Prompt Engineering, Build Tools, Azure AKS, Restful APIs, GPT - **Published:** May 29, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=929c59b599d276dd ## About the Role Do you have experience in Systems integration?, **Must be able to work onsite in NY 3 days a week (Tues-Thurs) **Must be able to work with no sponsorship** Top Skills Python and Java, building LLM agents, MCP servers, and tool-use integrations against enterprise datasources and APIs. Nice to haves Funding and/or Finance domain experience highly preferred., · 7+ years of software engineering experience, with at least 2 years of hands-on work building LLM-based applications or AI-powered automation in production. · Strong proficiency in Python and Java, with experience building production services (not just notebooks and prototypes). · Hands-on experience with LLM APIs (Claude, OpenAI, or similar), including prompt engineering, function/tool calling, structured outputs, and context management. · Experience building LLM agents with tool-use capabilities-MCP servers, function calling, API orchestration, and multi-step workflows. · Strong understanding of AI safety and reliability patterns: output validation, hallucination mitigation, cost controls, rate limiting, and audit trails. · Practical knowledge of enterprise data sources and integration patterns (REST APIs, SQL databases, messaging systems). · Excellent engineering fundamentals: clean code, testing discipline, observability, and production-readiness. · Strong communication skills; you can explain AI capabilities and limitations to non-technical stakeholders with clarity and honesty. Nice to Have · Experience with RAG (Retrieval-Augmented Generation) pipelines, vector databases, and document processing at scale. · Familiarity with evaluation frameworks for LLM outputs (automated scoring, human-in-the-loop review, regression testing). · Experience in financial services, operations, or control-oriented domains where accuracy and auditability are non-negotiable. · Exposure to workflow orchestration (Temporal or similar) for managing multi-step agent processes. Tech Environment · Python and Java as primary languages. · LLM APIs: Claude (Anthropic), with exposure to other providers as needed. · MCP servers for tool-use integration; REST APIs for enterprise system connectivity. · AKS, PostgreSQL, SQL Server, and enterprise data stores. · GitHub Actions for CI/CD; observability tooling for agent monitoring. ## Description We're looking for an AI Engineer who can design and implement LLM-powered agents that integrate with internal systems to automate operational workflows. This isn't a research role-it's a building role. You'll work at the intersection of software engineering and applied AI, creating reliable, observable, production-grade automations that teams across Operations and Finance can trust and use daily. You'll build agents that interact with enterprise data sources and APIs, design tool-use integrations via MCP servers, implement guardrails and human-in-the-loop patterns, and ensure that everything you ship is auditable and operationally sound. This role begins as a consulting engagement with a right-to-hire path. What You'll Do · Design and implement LLM-powered agents that automate operational workflows-from document processing to data validation to exception handling. · Build tool-use integrations: connect agents to internal APIs, databases, and enterprise systems via MCP servers and structured tool definitions. · Implement guardrails, validation layers, and human-in-the-loop patterns that ensure correctness and maintain trust in automated outputs. · Partner with business stakeholders to identify high-value automation opportunities and translate them into scoped, deliverable agent workflows. · Design for observability: structured logging, decision traces, cost tracking, and clear "what happened / why" visibility for every agent action. · Build reusable patterns and frameworks for agent development-prompt management, evaluation harnesses, context assembly, and output validation. · Stay current on LLM capabilities, API patterns, and tooling (Claude, GPT, open-source models) and make pragmatic recommendations on model selection and architecture. · Collaborate with the architecture and engineering teams to ensure AI components integrate cleanly with the broader platform (auth, audit, data governance). ## Related Videos - [Coffee with Developers - Maria Apazoglou](https://www.wearedevelopers.com/videos/1209-coffee-with-developers-maria-apazoglou) - [Debugging in the Dark](https://www.wearedevelopers.com/videos/1658-debugging-in-the-dark) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [ Evaluating AI models for code comprehension](https://www.wearedevelopers.com/videos/1462-evaluating-ai-models-for-code-comprehension) - [Agentic employees in world's most downloaded FinTech app](https://www.wearedevelopers.com/videos/100123-agentic-employees-in-world-s-most-downloaded-fintech-app) - [Software Engineering Social Connection: Yubo’s lean approach to scaling an 80M-user infrastructure](https://www.wearedevelopers.com/videos/1583-software-engineering-social-connection-yubo-s-lean-approach-to-scaling-an-80m-user-infrastructure) ## Related Articles - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix)