> Markdown version of [/jobs/ext/2008414-senior-ai-engineer-in-new-york](https://www.wearedevelopers.com/jobs/ext/2008414-senior-ai-engineer-in-new-york). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior AI Engineer in New York - **Company:** Energy Jobline - **Location:** New York, NY, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** A/B Testing, Artificial Intelligence, Audit Trail, Microsoft Azure, Cloud Computing, Code Review, Continuous Integration, Data as a Services, Data Infrastructure, Python (Programming Language), Modular Design, Open Source Technology, Regression Testing, Azure Machine Learning, Runbook, Search Technologies, Software Deployment, Software Engineering, Data Streaming, Software Technical Review, Management of Software Versions, Data Logging, Large Language Models, Multi-Agent Systems, Prompt Engineering, Generative AI, Kubernetes, Information Technology, Code Testing, Machine Learning Operations, GPT, Software Version Control, Data Pipelines, Api Management, Docker - **Published:** August 9, 2026 - **Apply:** https://www.energyjobline.com/job/senior-ai-engineer-new-york-31414302 ## About the Role You are a seasoned AI practitioner who has shipped production LLM and agentic systems, can reason through architectural trade-offs, and brings both depth (GenAI, RAG, agents, LLMOps) and breadth (software engineering, data infrastructure, cloud platforms). Beyond building, you will lead design and code reviews, mentor engineers, and actively shape how Lantern builds and operates AI at scale in a regulated healthcare environment., * Bachelor's or Master's degree in Computer Science, Engineering, or equivalent practical experience. * 5+ years of experience building and deploying production AI/ML systems, with at least 2-3 years focused on LLM and GenAI applications. * Strong proficiency in Python and software engineering fundamentals (testing, modular design, code reviews, documentation, version control). * Deep hands-on experience with LLM APIs (OpenAI, Azure OpenAI, Anthropic, Google, etc.) and advanced prompt engineering: chain-of-thought, few-shot, structured outputs, tool-calling, and multi-turn dialogue. * Proven experience designing and deploying production RAG systems: document processing, chunking strategies, embedding models, vector databases, hybrid retrieval, and retrieval evaluation. * Hands-on experience with agentic frameworks (LangChain, LangGraph, AutoGen, CrewAI, or custom orchestration) and production deployment of multi-step agent workflows. * Experience with LLM evaluation tooling (e.g., RAGAS, TruLens, DeepEval, or custom frameworks) and systematic approaches to measuring and improving output quality. * Experience with cloud platforms (preferably Azure) and containerized deployment (Docker, Kubernetes); familiarity with LLMOps/MLOps tooling (MLflow, Azure ML, W&B). * Strong communication and collaboration skills; proven ability to lead technical discussions and influence cross-functional partners. * Track record of mentoring engineers and elevating team engineering standards. Strong Candidates Will Also Have * Experience implementing safety, grounding, and compliance controls for AI systems in regulated industries (healthcare, finance, legal, etc.), including audit logging and PII handling. * Working knowledge of fine-tuning, RLHF, DPO, or parameter-efficient adaptation (LoRA, QLoRA) of open-source models for domain-specific tasks. * Experience with healthcare data, clinical documentation (e.g., clinical notes, ADT feeds), or claims workflows. * Architecture-level experience designing multi-agent systems at scale, including agent coordination patterns, distributed state management, and failure recovery. * Experience with streaming data pipelines, real-time inference, or event-driven AI architectures. * Contributions to open-source AI/LLM projects, applied research publications, or conference presentations., * You use LOGIC in your decision making and understand that progress is critical to making change. You focus on the execution of your content while balancing a fast-paced environment and you take the time to celebrate both the small & big wins. * is a core tenant of your personal beliefs. A diverse and inclusive environment is incredibly important to you. You understand and desire to be a part of a diverse team with different experiences and perspectives & you cherish the in each individual that you interact with. * You have the GRIT, drive and ambition to tackle big problems. Big problems require big ideas and a team that supports new ideas. * You care deeply for your customers are driven to keep HUMANITY in all decisions. Your customers aren't just the individuals using your product. They are the driving factor in your motivation to make a change. * Integrity guides you in life. Focusing on the TRUTH vs. giving people the answers they want to hear. * You thrive in a Team Environment. Collaboration is key in innovation and creating change. ## Description Generative AI & LLM Architecture * Architect and deliver production LLM-powered capabilities including advanced RAG pipelines, structured extraction, multi-document reasoning, dialogue systems, and domain-specific models. * Own prompt engineering strategy: design versioned, testable prompt pipelines; establish team standards for prompt management, evaluation, and continuous improvement. * Lead the selection and integration of embedding models, vector databases (e.g., Azure AI Search, Pinecone, Weaviate), and hybrid retrieval architectures; drive systematic retrieval quality improvement. * Define and implement LLM evaluation frameworks and automated quality benchmarks; establish guardrails, grounding strategies, and hallucination mitigation controls meeting healthcare compliance standards. * Evaluate frontier and open-source models (GPT-4.5, GPT-5.x, Claude, Gemini, Llama, Mistral, etc.); lead model selection decisions and maintain awareness of the evolving AI landscape to inform roadmap choices. Agentic Systems Design & Leadership * Lead the architecture and implementation of production agentic systems - including multi-agent orchestration, planning, tool-use, memory, and state persistence - using frameworks such as LangGraph, AutoGen, CrewAI, or custom layers. * Design robust human-in-the-loop mechanisms, approval workflows, fallback strategies, and audit trails to ensure agentic systems meet safety, compliance, and clinical trust requirements. * Establish patterns for tool-use and function-calling that allow agents to interact reliably with external APIs, clinical systems, and internal data services. * Define standards for agent observability: trace logging, step-level monitoring, behavioral drift detection, and structured evaluation of multi-step agent runs. Engineering Leadership & MLOps * Write production-quality, modular, and well-tested code; set the technical bar through rigorous design and code reviews across the AI engineering team. * Architect and maintain LLM inference services, API integrations, and supporting data pipelines on Azure; drive performance, reliability, and cost optimization. * Define and champion LLMOps practices: prompt versioning, experiment tracking, model registration, A/B testing, CI/CD for AI pipelines, and automated regression testing for LLM outputs. * Establish production monitoring and observability for AI systems: latency, quality scores, cost tracking, safety metrics, and behavioral drift alerting. * Lead technical documentation: architecture decision records, runbooks, model cards, and evaluation playbooks. Cross-Functional Partnership & Mentorship * Serve as the primary technical partner for product, clinical operations, marketing, and data teams; translate complex requirements into well-scoped, high-impact AI initiatives. * Mentor and grow junior and mid-level engineers through pairing, design reviews, knowledge-sharing, and feedback on AI engineering practices. * Lead architecture discussions and contribute to the AI engineering roadmap; represent the team's technical perspective in cross-functional planning. * Drive adoption of GenAI and agentic capabilities across the organization by communicating technical concepts clearly to non-engineering stakeholders. ## Related Videos - [ Evaluating AI models for code comprehension](https://www.wearedevelopers.com/videos/1462-evaluating-ai-models-for-code-comprehension) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Technical Documentation - How Can I Write Them Better and Why Should I Care?](https://www.wearedevelopers.com/videos/681-technical-documentation-how-can-i-write-them-better-and-why-should-i-care) - [How to Avoid LLM Pitfalls - Mete Atamel and Guillaume Laforge](https://www.wearedevelopers.com/videos/1328-how-to-avoid-llm-pitfalls-mete-atamel-and-guillaume-laforge) - [Agentic employees in world's most downloaded FinTech app](https://www.wearedevelopers.com/videos/100123-agentic-employees-in-world-s-most-downloaded-fintech-app) - [Bridging AI and Nomad: a Go-based MCP Server for Cluster Control](https://www.wearedevelopers.com/videos/2063-bridging-ai-and-nomad-a-go-based-mcp-server-for-cluster-control) ## Related Articles - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it) - [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path)