AI Engineer

Insight Global is seeking an AI Engineer for a top internal technology organization focused on applied AI and automation. This candidate will play a hands-on builder role, rapidly prototyping and productionizing AI-powered applications that integrate directly into internal platforms. The role centers on prompt and agent design, evaluation, and quality-turning early AI concepts into reliable, user-facing features. Working closely with AI leadership, platform engineers, and data teams, this engineer will help scale a growing AI product ecosystem while shaping how AI is safely and effectively deployed across the organization

Day-to-Day:

• Build AI-powered features and PoCs in Python using LLMs, RAG pipelines, and agentic workflows
• Design, iterate, and version production prompts and system instructions
• Develop and maintain evaluation harnesses to measure accuracy, grounding, and task success
• Take AI PoCs to production by adding tests, logging, guardrails, and error handling
• Partner with platform and data engineers on integrations, APIs, and deployment
• Improve reusable AI building blocks (prompt templates, RAG scaffolding, eval utilities)
• Monitor AI feature quality, debug regressions, and triage evaluation drops
• Document prompts, evaluations, and AI feature behavior for auditability and knowledge sharing

3-5 years of professional software engineering experience with a recent focus on applied AI / LLM-based systems

• Strong Python skills, including FastAPI, async patterns, and Pydantic v2
• Hands-on experience shipping LLM-powered features (RAG, agents, tool/function calling, structured outputs)
• Experience with prompt engineering and building evaluation harnesses (offline and online)
• Experience working with at least one major model provider (OpenAI, Anthropic, Azure OpenAI, or similar)
• Ability to read/write SQL and work with relational databases (Postgres or similar)
• Familiarity with Azure services for deployment, storage, or model hosting
• Strong written and verbal communication skills
• Bias toward shipping quickly and iterating with real users

Nice to Have Skills & Experience

• Experience with agentic frameworks or orchestration tools (LangGraph, Semantic Kernel, Autogen, Power Automate)
• Experience integrating AI solutions within the Microsoft ecosystem (M365, SharePoint, Power Platform)
• Experience with vector databases, embeddings, and retrieval optimization
• Exposure to MLOps and observability tools (MLflow, Weights & Biases, eval dashboards)
• Open-source contributions or public technical writing in applied AI

Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.