AI Engineer

As a Senior AI Engineer, you will design, build, and operate the AI systems behind Vertafore’s next generation of products for agencies, MGAs, and carriers. You will build production-grade agents that can reason through complex, multi-step insurance workflows, and you will be responsible for making those systems reliable, measurable, and safe in a highly regulated industry.

You will work in small pods with complete agency to build end to end products. This role is hands-on. You’ll be expected to directly contribute to the successful implementation and launch of critical features and empowered to make the decisions needed to get there. Vertafore designs these pods as end to end development teams so fluidity going up and down the stack is expected.

We are looking for an engineer who is strong in software and systems engineering, understands machine learning well, and has a habit of shipping. You use the latest agentic coding tools to work faster, and you hold yourself fully accountable for the quality, security, and correctness of what you ship.

Core Requirements and Responsibilities:

Essential job functions included but are not limited to the following:

· Design, build, and deploy complex reasoning agents and multi-agent systems for production workloads using LangGraph and related Python orchestration frameworks

· Architect agent workflows, including state management, tool use, memory, planning, human-in-the-loop checkpoints, error recovery, and fallback behavior

· Design and build clean, well-documented, versioned APIs that expose AI capabilities to Vertafore products and to external partners

· Define and own evaluation strategy for AI systems. This includes building eval datasets, writing graders (programmatic, model-based, and human review), running offline and online evaluations, and turning results into concrete improvements

· Set up regression testing for prompts, models, and agent behavior so that changes ship with measurable confidence

· Instrument AI systems for observability, including tracing, latency, cost, token usage, failure modes, and quality metrics in production

· Build retrieval and context pipelines (RAG, document processing, structured extraction) over insurance data such as policies, submissions, and compliance documents

· Troubleshoot and resolve production issues across the AI stack, from model behavior to infrastructure

· Expert-level Python, including writing idiomatic, typed, tested, production-quality code and using async programming

· Solid understanding of ML fundamentals, including model training and generalization, overfitting, bias and variance, embeddings, classification and ranking metrics, and statistical significance

· Deep understanding of how large language models behave in practice, including failure modes, non-determinism, context limits, and strategies for reliable outputs

· Rigorous, experimental mindset; you form hypotheses, measure, and let data drive decisions rather than intuition about model output, · Bachelor’s degree in Computer Science, Engineering, Physics, Mathematics, or a related field, or equivalent practical experience

· 7+ years of professional software engineering experience, with significant time building backend services and systems in Python

· 2+ years building and shipping LLM-powered applications or agentic systems to production

· Hands-on production experience with LangGraph (or comparable agent orchestration frameworks such as LangChain, LlamaIndex, or custom orchestration)

· 5+ years designing and building RESTful APIs (experience with FastAPI or similar frameworks preferred)

· Demonstrated experience designing and running evaluations for ML or LLM systems, and using results to drive measurable quality improvements

· Experience with cloud platforms (AWS preferred), Docker, and CI/CD pipelines

Preferred Qualifications:

· Experience with LLM observability and evaluation tooling (such as LangSmith, Langfuse, Braintrust, or similar)

· Experience with fine-tuning, embedding model selection, or classical ML pipelines

· Experience in insurance, financial services, healthcare, or another regulated industry

· Experience with Model Context Protocol (MCP) or building tool integrations for agents

· Open-source contributions or public writing on AI engineering

Additional Requirements and Details:

• Travel required up to 10% of the time.

• Located and working from an office location.

• Occasional lifting and/or moving up to 10 pounds., The selected candidate must be legally authorized to work in the United States.

Design, build, deploy, and operate production AI agents and multi-agent systems for insurance workflows. Responsibilities include agent orchestration, APIs, RAG pipelines, evaluation frameworks, regression testing, observability, production troubleshooting, and reliability improvements. The role requires hands-on Python software engineering, LLM application development, cloud infrastructure, and collaboration in end-to-end product pods. The summary above was generated by AI

Our fast-paced and collaborative environment inspires us to create, think, and challenge each other in ways that make our solutions and our teams better. Whether you’re interested in engineering or development, marketing or sales, or something else - if this sounds like you, then we’d love to hear from you!

We are headquartered in Denver, Colorado, with offices in the US, Canada, and India.

$175,000 + $210,000 + Bonus

The insurance industry runs on Vertafore. We equip agencies, MGAs, and carriers with the core digital systems, specialized AI, and data-driven foundation to eliminate distribution drag across the insurance lifecycle, spanning sales, servicing, and back-office operations.

Underpinned by unmatched speed and performance power, we are the trusted backbone that’s taking the insurance industry from friction to flow with Distribution Velocity - speed, performance, and trust - to drive growth at scale.

With over 95% of the top agencies and insurers and 50% of industry compliance transactions running through Vertafore, we lead at the intersection of innovation and trust, giving insurance professionals the confidence to transform and win in the AI era.

Our reach is global, with headquarters in Denver, Colorado, and offices across the U.S., Canada, and India., * The opportunity to work in a space where modern technology meets a stable and vital industry

• Medical, vision & dental plans
• Life, AD&D
• Short Term and Long Term Disability
• Pension Plan & Employer Match
• Maternity, Paternity and Parental Leave
• Employee and Family Assistance Program (EFAP)
• Education Assistance
• Additional programs - Employee Referral and Internal Recognition

Why Vertafore is the place for you: *US Only

• The opportunity to work in a space where modern technology meets a stable and vital industry
• We have a Flexible First work environment! Our North America team members use our offices for collaboration, community and team-building, with members asked to sometimes come into an office and/or travel depending on job responsibilities. Other times, our teams work from home or a similar environment.
• Medical, vision & dental plans
• PPO & high-deductible options
• Health Savings Account & Flexible Spending Accounts Options:
• Health Care FSA
• Dental & Vision FSA
• Dependent Care FSA
• Commuter FSA
• Life, AD&D (Basic & Supplemental), and Disability
• 401(k) Retirement Savings Plain & Employer Match
• Supplemental Plans - Pet insurance, Hospital Indemnity, and Accident Insurance
• Parental Leave & Adoption Assistance
• Employee Assistance Program (EAP)
• Education & Legal Assistance
• Additional programs - Tuition Reimbursement, Employee Referral, Internal Recognition, and Wellness
• Commuter Benefits (Denver)

Over the past 50 years, Vertafore has advanced the entire insurance distribution channel with the best software solutions in the industry. Today, we’re proud to say hundreds of thousands of Vertafore users rely on our solutions to write business faster, reduce costs, and fuel growth by increasing collaboration and streamlining processes. Vertafore leads the industry with secure, cloud-based mobile products that provide superior reporting and analytics, delivering actionable insight- right when customers need it most. We partner with other leading technology companies to deliver comprehensive solutions to improve the way our customers do business and serve their customers.

The Vertafore Way

Insurance is about relationships, and technology should make those relationships stronger. That’s why, at Vertafore, it’s our mission to transform the way the industry operates by putting people at the heart of insurance technology. By focusing on our customers, becoming better every day, and delivering results you can see, we provide the level of trust and security that insurance is all about.

· Bias to Action: We’re united by an innate drive to take action and make a difference in the technology and insurance spaces.

· Win Together: We work together as one team, showing empathy and respect along the way.

· Show Up Curious: We work to challenge one another to push boundaries and think beyond the box.

· Say It, Do It: We honor every one of our commitments because integrity is important to us.

· Customer Success is Our Success: We cultivate authentic relationships and follow up by actively listening to their needs.

· We Love Insurance: We appreciate the impact insurance has on the world.