> Markdown version of [/jobs/ext/1150731-principal-software-engineer-ai](https://www.wearedevelopers.com/jobs/ext/1150731-principal-software-engineer-ai). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Principal Software Engineer, AI - **Company:** Pepper Auditors PLLC - **Location:** Columbus, OH, United States (Remote available) - **Salary:** $200,000.0 - $300,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Large Language Models, Front End Software Development, Virtual Agents - **Published:** July 2, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=151aa12b978424de ## About the Role * Have shipped production LLM systems where correctness mattered - extraction pipelines, agentic workflows, or document-understanding systems - ideally in a domain with real consequences (fintech, legal, healthcare, regtech). * Build evals as a reflex. You've maintained golden datasets and caught regressions before they reached users, and you treat "we can't measure whether this got better" as an unacceptable state. * Have strong judgment about where to use a model and where to write a deterministic function - with a hard bias toward the latter when dollars or compliance are on the line. * Are a genuine 0 1 builder - you can own a system end-to-end, ship it, and operate it in production. You're energized, not unsettled, by being the second engineer in the building. * Treat engineering hygiene as default, not overhead. ## Description Pepper's mission is to protect the integrity of every American's employee benefit plan. We are a fast-growing team of technologists and CPAs working to build a modern audit firm that can serve as the fulfillment engine for federally mandated compliance work streams., We're looking for an experienced software engineer to help build and scale our audit workbench; a pipeline-based harness - not a generic agent loop - that takes an engagement from raw evidence to reviewable workpaper. As of today that looks roughly like: * Ingestion and extraction * Recomputation and exception detection * Workpaper generation * Eval infrastrcuture * Frontend review surface As one of the first engineering hires, you will help set the technical direction to ensure our audit wokrbench is usable and scalable from our our first 100 clients to our next 10,000. The hard part Most "build an AI agent" roles optimize for demo velocity. This one optimizes for a number a CPA stakes their license on. The reliability of this system comes from schema design, deterministic rule logic, validation, and structured human review - not from hoping the model is good. You'll spend as much time on the deterministic-versus-stochastic boundary, eval harnesses, and traceability as on prompts and orchestration. The model does extraction and narrative drafting; the math and the regulatory logic are exact code. If "build something auditable, reproducible, and provably correct in a regulated domain" is more interesting to you than "ship a chatbot," you'll like it here. ## Related Videos - [Guiding Agentic AI with Vue](https://www.wearedevelopers.com/videos/2033-guiding-agentic-ai-with-vue) - [Creating Industry ready solutions with LLM Models](https://www.wearedevelopers.com/videos/899-creating-industry-ready-solutions-with-llm-models) - [Edit Your Future: Queerverse Radical AI](https://www.wearedevelopers.com/videos/909-edit-your-future-queerverse-radical-ai) - [You are not an AI developer](https://www.wearedevelopers.com/videos/1148-you-are-not-an-ai-developer) - [Bringing the power of AI to your application.](https://www.wearedevelopers.com/videos/1010-bringing-the-power-of-ai-to-your-application) - [Angstfreude - AI and Corporate Culture - The Thrill and the Threat](https://www.wearedevelopers.com/videos/100354-angstfreude-ai-and-corporate-culture-the-thrill-and-the-threat) ## Related Articles - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [Never delegate the understanding](https://www.wearedevelopers.com/magazine/749-never-delegate-the-understanding) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)