Principal Software Engineer, AI
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
Job description
Pepperâs mission is to protect the integrity of every Americanâs employee benefit plan. We are a fast-growing team of technologists and CPAs working to build a modern audit firm that can serve as the fulfillment engine for federally mandated compliance work streams., Weâre looking for an experienced software engineer to help build and scale our audit workbench; a pipeline-based harness - not a generic agent loop - that takes an engagement from raw evidence to reviewable workpaper. As of today that looks roughly like:
- Ingestion and extraction
- Recomputation and exception detection
- Workpaper generation
- Eval infrastrcuture
- Frontend review surface
As one of the first engineering hires, you will help set the technical direction to ensure our audit wokrbench is usable and scalable from our our first 100 clients to our next 10,000.
The hard part
Most âbuild an AI agentâ roles optimize for demo velocity. This one optimizes for a number a CPA stakes their license on. The reliability of this system comes from schema design, deterministic rule logic, validation, and structured human review - not from hoping the model is good. Youâll spend as much time on the deterministic-versus-stochastic boundary, eval harnesses, and traceability as on prompts and orchestration. The model does extraction and narrative drafting; the math and the regulatory logic are exact code. If âbuild something auditable, reproducible, and provably correct in a regulated domainâ is more interesting to you than âship a chatbot,â youâll like it here.
Requirements
- Have shipped production LLM systems where correctness mattered - extraction pipelines, agentic workflows, or document-understanding systems - ideally in a domain with real consequences (fintech, legal, healthcare, regtech).
- Build evals as a reflex. Youâve maintained golden datasets and caught regressions before they reached users, and you treat âwe canât measure whether this got betterâ as an unacceptable state.
- Have strong judgment about where to use a model and where to write a deterministic function - with a hard bias toward the latter when dollars or compliance are on the line.
- Are a genuine 0 1 builder - you can own a system end-to-end, ship it, and operate it in production. Youâre energized, not unsettled, by being the second engineer in the building.
- Treat engineering hygiene as default, not overhead.
Benefits & conditions
Pulled from the full job description
- 401(k), Nice to haves
- Familiarity with accounting, audit, ERISA, 401(k) administration, or financial document processing. You do not need audit experience. Our partner CPAs own the domain end-to-end, and the regulatory logic lives in versioned, deterministic code youâll help build.
- Layout-aware / OCR extraction, retrieval systems, or structured-output generation.
- Experience building internal tools or review-and-approval UIs.
Logistics
- Compensation: Estimated $200,000-$300,000 base + equity
- Location: Remote-first (U.S.).š Columbus, Ohio is a plus but not required.
- Reporting: Directly to the founding team, partnering closely with our partner CPAs on domain and review standards.
We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.
Compensation Range: $200K - $300K
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role â technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Never delegate the understanding
How to Become an AI Engineer
Dev Digest 137 - AI'm not sure about this
Navigating the AI Shift