AI DevEx Engineer

Incident IQ
Atlanta, GA, United States
2 days ago
Apply on startup.jobs
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

.NET Framework Artificial Intelligence Software Debugging AI Infrastructure ReactJS Large Language Models Generative AI Backend Front End Software Development

Job description

We are looking for a pragmatic and forward-thinking AI DevEx Engineer to join our AI Tooling team. In this role, you will be instrumental in building the skills, plugins, commands, and internal tools that empower our engineering team and cross-functional departments to work smarter and faster.

Initially, your primary focus will be expanding our custom plugins and agentic skills for Claude Code, which is heavily utilized by our engineering teams. As we grow, you will scale these efforts into multiple targeted plugins across different engineering disciplines. We need someone who is relentlessly focused on solving real business problems through Full Stack Agentic Development (FSAD). You will architect practical AI solutions, shape the “brain” of our agents, pioneer how we test AI outputs, and clearly articulate your decision-making process to the team. We are building complex, non-deterministic systems, which means this role requires deep resilience, patience, and a persistent focus on long-term goals despite inevitable setbacks., * Claude Code Tooling: Design and build out robust skills, tools, and agents for our internal Claude Code plugins, eventually scaling this architecture to support multiple distinct engineering workflows.

  • Agent Intelligence (The “Brain”): Manage, structure, and expand our internal reference library. You will be responsible for ensuring our agents have the right context and documentation to make highly accurate, business-aligned decisions.
  • Monitoring & Troubleshooting: Actively review agent runs, interactions, and logs generated by the engineering teams. You will identify failure points, debug complex agentic loops, and deploy fixes to improve reliability.
  • Pioneer FSAD Testing: Design and implement a comprehensive testing suite from the ground up tailored for Full Stack Agentic Development. You will establish robust methodologies to effectively test, evaluate, and benchmark non-deterministic AI results.
  • Architectural Leadership: Make sound architectural decisions across the stack (primarily utilizing .NET and React) to ensure scalability, security, and performance of our AI infrastructure.
  • Process Transparency: Clearly document and explain your code, architectural choices, and the step-by-step process used to achieve your solutions to technical and non-technical stakeholders.
  • Mentorship & Advocacy: Actively mentor and teach engineering teams, creating comprehensive documentation and maintaining an open, feedback-receptive mindset toward the tools you build.
  • Empathetic Development: Approach development with deep empathy for existing workflows, ensuring that new solutions enhance our current processes rather than disrupting them for the sake of ‘the latest’ tech., Your customers include the engineers, Product Owners, and Designers who rely on your tools. Success means broad adoption of your solutions and measurable improvements in their daily workflows. You will be a champion of the FSAD process, delivering solutions that align with company goals while navigating feedback to solve immediate issues without losing sight of our long-term vision. You will act as an AI Ambassador at IIQ-not only creating new frameworks but actively teaching others and serving as a key resource for those growing their AI proficiency.

Requirements

  • Technical AI Proficiency: Strong command of LLM/Agentic orchestration, including MCP integrations, AI debugging/evaluation methodologies, and core CS fundamentals. A focus on data security and privacy is critical.
  • Collaboration & Communication: Exceptional ability to listen, translate complex technical jargon into actionable insights for non-technical stakeholders, and advocate for user-centric solutions.
  • Cultural Fit & Pragmatism: A pragmatic approach to problem-solving that favors simple, scalable solutions over over-engineering. We value autonomy, adaptability to rapidly shifting AI landscapes, and a positive alignment to advancing our AI strategy.
  • Development: Strong general understanding of coding and architectural understanding, with highly preferred experience in .NET (backend) and React (frontend)., * Experience with Retrieval-Augmented Generation (RAG) pipelines, vector databases, or knowledge graphing.
  • Experience building internal Developer Experience (DevEx) tools.
  • Familiarity with AI evaluation (Evals) frameworks for scoring agent performance.

Benefits & conditions

  • We facilitate whole-person growth where employees can develop personally as well as professionally.
  • We offer an energetic and collaborative environment; everyone’s opinion matters!
  • We produce software that empowers K-12 schools to run efficiently, allowing for a better classroom experience for students to THRIVE!
  • We provide excellent work/life balance. Two amazing offices - a Downtown Atlanta office location and one at Halcyon in Alpharetta!

Incident IQ offers a competitive salary based on experience with a benefits package for full-time employees that includes medical, dental, vision, life insurance, 401k match, and paid-time off (PTO).

Incident IQ is an Equal Opportunity Employer FULL_TIME Organization https://startup.jobs/logos/52747 Incident IQ None Startups Place

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on startup.jobs
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:14 min

Exploring internal AI product initiatives and global engineering roles

Maria Apazoglou · Coffee With Developers

1:21 min

Exploring the target application for front end tests

Anna Mcdougall · JS Congress

1:52 min

Structuring and scaling the backend engineering team

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

2:37 min

Tracing the evolution from early AI to generative AI

Mike Mike · World Congress 2025

1:31 min

Essential AI and human skills for future teams

Alexander Weißhaupt Alexander Weißhaupt +1 · World Congress 2025

2:59 min

Introduction and transitioning into the tech industry

Anna Mcdougall · JS Congress

Videos

See all

Related articles

See all