AI Agent Engineer

You’ll own the client’s voice AI infrastructure end to end - building a voice orchestration framework from the ground up on LiveKit that powers millions of live calls per month in production. What you’ll be doing

• Design and build an in-house voice orchestration framework on LiveKit from scratch
• Migrate existing AI agents from the current voice provider onto the new system
• Own prompt engineering and conversation design for agents handling millions of consumer interactions
• Optimize real-time voice performance - latency, turn-taking, and state management - at production scale
• Build testing and evaluation frameworks to continuously improve agent quality and business outcomes, Senior Distinguished AI Engineer At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader …
• 4 days ago +

• 3-8 years in backend engineering with hands-on voice AI infrastructure work
• Track record building and shipping production voice AI systems at scale, using LiveKit or a comparable voice framework
• Has built voice or agentic systems from the ground up - ideally as a founding engineer or at an early-stage startup
• Hands-on experience with a voice AI framework (LiveKit strongly preferred)
• Strong Node.js / JavaScript and AWS skills
• Excellent written communication, which is central to prompt and conversation design
• Based in the NYC area and able to work hybrid, 3+ days per week on-site

Nice to Haves

• Time at a well-regarded voice AI company
• A Big Tech background (e.g. Google, Meta, Roblox) paired with startup or voice AI side projects
• A CS or related technical degree from a strong university
• Prompt engineering and conversational flow design for voice agents

About the Company Our client is an early-stage, venture-backed startup building AI voice agents that automate consumer financial-services operations at scale. Their agents already outperform traditional human benchmarks by roughly 2x at a fraction of the cost, and the product has strong, demonstrated traction with real production volume behind it. This is a small, deeply technical team where you’ll work directly with the founders. Founded 2024 · ~8 people · Industry: Financial Services, AI, Fintech