Real-Time Voice AI Agent Systems Engineer

SGA CAPITAL LLC
New York, NY, United States
22 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Compensation
$200,000.0 - $300,000.0
Working hours
Regular working hours

Tech stack

A/B Testing Automatic Call Distributor Artificial Intelligence Amazon Web Services Systems Engineering Node.Js Performance Tuning Regression Testing Software Systems SQL Databases Core Voice Platform Real Time Systems
+4 more
Chatbots Prompt Engineering Backend Low Latency

Job description

The selected engineer will own the technical foundation behind millions of real-world AI voice interactions-from LiveKit architecture and orchestration to prompting, speech performance, testing, reliability, and continuous optimization. This position requires more than traditional backend development. The successful candidate must understand how infrastructure, conversational logic, speech systems, latency, and business outcomes intersect. The engineer will have significant ownership over how AI agents communicate, respond, recover from edge cases, and perform at scale., * Build and own production voice AI infrastructure using LiveKit.

  • Architect real-time voice-agent systems covering orchestration, state management, reliability, latency, and conversational execution.
  • Develop the prompting architecture governing conversation flows, tone, guardrails, compliant phrasing, exception handling, and agent behavior.
  • Create scalable testing and evaluation frameworks incorporating A/B testing, regression testing, conversation QA, benchmarking, and KPI measurement.
  • Analyze production interaction data and translate findings into measurable improvements in agent performance.
  • Optimize ASR, STT, TTS, turn-taking, interruption handling, state transitions, and real-time conversational responsiveness.
  • Build infrastructure capable of reliably supporting millions of voice interactions.
  • Develop migration tooling and processes for transitioning customers from legacy voice infrastructure while preserving required customizations.
  • Identify and resolve performance bottlenecks, reliability issues, conversational failures, and production edge cases.
  • Partner closely with Product, Operations, and leadership to translate commercial objectives into technical systems and effective agent behavior.
  • Continuously expand conversational coverage as new customer scenarios and operational requirements emerge., HireNow Staffing is recruiting a Real-Time Voice AI Agent Systems Engineer who:
  • Combines strong backend/infrastructure engineering with meaningful voice AI, conversational AI, speech, or agentic-system experience.
  • Has hands-on expertise with Node.js, AWS, SQL, and LiveKit or comparable technology.
  • Can architect real-time production systems rather than focusing exclusively on application-level development.
  • Understands prompting as an engineering discipline involving conversational logic, guardrails, testing, edge cases, and measurable performance.
  • Can optimize speech-agent behavior across latency, turn-taking, interruptions, state transitions, and reliability.
  • Has successfully shipped production technology in a fast-moving environment.
  • Uses data and testing to connect technical improvements directly to business results.
  • Can work onsite in Manhattan 4-5 days per week without requiring employment sponsorship.

Requirements

  • 3+ years of platform, infrastructure, backend, or comparable production engineering experience.
  • 2+ years of experience involving voice AI, conversational AI, speech systems, prompt engineering, or related agentic workflows.
  • Strong hands-on development experience with Node.js.
  • Strong experience with AWS and SQL.
  • Experience designing and shipping production systems within a startup or similarly fast-moving engineering environment.
  • Hands-on experience with LiveKit or a comparable voice orchestration/agent framework.
  • Strong understanding of real-time system architecture, state management, reliability, and performance optimization.
  • Demonstrated ability to design clear, resilient, and effective conversational prompts and agent flows.
  • Strong analytical ability with experience connecting engineering decisions to measurable operational or business outcomes.
  • Excellent written and verbal English communication skills.
  • High degree of technical ownership and ability to execute with limited oversight.
  • Must reside in or be willing to relocate to the New York City area.
  • Must be able to work onsite in Manhattan 4-5 days per week.
  • Must be permanently authorized to work in the United States.
  • No visa sponsorship is available., * Production experience with SIP trunking and telephony infrastructure.
  • Experience developing real-time audio pipelines.
  • Knowledge of call routing, telephony carriers, and communication integrations.
  • Experience operating speech infrastructure at significant production scale.
  • Advanced knowledge of ASR/STT, TTS, interruption management, latency optimization, and conversational turn-taking.
  • Experience building evaluation frameworks for production AI agents.
  • Background in debt collection, financial services, fintech, or regulated consumer communications.
  • Experience working in an early-stage or Seed-stage startup environment.
  • Experience connecting agent-performance metrics to conversion, containment, satisfaction, or other commercial KPIs., * Direct experience building production voice AI infrastructure from the ground up.
  • Deep hands-on LiveKit experience.
  • Proven experience supporting voice or conversational systems operating at significant interaction volume.
  • Expertise spanning real-time infrastructure, speech technology, prompting, evaluation, and performance optimization rather than only one discipline.
  • Experience with SIP, telephony carriers, real-time audio pipelines, and production call infrastructure.
  • Strong experimentation skills using A/B tests, regression testing, benchmarking, and conversation-quality analysis.
  • Demonstrated improvements to measurable AI-agent KPIs or business outcomes.
  • Experience operating successfully within small, highly technical startup teams.
  • Knowledge of regulated financial-services or consumer-communications environments.
  • Stable employment history demonstrating increasing engineering ownership., * Less than three years of relevant platform, infrastructure, backend, or comparable engineering experience.
  • No meaningful voice AI, conversational AI, speech-system, prompt-engineering, or related agentic-workflow experience.
  • No experience shipping production-grade systems.
  • Insufficient hands-on experience with Node.js, AWS, or SQL.
  • No exposure to LiveKit or comparable voice-agent/orchestration frameworks.
  • Candidates whose experience is limited to prompt writing without sufficient production engineering expertise.
  • Candidates unable to work onsite in Manhattan 4-5 days per week or relocate accordingly.

Benefits & conditions

Applicant Requirements: Candidates must be based in or willing to relocate to the New York City area and able to meet the in-person requirement.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

45 sec

Working securely with Node.js path application programming interfaces

Sonya Moisset · World Congress 2023

1:52 min

Structuring and scaling the backend engineering team

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

1:00 min

Introduction to chatbot infrastructure and cloud challenges

Stan Girard Stan Girard · World Congress 2024

4:16 min

Addressing latency and architecture in voice agents

Chris Heilmann +2 · LIVE

3:55 min

Identifying underlying Node.js runtime vulnerabilities using fuzzing tools

Sonya Moisset · World Congress 2023

5:57 min

Developing custom voice AI versus ecosystem platforms

Lee Boonstra · LIVE

Videos

See all

Related articles

See all