Senior Full Stack Engineer

US LABS INC
Chicago, IL, United States
1 day ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

AI Evaluation .NET Framework Application Programming Interfaces (APIs) Artificial Intelligence Microsoft Azure Continuous Integration Data Files Python (Programming Language) Regression Testing SQL Databases Management of Software Versions Scripting
+6 more
Retrieval-Augmented Generation Large Language Models Prompt Engineering Agentic-AI AngularJS Web Api

Job description

  • Develop production-ready Agentic AI applications using LLMs, tool calling, structured outputs, prompt/context engineering, and multi-step workflows.
  • Build full-stack solutions using Angular, .NET Web APIs, Python, SQL, and Microsoft Azure.
  • Design AI evaluation pipelines with test datasets, scoring rubrics, acceptance criteria, automated checks, and human review.
  • Evaluate LLM accuracy, source evidence, tool execution, retrieval quality, and end-to-end task success.
  • Integrate AI regression testing, prompt/dataset versioning, baseline comparisons, and quality gates into CI/CD.
  • Implement RAG, conversation management, enterprise integrations, and secure authentication/authorization.
  • Monitor production quality, latency, cost, failures, and observability; ensure reliability through retries, timeouts, cancellation, and recovery.

Requirements

Artificial Intelligence (AI), Application Programming Interface (API), Microsoft .NET, SQL (Structured Query Language), Python Programming/Scripting Language, Microsoft Windows Azure, Data Sets, Testing, Regression Testing, Continuous Integration

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…