AI Developer / Agentic AI Engineer

NJTECH INC.
Charlotte, NC, United States
3 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
4 years minimum
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Amazon Web Services Audit Trail Microsoft Azure Continuous Integration DevOps Information Extraction Python (Programming Language) Key Management Role-Based Access Control Regression Testing Software Engineering
+10 more
Management of Software Versions Google Cloud Cloud Platform System Data Ingestion Large Language Models Model Validation Backend Apache Kafka Amazon Simple Queue Service (SQS) Servicenow

Job description

  • Build and enhance LLM/agent orchestration (Planner/supervisor patterns, tool-using agents, routing, guardrails).
  • Implement intent classification information extraction validation and decision logic for servicing workflows
  • Developed tool calling integrations to downstream systems (CRM, workflow engine, core banking services, case management)
  • Implement human-in-the-loop workflows (review, approval, escalation, override) based on confidence/risk thresholds

Knowledge and grounding (RAG)

  • Design and implement retrieval-augmented generation (RAG) for policy procedure grounding and resolution guidance
  • Build knowledge ingestion pipelines with refresh/versioning
  • Improve answer quality via chunking strategies, embeddings re ranking and context management

Quality, Safety and Evaluation

  • Define and run evaluation frameworks: golden datasets, scenario tests, regression tests, and automated scoring.
  • Reduce hallucinations and risk by implementing prompt policies, constraints, structured outputs, and verification steps.
  • Partner with risk slash compliance to ensure traceability, audit logs, explain ability requirements are met.

Production Readiness and Operations

  • Implement observability for agents (latency, cost, tool failures, drift, quality signals, escalation rates).
  • Support CI/CD for agent prompts and configurations (versioning, approvals, rollback).
  • Collaborate with platform and security teams on secrets management, access controls, PII protections, and safe deployments.

Requirements

  • 4+ years of software engineering experience or equivalent with strong CS fundamentals
  • Hands-on experience building with LLMs and modern AI app stack (agents, RAG, tool/function calling).
  • Strong proficiency in Python and building back-end services/APIs.
  • Experience with at least one: LangChain / LangGraph, Llamalndex, Semantic Kernel or equivalent frameworks.
  • Experience with vector databases and search (e.g., Pinecone, Weaviate, Milvus, OpenSearch/Elastic, pgvector)
  • Experience deploying services in cloud environments (AWS/Azure/Google Cloud Platform) with basic DevOps practices
  • Strong understanding of security and privacy principles (PII handling, least privilege, audit logging), * Experience in financial services or other regulated domains (risk controls, compliance audit readiness)
  • Experience integrating with enterprise workflows (e.g., ServiceNow, Custom workflow engines, BPM/RPA)
  • Familiarity with model evaluation approaches (LLM-as-judge, rubric scoring, retrieval evals, offline/online testing)
  • Experience with messaging/eventing (Kafka/SQS), email ingestion pipelines, and document processing
  • Exposure to MRM concerns and governance (model cards, risk assessments, validation processes)

About the company

NJTECH is a globally managed IT service, IT consulting and Business solutions partner. Our “High Performance Business” strategy builds our expertise in technology and consulting. Our offshore consulting plays a major role in helping clients to achieve their objectives in the highest level; ultimately creating sustainable value to customers. Come, transform your career with us and be a part of our high-performing team.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:31 min

Evolving developer roles into tech leads for AI agents

Alfonso Graziano Alfonso Graziano · Coffee With Developers

56 sec

Integrating automated approval workflows into the portal

Markus Eisele Markus Eisele · World Congress 2025

1:52 min

Structuring and scaling the backend engineering team

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · World Congress 2026 Europe

2:27 min

Establishing a simulated technical environment for the workflow demo

Tobias Dunn-Krahn · LIVE

1:12 min

Choosing TypeScript for complex backend applications

Maximilian Otto Maximilian Otto · World Congress 2024

Videos

See all

Related articles

See all