Senior AI Engineer - New York, NY

NextDeavor, Inc.
New York, NY, United States
1 day ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Compensation
$150,000.0 - $220,000.0
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Software System Penetration Testing Code Review Decision Support Systems Mobile Application Software Python (Programming Language) Open Source Technology Open Web Application Security Inference Optimization Red Team (Cyber Security) Reverse Engineering
+11 more
Pytorch DeepSpeed Large Language Models Multi-Agent Systems Discretization Kubernetes Low Latency HuggingFace Transformer Architectures TensorRT Data Generation

Job description

You will help build and advance autonomous offensive security agents and the models that power them, delivering capabilities that improve exploit chaining, multimodal vision, mobile coverage, and customer-facing accuracy. You will collaborate with engineering and platform stakeholders to ship production-grade systems and run in EST hours as a remote contributor. Here’s How You’ll Make an Impact on the Team

  • Design, implement, and iterate on named agents, including orchestration patterns, hand-offs, planning loops, tool use, and shared memory
  • Contribute to model training and fine-tuning across data curation, supervised fine-tuning (SFT), preference optimization (DPO/GRPO/RLHF-style), and evaluation
  • Extend the co-evolutionary self-training (Javelin) loop so the system improves from its engagements
  • Build self-improvement systems (false-positive detection, tiered skill learning, agent directives, code-patch proposals) and pipelines for human approval
  • Design security-specific evaluations covering OWASP Top 10, exploit chaining, finding accuracy, and agent reliability; track performance over model and agent changes
  • Contribute to multimodal (vision) and mobile (iOS/Android) coverage and BYOK support efforts
  • Own production reliability: latency, cost, observability, failure-mode analysis, and Kubernetes-based deployment
  • Improve customer-facing accuracy surfaces and live accuracy gauges exposed to customers

Requirements

  • 5+ years building production ML/AI systems, including at least 2 years working directly on LLMs or LLM-powered agents
  • Deep Python and strong production engineering practices (testing, code review, observability)
  • Hands-on fine-tuning experience: SFT, preference optimization (DPO, GRPO, RLHF/RLAIF), data curation, and synthetic data generation
  • Strong grasp of transformer architectures and training stack (PyTorch, Hugging Face, DeepSpeed or FSDP, accelerate)
  • Experience designing and shipping multi-agent or tool-using LLM systems in production
  • Rigorous evaluation design experience: building harnesses, tracking experiments, and data-driven decision making
  • Inference optimization experience (vLLM, TensorRT-LLM, quantization, throughput/latency tradeoffs)
  • Familiarity with retrieval pipelines, vector stores, and structured memory for agents
  • Kubernetes and containerized deployment fluency
  • Genuine interest in offensive security and the ability to ramp quickly on OWASP Top 10, API/web/mobile pentesting concepts

Here’s What Else Might Help You Out

  • Offensive security certifications or experience (OSCP/OSWE/OSWA, CTF, bug bounty, red team)
  • Research publications at top ML/security venues or open source contributions to agent/LLM tooling
  • Experience with adversarial ML or red-teaming AI systems
  • Familiarity with mobile app reverse engineering or binary analysis

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Loading talks and stories from around this role…