Senior AI Engineer - New York, NY
NextDeavor, Inc.
New York, NY, United States
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerjet.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Compensation
$150,000.0 - $220,000.0
Working hours
Regular working hours
Job source
Tech stack
Application Programming Interfaces (APIs)
Artificial Intelligence
Software System Penetration Testing
Code Review
Decision Support Systems
Mobile Application Software
Python (Programming Language)
Open Source Technology
Open Web Application Security
Inference Optimization
Red Team (Cyber Security)
Reverse Engineering
+11 more
Pytorch
DeepSpeed
Large Language Models
Multi-Agent Systems
Discretization
Kubernetes
Low Latency
HuggingFace
Transformer Architectures
TensorRT
Data Generation
Job description
You will help build and advance autonomous offensive security agents and the models that power them, delivering capabilities that improve exploit chaining, multimodal vision, mobile coverage, and customer-facing accuracy. You will collaborate with engineering and platform stakeholders to ship production-grade systems and run in EST hours as a remote contributor. Here’s How You’ll Make an Impact on the Team
- Design, implement, and iterate on named agents, including orchestration patterns, hand-offs, planning loops, tool use, and shared memory
- Contribute to model training and fine-tuning across data curation, supervised fine-tuning (SFT), preference optimization (DPO/GRPO/RLHF-style), and evaluation
- Extend the co-evolutionary self-training (Javelin) loop so the system improves from its engagements
- Build self-improvement systems (false-positive detection, tiered skill learning, agent directives, code-patch proposals) and pipelines for human approval
- Design security-specific evaluations covering OWASP Top 10, exploit chaining, finding accuracy, and agent reliability; track performance over model and agent changes
- Contribute to multimodal (vision) and mobile (iOS/Android) coverage and BYOK support efforts
- Own production reliability: latency, cost, observability, failure-mode analysis, and Kubernetes-based deployment
- Improve customer-facing accuracy surfaces and live accuracy gauges exposed to customers
Requirements
- 5+ years building production ML/AI systems, including at least 2 years working directly on LLMs or LLM-powered agents
- Deep Python and strong production engineering practices (testing, code review, observability)
- Hands-on fine-tuning experience: SFT, preference optimization (DPO, GRPO, RLHF/RLAIF), data curation, and synthetic data generation
- Strong grasp of transformer architectures and training stack (PyTorch, Hugging Face, DeepSpeed or FSDP, accelerate)
- Experience designing and shipping multi-agent or tool-using LLM systems in production
- Rigorous evaluation design experience: building harnesses, tracking experiments, and data-driven decision making
- Inference optimization experience (vLLM, TensorRT-LLM, quantization, throughput/latency tradeoffs)
- Familiarity with retrieval pipelines, vector stores, and structured memory for agents
- Kubernetes and containerized deployment fluency
- Genuine interest in offensive security and the ability to ramp quickly on OWASP Top 10, API/web/mobile pentesting concepts
Here’s What Else Might Help You Out
- Offensive security certifications or experience (OSCP/OSWE/OSWA, CTF, bug bounty, red team)
- Research publications at top ML/security venues or open source contributions to agent/LLM tooling
- Experience with adversarial ML or red-teaming AI systems
- Familiarity with mobile app reverse engineering or binary analysis
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerjet.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…