Senior AI Engineer
On behalf of Next Deavor
United States
15 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Compensation
$150,000.0 - $220,000.0
Working hours
Regular working hours
Job source
Tech stack
Application Programming Interfaces (APIs)
Artificial Intelligence
Software System Penetration Testing
Code Review
Decision Support Systems
Mobile Application Software
Python (Programming Language)
Open Source Technology
Open Web Application Security
Red Team (Cyber Security)
Reverse Engineering
Pytorch
+7 more
Large Language Models
Multi-Agent Systems
Kubernetes
Low Latency
HuggingFace
TensorRT
Data Generation
Job description
- Design, implement, and iterate on named agents, including orchestration patterns, hand-offs, planning loops, tool use, and shared memory
- Contribute to model training and fine-tuning across data curation, supervised fine-tuning (SFT), preference optimization (DPO/GRPO/RLHF-style), and evaluation
- Extend the co-evolutionary self-training (Javelin) loop so the system improves from its engagements
- Build self-improvement systems (false-positive detection, tiered skill learning, agent directives, code-patch proposals) and pipelines for human approval
- Design security-specific evaluations covering OWASP Top 10, exploit chaining, finding accuracy, and agent reliability; track performance over model and agent changes
- Contribute to multimodal (vision) and mobile (iOS/Android) coverage and BYOK support efforts
- Own production reliability: latency, cost, observability, failure-mode analysis, and Kubernetes-based deployment
- Improve customer-facing accuracy surfaces and live accuracy gauges exposed to customers
Requirements
- 5+ years building production ML/AI systems, including at least 2 years working directly on LLMs or LLM-powered agents
- Deep Python and strong production engineering practices (testing, code review, observability)
- Hands-on fine-tuning experience: SFT, preference optimization (DPO, GRPO, RLHF/RLAIF), data curation, and synthetic data generation
- Strong grasp of transformer architectures and training stack (PyTorch, Hugging Face, DeepSpeed or FSDP, accelerate)
- Experience designing and shipping multi-agent or tool-using LLM systems in production
- Rigorous evaluation design experience: building harnesses, tracking experiments, and data-driven decision making
- Inference optimization experience (vLLM, TensorRT-LLM, quantization, throughput/latency tradeoffs)
- Familiarity with retrieval pipelines, vector stores, and structured memory for agents
- Kubernetes and containerized deployment fluency
- Genuine interest in offensive security and the ability to ramp quickly on OWASP Top 10, API/web/mobile pentesting concepts
Here’s What Else Might Help You Out
- Offensive security certifications or experience (OSCP/OSWE/OSWA, CTF, bug bounty, red team)
- Research publications at top ML/security venues or open source contributions to agent/LLM tooling
- Experience with adversarial ML or red-teaming AI systems
- Familiarity with mobile app reverse engineering or binary analysis
Benefits & conditions
$150,000 - $220,000 a year - Full-time, Pulled from the full job description
- 401(k)
- Health insurance
- Vision insurance
- Dental insurance, * 401(k)
- Dental insurance
- Health insurance
- Vision insurance
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.indeed.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
LM
Luis Minvielle
over 2 years ago
BB
Benedikt Bischof
MLOps And AI Driven Development
over 4 years ago
LM
Luis Minvielle
What Are Large Language Models?
almost 3 years ago
EF
Elizabeth Fuentes Leone, AWS Developer Advocate, GenAI
From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path
9 months ago
CH
Chris Heilmann
Dev Digest 137 - AI'm not sure about this
almost 2 years ago
BB
Benedikt Bischof
MLOps – What’s the deal behind it?
almost 4 years ago