Staff/Senior AI Engineer, AI for Code
JetBrains
Amsterdam, Netherlands
3 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Remote
Amsterdam, Netherlands
Tech stack
API
Artificial Intelligence
JetBrains
Large Language Models
Low Latency
Job description
- Build production-ready coding agents and agentic workflows for real developer tasks inside JetBrains products.
- Turn promising model capabilities into dependable product behavior through prompt design, context construction, fine-tuning, instruction-tuning, or other post-training techniques where appropriate.
- Design and improve the agent loop itself, including tool use, execution strategy, safeguards, and task completion quality.
- Create evaluation suites and quality infrastructure for agent behavior, including online and offline evaluations, regression checks, failure analysis, and release criteria.
- Build feedback loops from real usage, using logs, user signals, and edge cases to improve data, evaluations, and agent behavior.
- Work with both hosted frontier APIs and self-hosted or open-weight models, making pragmatic decisions about where each model belongs based on capability, latency, reliability, privacy, and cost.
- Collaborate closely with product managers, software engineers, ML engineers, and researchers to ship features end to end.
- Help define the technical direction for future work, especially in ambiguous areas where we need strong judgment rather than a prewritten playbook., * You ship one or more agent capabilities that users can rely on for meaningful work, not just demos.
- You establish better evaluation coverage and clearer release criteria for agent behavior.
- You help the team build a repeatable loop from idea to shipped capability: prototype, evaluate, learn from usage, improve, and scale.
Requirements
Do you have experience in Communication skills?, Do you have a Master's degree?, * Strong software engineering fundamentals and a track record of shipping complex systems to production.
- Hands-on experience building LLM-powered products, coding agents, or other AI systems.
- Experience improving model behavior through systematic iteration, whether via prompting, context engineering, fine-tuning, preference optimization, or broader post-training methods.
- Practical experience with evaluation and benchmarking for LLM systems, including defining task-grounded success metrics and catching regressions.
- Experience working from noisy real-world signals rather than only from clean benchmark datasets.
- Good judgment about trade-offs between model quality, latency, reliability, privacy, and cost.
- Confidence working with ambiguity and taking ownership of a direction over multiple iterations.
- Strong communication skills and the ability to align engineering and product decisions.
Benefits & conditions
- Strong base salary. We offer competitive pay that reflects your skills and experience.
- Flexible work location. Enjoy the freedom to work from home or from the office.
- Remote work. Spend up to 30 days per year working remotely from abroad.
- Extra time off. More days to relax, recharge, and do the things you love.
- Medical insurance allowance. Enjoy peace of mind for you and your family
- Learning and development opportunities. Access to conferences, courses, and language classes.
- Relocation support. We help make your move as smooth and stress-free as possible.
- Language classes. Pick up the local language or sharpen your English skills.
- Fuel your day. Enjoy a hot meal or receive a lunch allowance on workdays.
- Mental health support. To help you feel your best, we provide easy access to professional mental health services.
- Sports benefit. Enjoy an on-site gym or sports club stipend.
- Internal events. Join company-wide celebrations and team gatherings.