AI Engineer
Analytic Recruiting Inc.
New York, United States of America
1 month ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Junior Compensation
$ 300KJob location
New York, United States of America
Tech stack
Artificial Intelligence
Python
Machine Learning
Recommender Systems
Large Language Models
Prompt Engineering
Job description
- Design, refine, and maintain prompts, structured outputs, and orchestration systems that power core AI features.
- Build evaluation infrastructure to measure AI quality at scale using tools such as Langfuse, TensorZero, and Promptfoo.
- Partner closely with product, engineering, and research to translate AI capabilities into polished, user-facing features.
- Run structured experiments across models, prompts, and configurations to optimize for quality, cost, and latency.
- Develop internal tools-dashboards, admin interfaces, debugging workflows-that give the team visibility into system behavior.
- Identify opportunities to finetune open source models (SFT, DPO, RLHF) to improve performance and reduce cost.
Requirements
- 1-2+ years building LLM-powered products in production
- 1-3 years in software or ML engineering.
- Proven experience shipping, deploying, and monitoring AI applications over time.
- Comfort working in an early-stage environment where ownership is high and iteration is fast.
- Experience with recommendation systems or consumer-facing products.
Keywords: AI Engineer, GenAI, LLM, Python, ML, Prompt Engineering
