AI Engineer
Intone Networks
Philadelphia, PA, United States
2 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerbuilder.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
Tech stack
LangGraph Framework
A/B Testing
Artificial Intelligence
Amazon Web Services
Computer Programming
Python (Programming Language)
Performance Tuning
Scripting
Large Language Models
Prompt Engineering
Structured Output Generation
Claude
+1 more
Evaluation of Large Language Models
Job description
We are seeking an AI Engineer for a contract position based in Philadelphia, Pennsylvania, lasting six months or more.
Responsibilities
- Develop and implement state graphs, checkpointing, interrupts, and tool-calling agents using LangGraph
- Design and execute LLM evaluations using golden sets, LLM-as-judge methodologies, and A/B comparisons to assess quality, cost, and latency
- Engineer robust prompts, including structured outputs, to optimize model performance
- Build and maintain AI solutions in production environments
Requirements
Artificial Intelligence (AI), Artificial Intelligence (AI), Cost Analysis, Performance Modeling, Performance Tuning/Optimization, Production Systems, A/B Testing, Python Programming/Scripting Language, Computer Programming, Amazon Web Services (AWS), * Required
- Demonstrated experience with LangGraph, including state graphs, checkpointing, interrupts, and tool-calling agents
- Proficiency in LLM evaluation frameworks and methodologies such as golden sets, LLM-as-judge, and A/B testing
- Expertise in prompt engineering and structured output generation
- Strong Python programming skills
- Preferred
- Experience with Claude and AWS Bedrock
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerbuilder.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦