AI Engineer

Intone Networks
Philadelphia, PA, United States
2 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

LangGraph Framework A/B Testing Artificial Intelligence Amazon Web Services Computer Programming Python (Programming Language) Performance Tuning Scripting Large Language Models Prompt Engineering Structured Output Generation Claude
+1 more
Evaluation of Large Language Models

Job description

We are seeking an AI Engineer for a contract position based in Philadelphia, Pennsylvania, lasting six months or more.

Responsibilities

  • Develop and implement state graphs, checkpointing, interrupts, and tool-calling agents using LangGraph
  • Design and execute LLM evaluations using golden sets, LLM-as-judge methodologies, and A/B comparisons to assess quality, cost, and latency
  • Engineer robust prompts, including structured outputs, to optimize model performance
  • Build and maintain AI solutions in production environments

Requirements

Artificial Intelligence (AI), Artificial Intelligence (AI), Cost Analysis, Performance Modeling, Performance Tuning/Optimization, Production Systems, A/B Testing, Python Programming/Scripting Language, Computer Programming, Amazon Web Services (AWS), * Required

  • Demonstrated experience with LangGraph, including state graphs, checkpointing, interrupts, and tool-calling agents
  • Proficiency in LLM evaluation frameworks and methodologies such as golden sets, LLM-as-judge, and A/B testing
  • Expertise in prompt engineering and structured output generation
  • Strong Python programming skills
  • Preferred
  • Experience with Claude and AWS Bedrock

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…