Machine Learning Engineer

• Design and build LLM-based evaluation frameworks, including automated scoring pipelines and rubric-based grading systems
• Build and maintain data pipelines for evaluation datasets using Python, SQL, and scalable processing tools
• Translate complex evaluation results into clear, actionable insights for technical and non-technical stakeholders
• Implement automation workflows and agentic evaluation systems to improve efficiency and reduce manual efforts
• Develop prompt engineering strategies to evaluate output quality, accuracy, and consistency
• Create and maintain metrics, KPIs, and dashboards to track and communicate model performance
• Conduct error analysis, root-cause investigations, and quality deep dives to guide model improvements
• Partner cross-functionally to define evaluation methodologies and integrate them into production workflows, Use of Artificial Intelligence (AI): We may use Artificial Intelligence (AI) to support parts of our hiring process, including sourcing, screening, and evaluating candidates. AI helps assess applications and qualifications, but final decisions are made by our hiring team. By applying, you acknowledge and agree that your application may be reviewed using AI tools. Related Jobs Practice Architect AI/ML TEKsystems Los Angeles, CARemote JIRA Sales Linux CI/CD DevOps Gitlab Github Ansible Jenkins Presales Scripting Terraform Bitbucket Operations Leadership Consulting Management Automation Innovation Resilience Kubernetes Artifactory API Gateway Cloud Design Communication Microservices Sales Support Cloud Services Load Balancing Cloud Migration Project Closure Amazon DynamoDB Customer Service Project Planning Computer Science Scope Management Machine Learning AWS CodePipeline Code Refactoring Project Delivery Office Procedures Docker (Software) Analytical Skills Solution Delivery Service Offerings Windows PowerShell Business Valuation Problem Management Amazon Web Services Resource Management Service Improvement Atlassian Confluence Serverless Computing Strategic Objectives System Administration Solution Architecture Business Intelligence Technology Strategies Information Technology Cloud-Native Computing Full Stack Development Operational Excellence Technical Requirements Internal Communications Artificial Intelligence Project Risk Management Technical Communication Business Transformation Research And Development Cloud-Native Development Bash (Scripting Language) C# (Programming Language) Critical Illness Insurance Java (Programming Language) Verbal Communication Skills Team Performance Management Node.js (Javascript Library) Infrastructure as Code (IaC) Service Improvement Planning Cloud Computing Architecture Python (Programming Language) Virtual Private Networks (VPN) Project Initiation Documentation Application Lifecycle Management Key Performance Indicators (KPIs) JavaScript (Programming Language) Chef (Configuration Management Tool) Puppet (Configuration Management Tool) +0 Machine Learning Engineer - LLM Evaluation & Automation TEKsystems Culver City, CARemote PySpark Research Dashboard Operations Automation Scalability Investigation Data Pipelines Machine Learning Business Valuation Scalability Design Prompt Engineering Workflow Management Product Engineering Full Stack Development Distributed Data Store Artificial Intelligence Business Transformation SQL (Programming Language) Critical Illness Insurance Python (Programming Language) Large Language Model Evaluation Key Performance Indicators (KPIs) Error Analysis (Numerical Analysis)

• 5+ years of experience in ML engineering, NLP, or AI/ML automation
• Strong programming skills in Python and SQL
• Deep understanding of machine learning concepts with a focus on NLP and advanced LLM capabilities (e.g., Chain-of-Thought, agentic workflows)
• Experience working with large-scale datasets and data pipelines
• Strong experience with LLM evaluation, prompt engineering, or auto grading systems
• Experience developing metrics and KPIs to measure model output quality and consistency

Nice-to-Have:

• Experience with LLM-as-judge systems or human + model evaluation frameworks
• Background in inter-rater reliability, evaluation calibration, or judged systems design
• Experience with PySpark or distributed data processing tools
• Exposure to building dashboards or visualization tools for model performance tracking, Python, SQL, NLP, LLM Evaluation, Prompt Engineering, Machine Learning, Data Pipelines, Automation Systems

This is a Contract position based out of Culver City, CA. Pay and Benefits

The pay range for this position is $60.00 - $70.00/hr.

Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following:

• Medical, dental & vision
• Critical Illness, Accident, and Hospital
• 401(k) Retirement Plan - Pre-tax and Roth post-tax contributions available
• Life Insurance (Voluntary Life & AD&D for the employee and dependents)
• Short and long-term disability
• Health Spending Account (HSA)
• Transportation benefits
• Employee Assistance Program
• Time Off/Leave (PTO, Vacation or Sick Leave) Workplace Type

PySpark Research Dashboard Operations Automation Scalability Investigation Data Pipelines Machine Learning Business Valuation Scalability Design Prompt Engineering Workflow Management Product Engineering Full Stack Development Distributed Data Store Artificial Intelligence Business Transformation SQL (Programming Language) Critical Illness Insurance Python (Programming Language) Large Language Model Evaluation Key Performance Indicators (KPIs) Error Analysis (Numerical Analysis), We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company., We're a leading provider of business and technology services. We accelerate business transformation for our customers. Our expertise in strategy, design, execution and operations unlocks business value through a range of solutions. We're a team of 80,000 strong, working with over 6,000 customers, including 80% of the Fortune 500 across North America, Europe and Asia, who partner with us for our scale, full-stack capabilities and speed. We're strategic thinkers, hands-on collaborators, helping customers capitalize on change and master the momentum of technology. We're building tomorrow by delivering business outcomes and making positive impacts in our global communities. TEKsystems and TEKsystems Global Services are Allegis Group companies. Learn more at TEKsystems.com.