Sr ML Engineer - REMOTE

Insight Global
Raleigh, NC, United States
about 1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Amazon Web Services Microsoft Azure Decision-Making Software Distributed Systems Python (Programming Language) Lexis Cloud Platform System Large Language Models Containerization AI Platforms Kubernetes
+1 more
Machine Learning Operations

Job description

Day to Day:

Designing and owning the architecture for enterprise AI platforms used across multiple LexisNexis products

Building and scaling LLM-powered systems (including RAG pipelines) that support legal research and decision-making tools

Designing agentic AI workflows where models reason, call tools/APIs, and execute multi-step tasks

Creating high-availability, low-latency inference systems for global, enterprise users

Establishing platform standards for model deployment, monitoring, evaluation, and reliability

Defining guardrails, permissions, and auditability for AI systems in a regulated legal environment

Working closely with product, platform, and engineering teams to ensure AI systems are reusable and scalable

Mentoring senior engineers and influencing technical direction across teams

Ensuring Responsible AI principles are embedded into system design (safety, reliability, governance)

Requirements

10+ years building production ML systems (not research-only)

Hands-on LLM experience in production, including:

RAG architectures

Inference performance, reliability, and monitoring

Experience designing agentic AI systems (models calling tools/APIs, multi-step workflows)

Strong distributed systems architecture experience in cloud environments (AWS, Azure, or GCP)

Kubernetes + containerization experience in production environments

Strong Python engineering background (platform-level code, not just notebooks)

Experience building or contributing to enterprise AI platforms used by multiple teams

Proven ability to lead technically (set standards, mentor engineers, influence architecture)

Comfortable working in regulated or high-reliability environments Direct experience with Model Context Protocol (MCP) servers or structured tool-calling frameworks

Deep experience with vector databases and large-scale search systems

Experience designing LLMOps / MLOps standards at the platform level

Prior work in legal, financial, healthcare, or other regulated industries

Exposure to Responsible AI governance, auditing, or compliance frameworks

Experience building internal AI platforms rather than just end-user applications

Background mentoring senior engineers or leading cross-team technical initiatives

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.juju.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:14 min

Exploring internal AI product initiatives and global engineering roles

Maria Apazoglou · Coffee With Developers

2:36 min

Choosing between managed AI platforms and custom governance

Péter Farkas Péter Farkas · Europe 2026 Virtual

2:28 min

Understanding Kubernetes architecture and core cluster components

Marc Nimmerrichter · WWC 2022

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:08 min

Essential engineering roles in the generative AI space

Mary Grygleski Mary Grygleski · LIVE

4:04 min

Overview of Kubernetes operators and custom resource definitions

Philipp Krenn · WWC 2022

Videos

See all

Related articles

See all