Senior AI/ML Software Engineer

Insight Global
Bentonville, AR, United States
17 days ago
Apply on jobs.insightglobal.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Compensation
$122,720.0 - $153,920.0
Working hours
Regular working hours

Tech stack

Java (Programming Language) Application Programming Interfaces (APIs) Artificial Intelligence Microsoft Azure Distributed Systems Fault Tolerance Java Web Services Python (Programming Language) Machine Learning OpenStack Ansible Tensorflow
+18 more
Software Construction Software Engineering Pytorch Large Language Models Spring-boot Software Application Programming Generative AI Backend Build Management Kubernetes HuggingFace Machine Learning Operations Api Design Restful APIs Terraform Software Version Control Docker Microservices

Job description

Design and build AI-enabled backend services and APIs using Java and Python Integrate machine learning and GenAI models into production software systems Develop services that support model inference, orchestration, and business workflows Collaborate with data scientists to productionize models built with TensorFlow, PyTorch, Hugging Face, or similar frameworks Implement scalable, fault-tolerant microservices that consume and expose AI/ML capabilities Deploy and run applications on OpenStack-hosted environments without owning underlying infrastructure Work within containerized environments (Docker/Kubernetes) from an application perspective Apply software engineering best practices around API design, performance, testing, and observability Participate in architecture and design discussions for AI-driven systems Troubleshoot and optimize application-level performance tied to data volume, model latency, and throughput

Requirements

6-9+ years of software engineering experience Strong background as a Java or Python backend developer Expert-level experience with Java, Spring Boot, REST APIs, and microservices Hands-on experience transitioning into AI/ML application development (libraries like Facebook profit and anomaly detection) Experience integrating ML models into real production applications Working experience deploying applications on OpenStack-based private cloud or similar enterprise platforms Experience developing applications that run on Docker and Kubernetes (no platform ownership required) Solid understanding of distributed systems, scalability, and service reliability

Nice to Have Skills & Experience

Experience with GenAI or LLM-based applications Familiarity with MLOps concepts (model versioning, deployment patterns, monitoring) Experience bridging Python-based ML workflows with Java services Exposure to event-driven or data-intensive systems Background in large enterprise environments with complex application ecosystems Ansible, Terraform Azure cloud Prior Walmart Experience

Benefits & conditions

Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on jobs.insightglobal.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · World Congress 2025

1:52 min

Structuring and scaling the backend engineering team

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

2:35 min

Preventing remote code execution in PyTorch models

Balázs Kiss · World Congress 2023

2:14 min

Exploring internal AI product initiatives and global engineering roles

Maria Apazoglou · Coffee With Developers

2:34 min

Docker sandbox architecture and microVM environment integration

Manuel de la Peña Manuel de la Peña · World Congress 2026 Europe

Videos

See all

Related articles

See all