> Markdown version of [/jobs/ext/2284773-software-engineer-iii-ai-systems](https://www.wearedevelopers.com/jobs/ext/2284773-software-engineer-iii-ai-systems). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Software Engineer III- AI Systems - **Company:** Wal-Mart Stores, Inc. - **Location:** Bentonville, AR, United States - **Experience:** Experienced - **Salary:** $90,000.0 - $180,000.0 - **Contract:** Permanent contract - **Skills:** Adobe Analytics, Java (Programming Language), Web Accessibility, Application Programming Interfaces (APIs), Artificial Intelligence, C++ (Programming Language), Profiling, Encodings, Computer Engineering, Continuous Integration, Data Structures, Fault Tolerance, Python (Programming Language), Software Engineering, Systems Integration, Web Content Accessibility Guidelines, Data Logging, Model-Driven Development, Pytorch, Autoscaling, Flask (Web Framework), Large Language Models, Multi-Agent Systems, Concurrency, Apache Spark, Caching, Backend, Fastapi, Build Management, Containerization, AI Platforms, Kubernetes, Information Technology, Low Latency, ONNX (Open Neural Network Exchange) Format, Dask, Machine Learning Operations, TensorRT, Virtual Agents, Stream Processing, Data Pipelines, Docker, Microservices - **Published:** August 28, 2026 - **Apply:** https://www.techcareers.com/job.asp?id=3367882832&tx=ZT1716TYT&pt=1&aff=0B19D771-A501-4A5E-8338-2A822B784D54&utm_source=Job%20Feed&utm_medium=textkernel&utm_campaign=DE&utm_term=0B19D771-A501-4A5E-8338-2A822B784D54 ## About the Role The ideal candidate blends strong software engineering fundamentals with practical ML systems exposure and a passion for performance, reliability, and developer experience., * Bachelor's/Master's in CS, Engineering, or equivalent industry experience. * 4+ years building production backend or platform services (preferably in AI/ML contexts). * Proficiency in: * Languages: Python (primary), plus one of Go/Java/C++ for performance services. * Distributed frameworks: Ray, Spark, or Dask. * Accelerated compute: RAPIDS (cuDF/cuML/cuGraph) and GPU-aware programming concepts (streams, memory). * Service frameworks: FastAPI/Flask (Python), K8s (Kubernetes) and containerization (Docker). * Strong foundations in data structures/algorithms , concurrency , networking , and systems design ., * Production experience with agent frameworks (e.g., LangGraph-style planners, tool-use patterns, retrieval and memory components). * Experience with vector databases (e.g., FAISS, Milvus, pgvector, Pinecone) and feature stores . * Familiarity with LLM and embedding services , prompt/tooling patterns, and evaluation harnesses. * Hands-on with Kubernetes , autoscaling (HPA/KEDA), and GPU scheduling/operators. * Performance profiling: PyTorch profiler , Nsight , line-profiler , Ray dashboard . * Experience with vLLM , Triton Inference Server , ONNX Runtime , or TensorRT for high-throughput inference. Soft Skills & Leadership * Pragmatic problem solver with a bias for measurable outcomes (latency, throughput, reliability). * Excellent communicator able to translate between research goals and production constraints. * Drives clarity in ambiguous problem spaces; mentors others and uplifts engineering standards., Outlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications. Option 1: Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 2 years' experience in software engineering or related area. Option 2: 4 years' experience in software engineering or related area. Preferred Qualifications... Outlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications. Master's degree in Computer Science, Computer Engineering, Computer Information Systems, Software Engineering, or related area, We value candidates with a background in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly. The ideal candidate would have knowledge of accessibility best practices and join us as we continue to create accessible products and services following Walmart's accessibility standards and guidelines for supporting an inclusive culture. Masters: Computer Science ## Description We're seeking a Software Engineer to design and build AI-first systems with a focus on agentic AI, high performance data/compute frameworks, and scalable, production-grade services. You'll work across model-driven features and platform layers-integrating LLMs/agents, orchestrating pipelines with Ray, accelerating data science workloads with RAPIDS, and delivering robust APIs and services that power high-impact AI applications at scale., * Build agentic AI services (planning, tool use, retrieval, feedback loops) and integrate them with internal systems and APIs. * Implement orchestration , memory , tooling , evaluation , and guardrails for agentic workflows. * Collaborate with DS/MLE partners to productionize models (LLMs, GNNs, embedding services) behind stable APIs and SDKs. Accelerated Compute & Data Pipelines * Develop GPU - accelerated pipelines using RAPIDS (cuDF/cuML/cuGraph) and optimize end-to-end performance. * Use Ray (or similar) for distributed compute, batch/stream processing, and scalable workflow orchestration. * Profile and optimize bottlenecks across CPU/GPU, memory, and I/O layers; implement caching, vectorization, and async patterns. Service & Platform Engineering * Design and maintain reliable microservices for training/inference, vector indexing, and real-time decisioning. * Implement observability (tracing/metrics/logging), fault tolerance, auto-scaling, and cost-aware execution. * Create internal SDKs/CLIs to streamline developer workflows, testing, and reproducibility. Quality, Security & MLOps Integration * Establish CI/CD for AI services (unit/integration/e2e tests, canaries, blue/green, rollback). * Integrate with feature stores , vector databases , artifact registries , and model catalogs . * Enforce security, privacy, and compliance (data minimization, PII handling, governance, auditability). Collaboration & Influence * Partner with product, platform, and DS/MLE teams to align requirements, SLAs, and success metrics. * Document systems thoroughly; contribute to design reviews and engineering best practices. * Mentor peers on AI systems patterns, distributed compute, and performance engineering. ## Related Videos - [Rethinking Intelligence: AI, Accessibility, and the Future of Inclusive Work - Artur Ortega](https://www.wearedevelopers.com/videos/1377-rethinking-intelligence-ai-accessibility-and-the-future-of-inclusive-work-artur-ortega) - [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Serverless deployment of (large) NLP models ](https://www.wearedevelopers.com/videos/158-serverless-deployment-of-large-nlp-models) - [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts) - [What is Software Engineering in the Age of AI?](https://www.wearedevelopers.com/magazine/640-what-is-software-engineering-in-the-age-of-ai) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated)