> Markdown version of [/jobs/ext/1041699-ai-product-engineer-backend](https://www.wearedevelopers.com/jobs/ext/1041699-ai-product-engineer-backend). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AI Product Engineer, Backend

- **Company:** Arize AI
- **Location:** San Francisco, CA, United States (Remote available)
- **Experience:** Expert
- **Salary:** $125,000.0 - $225,000.0
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Microsoft Azure, Software as a Service, Databases, Data Systems, Monitoring of Systems, Python (Programming Language), Machine Learning, Online Analytical Processing, Node.Js, Open Source Technology, Queueing Systems, Prometheus, TypeScript, Google Cloud, Large Language Models, Backend, Build Management, Kubernetes, Apache Kafka, Stream Processing, Golang, Programming Languages
- **Published:** June 9, 2026
- **Apply:** https://www.dice.com/job-detail/27abc7d4-5f43-42b3-9ad4-f46b4ac468bd

## About the Role

* 5+ years of experience working with high-performance backend systems.
 * Strong experience writing Go, Python, TypeScript/Node, Java, or similar server programming languages.
 * Enthusiasm and interest in the AI and LLM ecosystem, with a desire to learn and stay updated on emerging technologies.
 * Previous work building and operating highly complex SaaS platforms/systems.
 * Knowledge of working with public clouds & container orchestration - AWS, Google Cloud Platform, Azure, Kubernetes, etc.

Bonus Points, But Not Required

 * Experience with distributed stream processing - Kafka, Gazette, or similar.
 * Experience with OLAP systems.
 * Familiarity with system observability tooling like Prometheus.
 * Working knowledge of Machine Learning and/or Data Science.
 * First-hand experience working with large language models (LLMs) or developing AI products.

## Description

* Write maintainable, scalable, and performant backend code primarily in Go, Java, and Python, with opportunities to work in TypeScript.
 * Build high-volume and highly available analytics systems.
 * Design and build APIs specific to our customers' Machine Learning and LLM workflows.
 * Prototype, optimize, and maintain scalable backend services that power the Arize core platform.
 * Extend, and contribute back to, open source OLAP databases and distributed message queue frameworks.
 * Develop and integrate collection tools for robust monitoring of ML and LLM pipelines.
 * Research and implement cutting-edge visualization & dimensionality reduction algorithms in a distributed environment.
 * Collaborate with our product, design, and directly with customer engineering teams to enhance and expand our product offerings.
 * Contribute to the build our own in-house AI Agents


## Related Videos

- [Go with the Flow: Stop the Leaks Before Your Memory's a Waterfall!](https://www.wearedevelopers.com/videos/100073-go-with-the-flow-stop-the-leaks-before-your-memory-s-a-waterfall)
- [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock)
- [Stop using Node.js like in 2020! What changed and what you can do today with Node.js](https://www.wearedevelopers.com/videos/100011-stop-using-node-js-like-in-2020-what-changed-and-what-you-can-do-today-with-node-js)
- [You are not an AI developer](https://www.wearedevelopers.com/videos/1148-you-are-not-an-ai-developer)
- [Scoring 2000 Products per Request: Performance Pitfalls in Golang](https://www.wearedevelopers.com/videos/2073-scoring-2000-products-per-request-performance-pitfalls-in-golang)
- [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)