> Markdown version of [/jobs/ext/2635609-llm-backend-engineer-graduate-applied-machine-learning-2027-start](https://www.wearedevelopers.com/jobs/ext/2635609-llm-backend-engineer-graduate-applied-machine-learning-2027-start). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# LLM Backend Engineer Graduate (Applied Machine Learning) - 2027 Start

- **Company:** BYTEDANCE INC.
- **Location:** San Jose, CA, United States
- **Experience:** Starter
- **Salary:** $128,000.0 - $256,000.0
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), C++ (Programming Language), Cloud Engineering, Computer Networks, Databases, Distributed Systems, Python (Programming Language), Machine Learning, Performance Tuning, Software Engineering, Istio, Large Language Models, Backend, Rate Limiting, Kubernetes, Information Technology, Low Latency, Docker, Golang
- **Published:** August 6, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=11da75acba237501

## About the Role

* Individuals who are completing or have recently completed a Bachelor's or Master's degree in Computer Science or a related discipline.
 * Proficient in at least one programming language such as Golang, Java, C++, or Python; has practical software development experience and solid computer science fundamentals.
 * Understands basic backend engineering systems, including databases, computer networks, operating systems, and distributed system principles., * Hands-on experience in server-side engineering.
 * Understanding of Agent concepts and related technical implementations, such as Function Calling and MCP.
 * Familiarity with cloud-native and service mesh technologies such as Kubernetes, Docker, Istio, and Envoy.
 * Interest in large model inference pipelines, with relevant background knowledge., Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment

## Description

* Design and develop core components of the Volcano Ark MaaS platform, supporting API capabilities for text dialogue, multimodal understanding, and multimodal generation.
 * Participate in cloud-native architecture evolution, including Service Mesh, load balancing, and intelligent routing; design and implement high-availability solutions such as end-to-end grayscale release, traffic degradation, circuit breaking, and rate limiting.
 * Perform system-level performance tuning for long connections, high throughput, streaming output, and low latency in multimodal large model inference scenarios.
 * Ensure system stability for large-scale model invocation scenarios and resolve architectural bottlenecks caused by sudden traffic spikes.


## Related Videos

- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [Go with the Flow: Stop the Leaks Before Your Memory's a Waterfall!](https://www.wearedevelopers.com/videos/100073-go-with-the-flow-stop-the-leaks-before-your-memory-s-a-waterfall)
- [Rate-limiting using eBPF and Istio: How to protect your SaaS customers from themselves](https://www.wearedevelopers.com/videos/100220-rate-limiting-using-ebpf-and-istio-how-to-protect-your-saas-customers-from-themselves)
- [Beyond the Hype: Building Trustworthy and Reliable LLM Applications with Guardrails](https://www.wearedevelopers.com/videos/1594-beyond-the-hype-building-trustworthy-and-reliable-llm-applications-with-guardrails)
- [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker)
- [Scoring 2000 Products per Request: Performance Pitfalls in Golang](https://www.wearedevelopers.com/videos/2073-scoring-2000-products-per-request-performance-pitfalls-in-golang)

## Related Articles

- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [7 Most Popular Web Developer Jobs in Europe](https://www.wearedevelopers.com/magazine/163-7-most-popular-web-developer-jobs-in-europe)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix)
- [What’s the Difference Between Frontend and Backend Development?](https://www.wearedevelopers.com/magazine/240-what-s-the-difference-between-frontend-and-backend-development)