AI Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+12 more
Job description
The AI Engineer builds and improves the systems that fine-tune and serve AI models on Zettabyte GPU infrastructure.
The role suits an engineer who ships quickly, learns new techniques fast and takes ownership of results in production.
The role sits within the post-training and inference team led by the Tech Lead, collaborating across the globally distributed teams.
Reporting Line
Reports to: Tech Lead., * Model serving: deploy, benchmark and maintain models on vLLM, TensorRT-LLM, SGLang or similar frameworks.
- Fine-tuning: run and automate supervised fine-tuning, LoRA and preference optimization jobs for customer and open-weight models.
- Optimization: apply quantization, batching, caching and parallelism to improve latency, throughput and cost.
- Evaluation: build evaluation and benchmarking scripts for model quality and serving performance.
- Pipelines: develop data preparation, training and deployment pipelines.
- Integration: integrate models with the zCLOUD platform APIs, monitoring and autoscaling.
- Troubleshooting: diagnose performance and reliability issues across models, GPUs and serving infrastructure.
- Documentation: write clear runbooks, benchmarks and technical notes., * Workplace: Hybrid in Palo Alto or Seattle (3 days in office, 2 days remote) if based in the United States; on-site 5 days a week at the Taipei office if based in Taiwan
Requirements
Artificial Intelligence (AI), Cloud Computing, Artificial Intelligence (AI), GPU (Graphics Processing Unit), High Tech Industry, Computer Software, Network Operations Center, OEM (Original Equipment Manufacturer), Technical Leadership, Benchmarking, Palo Alto, Seattle or TaipeiOn-site or HybridEngineering, * 5+ years of software or machine learning engineering experience
- Hands-on experience training, fine-tuning or serving transformer models on GPUs
- Strong Python and PyTorch skills
- Familiarity with Hugging Face Transformers and at least one inference engine such as SGLang, vLLM or TensorRT-LLM
- Comfort working with Linux, Docker and GPU tooling
- An execution focus, with a record of shipping working results quickly and improving them with feedback
- Clear written English; working Mandarin is an advantage for Taiwan-based candidates
Bonus Qualifications
- Experience with CUDA, Triton or profiling tools such as Nsight
- Experience with DeepSpeed, FSDP or Megatron-LM
- Contributions to AI frameworks or published projects
- Experience running GPU workloads on Kubernetes
Benefits & conditions
AI computing company: we turn GPU hardware into reliable, high-utilization AI compute through software, orchestration and full lifecycle operations.
- What we offer: enterprise GPU cloud and AI inference, software for data center owners to run their own GPU clouds, turnkey and sovereign AI data centers, edge computing and GPU financing
- Who we work with: GPU owners, data center operators, enterprises, OEMs, integrators and financiers across multiple markets
- How we work: fast-moving and high-accountability; we value speed, ambition, clarity, ownership and measurable outcomes, What Success Looks Like (First 90 to 180 Days)
- Production models deployed and benchmarked on zCLOUD
- At least one documented improvement in latency, throughput or cost
- A customer or internal fine-tuning project completed end to end
- Runbooks and benchmarks published for the team
Why This Role Matters
- Hands on the product: this role directly shapes the speed and quality customers experience.
- Workloads at scale: customer AI inference and post-training run reliably and efficiently because of it.
Working Norms at Zettabyte
- Bias to action: deliver drafts quickly, then iterate on feedback
- Be precise: double-check numbers and facts; sloppy analysis creates downstream cost
- Make it usable: package outputs for decision-making, not data dumps
- Own the process: whoever drives a deliverable manages stakeholders and timelines
- Learn the ecosystem: understand GPUs, cluster operations and the buyer landscape, * Compensation: USD 185,000 to 235,000 a year base salary, plus equity, if based in the United States; competitive salary based on experience and skills if based in Taiwan
- Benefits: Taiwan: Labour and health insurance; 6% labour pension contribution; generous paid leave with no unpaid period for new joiners; free snacks, drinks and coffee; employee share options after a qualifying period. United States: Medical, dental and vision insurance; 401(k) retirement plan; paid time off and US public holidays; equity
- Right to work: Required in Taiwan or the United States
- Equal opportunity: We hire on merit in line with the fair employment rules of Taiwan and the United States; in the US, Zettabyte is an equal opportunity employer and considers qualified applicants with arrest or conviction records in line with applicable fair chance laws, including the California Fair Chance Act and the Washington Fair Chance Act
AI Engineer
LocationPalo Alto, Seattle or Taipei
Work arrangementOn-site or Hybrid
Employment typeFull-time
TeamEngineering
185,000-235,000USD / year (US)
Apply
Share
AI Engineer
185,000-235,000USD / year (US)
About the company
About UsPress ReleasesCareersFAQPricingContact Us, Zettabyte is a supplier of the United Nations Global Marketplace (UNGM #1117361) and is committed to aiding the United Nations in achieving its Sustainable Development Goals.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦