> Markdown version of [/jobs/ext/583197-senior-ai-systems-engineer](https://www.wearedevelopers.com/jobs/ext/583197-senior-ai-systems-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior AI Systems Engineer - **Company:** ARCHER - **Location:** San Jose, CA, United States - **Experience:** Expert - **Salary:** $160,000.0 - $180,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Systems Engineering, Audio Signal Processing, Cloud Computing, Cloud Engineering, Information Engineering, Software Debugging, Monitoring of Systems, Machine Learning, NoSQL, Raw Data, Software Engineering, SQL Databases, Speech Recognition, Parquet, High Performance Computing, Large Language Models, Multi-Cloud, Kubernetes, Information Technology, Bare Metal, Machine Learning Operations, Data Pipelines, Docker - **Published:** June 20, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=4452d233564e2ca6 ## About the Role Do you have experience in Systems engineering?, Do you have a Bachelor's degree?, * Education: BS/MS/PhD degree in Computer Science, Software Engineering, or a related field. * Experience: 3+ years of professional software engineering experience with a dedicated focus on AI/ML systems, high-performance computing (HPC), or ML infrastructure. * Multi-Cloud & Compute Management: Familiarity with hyper-scaler infrastructure (AWS) alongside specialized AI-centric bare-metal and GPU clouds (Nebius AI Cloud). * Cloud-Native Orchestration & Abstraction: Hands-on experience with containerization (Docker) and production-grade orchestration (Kubernetes), paired with cloud-agnostic cluster abstractors like SkyPilot to manage multi-region GPU availability. * LLM Serving Optimization: Deep architectural understanding of large language models and the system infrastructure required to serve them at scale using frameworks like vLLM and SGLang. * Data Engineering for AI: Experience building high-throughput data pipelines to support large-scale training, including proficiency in SQL, NoSQL, and columnar storage formats optimized for ML (e.g., Parquet)., * Familiarity with audio processing, speech-to-text frameworks, or Automatic Speech Recognition (ASR) pipelines. * Prior experience or a deep technical interest in aerospace, aviation, or autonomous systems (e.g., safety-critical software, edge-AI deployments). ## Description As a Senior AI Systems Engineer, you will architect, deploy, and manage the critical infrastructure services required for large-scale AI model training and inference. You will ensure our machine learning platforms are robust and efficient, bridging the gap between raw data and high-performance AI models. * Infrastructure & Orchestration: Deploy, scale, and manage resilient infrastructure services tailored for distributed AI model training and low-latency inference. * Maturity & MLOps: Utilize and maintain end-to-end tooling-including MLflow for experiment tracking and model registry-to streamline and optimize the AI development lifecycle. * Compute & Inference Optimization: Leverage specialized frameworks to maximize hardware utilization, managing multi-cloud compute scheduling alongside advanced LLM serving engines. * Cross-Functional Collaboration: Partner closely with AI researchers and Software Engineers to productionize cutting-edge models, establish monitoring systems, and debug complex performance bottlenecks at the hardware-software interface. ## Related Videos - [Coffee with Developers - Maria Apazoglou](https://www.wearedevelopers.com/videos/1209-coffee-with-developers-maria-apazoglou) - [Parquet, Delta, Iceberg & Ducklake - An introduction for developers](https://www.wearedevelopers.com/videos/100075-parquet-delta-iceberg-ducklake-an-introduction-for-developers) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [OLAP for AI Applications and why you should care](https://www.wearedevelopers.com/videos/100212-olap-for-ai-applications-and-why-you-should-care) - [Architecting the Future: Leveraging AI, Cloud, and Data for Business Success](https://www.wearedevelopers.com/videos/1096-architecting-the-future-leveraging-ai-cloud-and-data-for-business-success) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)