> Markdown version of [/jobs/ext/1889726-staff-software-engineer](https://www.wearedevelopers.com/jobs/ext/1889726-staff-software-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Staff Software Engineer - **Company:** SUPER TOOL LLC - **Location:** Burlingame, CA, United States - **Experience:** Experienced - **Salary:** $200,000.0 - $275,000.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Audit Trail, Microsoft Azure, Software as a Service, Cloud Computing, Cloud Engineering, Continuous Delivery, Continuous Integration, Data Governance, Distributed Systems, Medical Software, Python (Programming Language), Machine Learning, Performance Tuning, Software Architecture, Systems Development Life Cycle, Service-Oriented Architecture, Software Engineering, TypeScript, Web Services, Load Balancing, Fast Healthcare Interoperability Resources, Large Language Models, Caching, Backend, Kubernetes, Low Latency, HuggingFace, Health Level Seven International, Machine Learning Operations, Software Coding, Terraform, Docker - **Published:** July 31, 2026 - **Apply:** https://www.careerbuilder.com/job-details/staff-software-engineer-applied-ai-burlingame-ca--657a4468-636b-402c-b4d8-2bfaff6d3a7a ## About the Role * 5+ years of backend or full-stack software engineering experience, with 3+ years working on ML/LLM-enabled applications. * Strong coding skills in Python (and ideally one statically typed language such as Go, Java, or TypeScript). * Experience with LLM integration frameworks (Hugging Face, LangChain, LlamaIndex, OpenAI APIs, Anthropic, etc.). * Deep knowledge of distributed systems, service-oriented architecture, and building APIs at scale. * Cloud-native expertise: AWS/GCP/Azure, Kubernetes, Docker, Terraform, etc. * Familiarity with MLOps/LLMOps practices: CI/CD for models, evaluation harnesses, monitoring, and reproducibility. * Excellent system design skills and the ability to align technical architecture with product goals., * Experience applying LLMs in healthcare or other regulated industries (FHIR, HL7, HIPAA). * Hands-on experience with RAG pipelines, vector databases, and structured-output orchestration. * Background in enterprise SaaS or mission-critical platforms where uptime, latency, and scale matter. * Knowledge of responsible AI, safety, and privacy-preserving ML techniques., Application Programming Interface (API), Artificial Intelligence (AI), Best Practices, Caching, Cloud Computing, Continuous Deployment/Delivery, Continuous Integration, Cross-Functional, Distributed Computing, HIPAA (Health Insurance Portability and Accountability Act), HL7 (Health Level 7), Healthcare, Healthcare Software, Hospital/Healthcare Construction, Leadership, Load Balancing, Mentoring, Performance Tuning/Optimization, Product Demonstration, Product Engineering, Project Engineering, Revenue Management, Scalable System Development, Service-Oriented Architecture (fka Distributed Object Architecture), Software Engineering, Software as a Service (SaaS), Technical Leadership, Use Cases ## Description SuperDial is seeking a Staff Software Engineer, Applied AI to build and scale the backend systems that power LLM applications in healthcare. This role is ideal for an engineer who thrives at the intersection of backend architecture and applied AI, designing APIs, pipelines, and infrastructure that make LLMs reliable, secure, and cost-efficient in production. If you want to push LLMs beyond demos into mission-critical healthcare workflows, we'd love to hear from you., * Backend for LLMs - Architect and implement scalable, low-latency APIs and services that wrap, orchestrate, and optimize LLMs for healthcare use cases. * Data & Retrieval Pipelines - Build ingestion, preprocessing, and retrieval-augmented generation (RAG) pipelines to ground LLMs in clinical and revenue-cycle data. * LLMOps & Observability - Design systems for model monitoring, evaluation, cost tracking, and guardrails, ensuring reliability and responsible use. * Performance & Optimization - Engineer solutions for caching, batching, load balancing, and scaling LLM workloads across cloud and containerized environments. * Security & Compliance - Implement HIPAA-ready infrastructure, data governance, and auditability for LLM-powered applications. * Cross-Functional Collaboration - Partner with product, ML engineers, and healthcare experts to translate business workflows into robust backend systems. * Technical Leadership - Drive end-to-end delivery of LLM backend projects, establish engineering best practices, and mentor peers in LLM system design. ## Related Videos - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock) - [HTTP headers that make your website go faster](https://www.wearedevelopers.com/videos/1676-http-headers-that-make-your-website-go-faster) - [Three years of putting LLMs into Software - Lessons learned](https://www.wearedevelopers.com/videos/1508-three-years-of-putting-llms-into-software-lessons-learned) - [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker) - [One AI API to Power Them All](https://www.wearedevelopers.com/videos/1601-one-ai-api-to-power-them-all) ## Related Articles - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production](https://www.wearedevelopers.com/magazine/115-mlops-deploying-maintaining-and-evolving-machine-learning-models-in-production) - [Why Upskilling And Reskilling is Important For Developers](https://www.wearedevelopers.com/magazine/428-why-upskilling-and-reskilling-is-important-for-developers) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)