> Markdown version of [/jobs/ext/4689511-senior-staff-software-engineer-ai-ml](https://www.wearedevelopers.com/jobs/ext/4689511-senior-staff-software-engineer-ai-ml). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior/Staff Software Engineer, AI/ML - **Company:** Recruiting from Scratch - **Location:** New York, NY, United States (Remote available) - **Experience:** Expert - **Salary:** $220,000 - $300,000 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Data Transformation, Distributed Systems, EHealth, Python (Programming Language), Machine Learning, Software Product Management, Software Architecture, Recommender Systems, OpenAI, Tensorflow, Software Deployment, Software Engineering, Chatbots, Pytorch, Retrieval-Augmented Generation, Delivery Pipeline, Large Language Models, Llamaindex, Generative AI, Backend, Agentic-AI, AI Platforms, Production Code, Search Engines, Machine Learning Operations, Virtual Agents, Multiplatform - **Published:** November 12, 2026 - **Apply:** https://www.careerbuilder.com/job-details/senior-staff-software-engineer-ai-ml-ny--daf33fc5-cf9a-4f9d-a6c3-6110e33b9144 ## About the Role Software Engineering, Artificial Intelligence (AI), Software Engineering, Artificial Intelligence (AI), Funding, Health Plan, Conversation Engine, Healthcare, Multiplatform/Cross-Platform, Search Engines, 6-15 years of experience in software engineering or AI/ML engineering roles Strong software engineering foundation with backend-heavy product engineering experience Experience building AI/ML products end-to-end in production environments Hands-on experience with LLMs, RAG systems, and agent frameworks Experience shipping production AI products from 0-to-1 Strong Python engineering experience Experience with chatbot systems, recommendation engines, search, or GenAI applications Experience working across the full ML lifecycle including ingestion, preprocessing, training, deployment, and monitoring Strong distributed systems and backend architecture skills Experience collaborating closely with product and cross-functional teams Comfortable operating autonomously in fast-moving startup or high-growth environments Strong builder mentality with high ownership and execution ability Comfortable writing production-grade code without heavy AI tooling dependence Ability to explain AI systems and technical tradeoffs clearly to non-technical stakeholders Strong Signals Experience building production LLM applications at scale Experience with RAG architectures and retrieval pipelines in production Experience with AI agent frameworks and orchestration systems Experience building chatbot, recommendation, or intelligent search systems Strong backend engineering foundation transitioning into AI/ML Experience with OpenAI APIs, Vertex AI, LangChain, LlamaIndex, or similar tooling Healthcare or digital health AI experience Experience handling high-volume production AI workloads Experience measuring production AI system performance and reliability Strong product-minded engineering instincts Experience working at high-growth product companies Experience owning projects from architecture through deployment Experience balancing ML experimentation with production engineering rigor Strong understanding of distributed systems and scalable infrastructure Experience working with PyTorch or TensorFlow Strong coding interview and system design capability Ability to discuss production metrics, scale, and operational performance of AI systems Experience building AI features with meaningful user or business impact Experience working on AI-powered user-facing products instead of purely internal ML infrastructure ## Description Build production-grade LLM systems using RAG, agent frameworks, orchestration layers, and modern AI tooling Develop AI-powered chatbots, recommendation engines, search systems, and intelligent workflows Own AI/ML product development from 0-to-1, from architecture through production deployment Design scalable ML pipelines for experimentation, fine-tuning, evaluation, and deployment Work closely with product, data, analytics, and engineering teams to deliver AI-native product experiences Build backend systems and APIs supporting AI workloads and inference pipelines Drive technical architecture and engineering best practices across AI systems Work with modern AI platforms including OpenAI APIs, Vertex AI, PyTorch, TensorFlow, and agent frameworks Translate healthcare and user data into intelligent, production-ready AI systems Contribute to AI platform strategy and help shape the company's long-term AI roadmap Operate autonomously in a fast-moving, highly ambiguous AI product environment Balance rapid iteration with scalability, safety, reliability, and performance Collaborate cross-functionally with product and business stakeholders to identify impactful AI opportunities Stay current with emerging LLM, RAG, and agentic AI technologies and integrate them into production systems