> Markdown version of [/jobs/ext/1488904-llm-ops-architect](https://www.wearedevelopers.com/jobs/ext/1488904-llm-ops-architect). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # LLM Ops Architect - **Company:** Fractal Analytics - **Location:** United States - **Experience:** Expert - **Salary:** $130,000.0 - $160,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Audit Trail, Microsoft Azure, Cloud Computing, Cloud Engineering, Information Systems, Information Engineering, Data Security, Data Systems, DevOps, Identity and Access Management, Software Deployment, Software Engineering, Large Language Models, Multi-Agent Systems, Prompt Engineering, Generative AI, Information Technology, Data Management, Virtual Agents, Databricks - **Published:** July 29, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=574701e101f65830 ## About the Role * Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or a related field. * 8+ years of experience in cloud architecture, software engineering, or data engineering. * 3+ years of experience designing and delivering AI/ML or Generative AI solutions. * Proven architect-level expertise in Microsoft Azure within customer-facing or consulting environments. * Strong hands-on experience with Azure Databricks and modern cloud-native architectures. * Experience implementing production-grade Generative AI and Agentic AI solutions. * Deep understanding of cloud infrastructure, networking, security, DevOps, and observability practices. * Demonstrated expertise in AI application security, governance, access management, and compliance controls. * Excellent communication, stakeholder management, and leadership skills. ## Description We are seeking a highly experienced Senior AI Engineer to architect, design, and deliver enterprise-grade AI solutions on Microsoft Azure. This role requires deep expertise in cloud architecture, Azure services, Databricks, Generative AI, and Agentic AI frameworks. The ideal candidate will serve as a trusted technical advisor for customers, lead engineering teams, and drive the end-to-end implementation of secure, scalable, and production-ready AI applications. The successful candidate will combine strong hands-on engineering capabilities with strategic architectural thinking, ensuring AI solutions meet business objectives, security requirements, and operational excellence standards., AI Solution Architecture & Delivery * Design and implement enterprise-scale AI and data platforms on Microsoft Azure. * Lead the architecture of Generative AI and Agentic AI solutions aligned with business and technical requirements. * Collaborate directly with clients, stakeholders, and delivery teams to define solution roadmaps and implementation strategies. * Provide technical leadership across the full AI application lifecycle, from ideation through production deployment. Generative AI & Agentic AI * Design and implement GenAI applications leveraging modern patterns such as: + Retrieval-Augmented Generation (RAG) + Prompt Engineering + AI Evaluation Frameworks + Responsible AI and Guardrails + AI Orchestration Frameworks * Develop and implement Agentic AI solutions, including: + Multi-agent architectures + Skills-based agents + MCP (Model Context Protocol) integrations + Tool calling and workflow automation * Evaluate and optimize AI solution performance, reliability, and cost efficiency. Azure & Cloud Engineering * Architect and implement solutions using core Azure services, including: * Build and maintain scalable data and AI platforms leveraging Azure Databricks. * Establish cloud engineering best practices across networking, infrastructure, automation, monitoring, and operational excellence. Security, Governance & Compliance * Design secure AI and data solutions adhering to enterprise security standards. * Implement and govern: + Identity & Access Management (IAM) + Data security and access controls + Auditability and monitoring + Compliance and governance frameworks * Ensure responsible AI principles and security controls are embedded throughout the solution lifecycle. * Strong leadership, communication, and problem-solving; able to lead technical teams ## Related Videos - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [From Traction to Production: Maturing your LLMOps step by step](https://www.wearedevelopers.com/videos/1250-from-traction-to-production-maturing-your-llmops-step-by-step) - [Resilient by Design: Building Robust Architectures in High-Stakes Financial Systems](https://www.wearedevelopers.com/videos/2106-resilient-by-design-building-robust-architectures-in-high-stakes-financial-systems) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [DevOps for AI: running LLMs in production with Kubernetes and KubeFlow](https://www.wearedevelopers.com/videos/1222-devops-for-ai-running-llms-in-production-with-kubernetes-and-kubeflow) - [No Keys for the Robot: GitOps as the Control Plane for Autonomous Agents](https://www.wearedevelopers.com/videos/100095-no-keys-for-the-robot-gitops-as-the-control-plane-for-autonomous-agents) ## Related Articles - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)