LLM Ops Architect

We are seeking a highly experienced Senior AI Engineer to architect, design, and deliver enterprise-grade AI solutions on Microsoft Azure. This role requires deep expertise in cloud architecture, Azure services, Databricks, Generative AI, and Agentic AI frameworks. The ideal candidate will serve as a trusted technical advisor for customers, lead engineering teams, and drive the end-to-end implementation of secure, scalable, and production-ready AI applications.

The successful candidate will combine strong hands-on engineering capabilities with strategic architectural thinking, ensuring AI solutions meet business objectives, security requirements, and operational excellence standards., AI Solution Architecture & Delivery

• Design and implement enterprise-scale AI and data platforms on Microsoft Azure.
• Lead the architecture of Generative AI and Agentic AI solutions aligned with business and technical requirements.
• Collaborate directly with clients, stakeholders, and delivery teams to define solution roadmaps and implementation strategies.
• Provide technical leadership across the full AI application lifecycle, from ideation through production deployment.

Generative AI & Agentic AI

• Design and implement GenAI applications leveraging modern patterns such as:
• Retrieval-Augmented Generation (RAG)
• Prompt Engineering
• AI Evaluation Frameworks
• Responsible AI and Guardrails
• AI Orchestration Frameworks
• Develop and implement Agentic AI solutions, including:
• Multi-agent architectures
• Skills-based agents
• MCP (Model Context Protocol) integrations
• Tool calling and workflow automation
• Evaluate and optimize AI solution performance, reliability, and cost efficiency.

Azure & Cloud Engineering

• Architect and implement solutions using core Azure services, including:
• Build and maintain scalable data and AI platforms leveraging Azure Databricks.
• Establish cloud engineering best practices across networking, infrastructure, automation, monitoring, and operational excellence.

Security, Governance & Compliance

• Design secure AI and data solutions adhering to enterprise security standards.
• Implement and govern:
• Identity & Access Management (IAM)
• Data security and access controls
• Auditability and monitoring
• Compliance and governance frameworks
• Ensure responsible AI principles and security controls are embedded throughout the solution lifecycle.
• Strong leadership, communication, and problem-solving; able to lead technical teams

• Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or a related field.
• 8+ years of experience in cloud architecture, software engineering, or data engineering.
• 3+ years of experience designing and delivering AI/ML or Generative AI solutions.
• Proven architect-level expertise in Microsoft Azure within customer-facing or consulting environments.
• Strong hands-on experience with Azure Databricks and modern cloud-native architectures.
• Experience implementing production-grade Generative AI and Agentic AI solutions.
• Deep understanding of cloud infrastructure, networking, security, DevOps, and observability practices.
• Demonstrated expertise in AI application security, governance, access management, and compliance controls.
• Excellent communication, stakeholder management, and leadership skills.

Pulled from the full job description

• Parental leave
• Paid time off
• Vision insurance
• Dental insurance
• Life insurance
• Paid holidays
• Benefits from day one, The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Fractal, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is: $130,000 - $160,000. In addition, you may be eligible for a discretionary bonus for the current performance period., As a full-time employee of the company or as an hourly employee working more than 30 hours per week, you will be eligible to participate in the health, dental, vision, life insurance, and disability plans in accordance with the plan documents, which may be amended from time to time. You will be eligible for benefits on the first day of employment with the Company. In addition, you are eligible to participate in the Company 401(k) Plan after 30 days of employment, in accordance with the applicable plan terms. The Company provides for 11 paid holidays and 12 weeks of Parental Leave. We also follow a “free time” PTO policy, allowing you the flexibility to take time needed for either sick time or vacation.

Fractal provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws

If you like wild growth and working with happy, enthusiastic over-achievers, you’ll enjoy your career with us!

Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets; an ecosystem where human imagination is at the heart of every decision. Where no possibility is written off, only challenged to get better. We believe that a true Fractalite is the one who empowers imagination with intelligence. Fractal has been featured as a Great Place to Work by The Economic Times in partnership with the Great Place to Work® Institute and recognized as a ‘Cool Vendor’ and a ‘Vendor to Watch’ by Gartner.