Architect, AI Platform

We are seeking a visionary Red Hat Architect specializing in Machine Learning Operations (MLOps) and Artificial Intelligence (AI) to design, build, and scale our enterprise AI platform. In this role, you will bridge the gap between enterprise-grade infrastructure and cutting-edge artificial intelligence.

You will lead the architectural design of our container-native machine learning pipelines on Red Hat OpenShift, with a heavy focus on Large Language Models (LLMs), containerized model serving, scalable runtime environments, and automated benchmarking.

What you will do:

• Design and advocate solutions that leverage the full Red Hat ecosystem to solve complex business problems, explicitly aligning AI/ML capabilities with customer strategic goals.
• Work hand-in-hand with customer associates and executive stakeholders to guide the adoption of Artificial Intelligence and MLOps processes, drastically improving model time-to-market and operational efficiency.
• Collaborate with project and customer team members to manage scope, mitigate architectural risks, and consistently meet delivery timelines and project goals.
• Participate in consulting sales motions to discover customer pain points, scope complex engineering engagements, architect high-level proposals, and deliver compelling technical demonstrations/proof-of-concepts (PoCs).
• Contribute heavily to project documentation and diagrams, capturing architectural blueprints, deployment guides, and best practices to ensure long-term customer success and internal knowledge reuse.
• Commit to continuous training and professional development to stay at the absolute forefront of the rapidly evolving LLM, MLOps, and Cloud-Native ecosystem.
• Architect and build production-grade MLOps pipelines using Red Hat OpenShift Container Platform and Red Hat OpenShift AI (RHOAI).
• Guide customers through Model Selection (e.g., Llama, Mistral, Granite) by analyzing specific business use cases against hardware/GPU memory constraints, cost profiles, and licensing models.
• Design containerized Model Deployment architectures using KServe, optimizing low-latency Inference Servers (e.g., vLLM, TGI, Triton) within OpenShift environments.
• Establish automated Benchmarking and Test pipelines to measure tokens-per-second throughput, hardware efficiency, and cost-per-inference metrics.
• Mentor and share knowledge with customers through structured workshops, paired programming sessions, and architectural reviews, empowering their internal teams to confidently manage the platform post-delivery.
• Act as an internal champion, coaching junior consultants and engineering associates on the nuances of deploying AI workloads on Kubernetes.

• 8-10 years in a related technology position, e.g., sales, consulting, operations, development, etc
• 5+ years of experience with Public Cloud and Linux technologies
• 3+ years of experience with Red Hat OpenShift Container Platform or Kubernetes
• 3+ years experience in production ready AI solutions.
• 3+ years experience in production ready Machine Learning use cases.

Nice to have:

• Experience in designing and delivering implementations using various public and private cloud infrastructure technologies and providers
• Red Hat Certified Architect (RHCA) or Specialist certifications in OpenShift.
• Demonstrated experience publishing technical whitepapers, architectural blueprints, or speaking at industry conferences (e.g., Red Hat Summit, KubeCon).
• Experience in Financial Services

The salary range for this position is $142,370.00 - $234,770.00. Actual offer will be based on your qualifications.

(part of IBM) 4.04.0 out of 5 stars New York State $142,370 - $234,770 a year - Full-time, Pulled from the full job description

• Tuition reimbursement
• Military leave
• Paid parental leave
• Employee stock purchase plan
• Parental leave
• Health insurance
• 401(k) matching, Red Hat determines compensation based on several factors including but not limited to job location, experience, applicable skills and training, external market value, and internal pay equity. Annual salary is one component of Red Hat’s compensation package. This position may also be eligible for bonus, commission, and/or equity. For positions with Remote-US locations, the actual salary range for the position may differ based on location but will be commensurate with job duties and relevant work experience., * Comprehensive medical, dental, and vision coverage
• Flexible Spending Account - healthcare and dependent care
• Health Savings Account - high deductible medical plan
• Retirement 401(k) with employer match
• Paid time off and holidays
• Paid parental leave plans for all new parents
• Leave benefits including disability, paid family medical leave, and paid military leave
• Additional benefits including employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more!

Note: These benefits are only applicable to full time, permanent associates at Red Hat located in the United States.

Inclusion at Red Hat Red Hat’s culture is built on the open source principles of transparency, collaboration, and inclusion, where the best ideas can come from anywhere and anyone. When this is realized, it empowers people from different backgrounds, perspectives, and experiences to come together to share ideas, challenge the status quo, and drive innovation. Our aspiration is that everyone experiences this culture with equal opportunity and access, and that all voices are not only heard but also celebrated. We hope you will join our celebration, and we welcome and encourage applicants from all the beautiful dimensions that compose our global village.

Red Hat is the world’s leading provider of enterprise open source software solutions, using a community-powered approach to deliver high-performing Linux, cloud, container, and Kubernetes technologies. Spread across 40+ countries, our associates work flexibly across work environments, from in-office, to office-flex, to fully remote, depending on the requirements of their role. Red Hatters are encouraged to bring their best ideas, no matter their title or tenure. We’re a leader in open source because of our open and inclusive environment. We hire creative, passionate people ready to contribute their ideas, help solve complex problems, and make an impact.