Agentic AI Architect

Altera Semiconductor
San Jose, CA, United States
4 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Compensation
$149,100 - $238,200
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Computing Platforms C++ (Programming Language) Cloud Computing Computer Programming Distributed Systems Memory Management Field-Programmable Gate Array (FPGA) Python (Programming Language) Knowledge Management Language Modeling
+21 more
Open Source Technology Performance Tuning Systems Development Life Cycle Systems Integration Application Specific Integrated Circuits Data Ingestion Retrieval-Augmented Generation Transfer Learning Large Language Models Multi-Agent Systems Prompt Engineering IT Architecture Llamaindex Generative AI Agentic-AI Discretization Hardware Acceleration Machine Learning Operations Model Inference MLIR (Multi-Level Intermediate Representation) Microservices

Job description

We are seeking an Agentic AI Architect to lead the design and development of next-generation agentic AI systems integrated with FPGA/ASIC platforms.

This role sits at the intersection of:

  • Large Language Models (LLMs)
  • Agent frameworks & autonomous systems
  • Retrieval-Augmented Generation (RAG)
  • Hardware-aware AI system design (FPGA / ASIC / EDA)

You will define architecture, drive technical strategy, and build scalable AI systems that bridge software intelligence and hardware acceleration., AI Architecture & System Design

  • Design and implement agentic AI systems using LLMs, tools, and multi-agent orchestration
  • Architect RAG pipelines for enterprise-scale knowledge integration
  • Define end-to-end AI system architecture from data ingestion reasoning action

Agentic AI & LLM Development

  • Develop advanced workflows using:
  • tool-using agents
  • planning & reasoning agents
  • multi-agent collaboration frameworks
  • Evaluate and integrate leading LLMs (open-source and proprietary)
  • Optimize prompt engineering, memory, and reasoning capabilities

Hardware-Aware AI Optimization

  • Co-design AI systems with:
  • FPGA acceleration
  • ASIC platforms
  • heterogeneous compute (CPU/GPU/FPGA)
  • Explore LLM inference optimization on FPGA (quantization, compilation, partitioning)
  • Collaborate with hardware teams on EDA and system integration

Framework & Platform Development

  • Build internal platforms using
  • LangChain
  • LlamaIndex
  • custom agent orchestration framework
  • Develop reusable components for:
  • memory management
  • tool integration
  • knowledge retrieval

Technical Leadership

  • Lead architecture reviews and guide engineering teams
  • Mentor senior engineers and influence cross-functional teams
  • Drive innovation in AI + hardware convergence

What Makes This Role Unique

  • Opportunity to define agentic AI architecture for hardware-driven systems
  • Work at the convergence of:
  • AI reasoning systems
  • FPGA acceleration
  • next-generation computing platforms
  • High-impact role influencing future AI + semiconductor integration

Impact

You will help shape how AI agents interact with hardware, enabling:

  • intelligent system orchestration
  • real-time decision-making pipelines
  • scalable AI deployment on FPGA platforms

Requirements

  • Master’s or Bachelor’s degree with 10+ years of experience in one or more of the following:
  • AI/ML systems
  • Distributed systems
  • Hardware-software co-design

  • Recognized expertise in AI/ Large Language Models (LLMs)

  • Deep understanding of:
  • LLM architectures and inference
  • RAG systems and vector databases
  • Agentic AI / autonomous agents

  • Hands-on experience building:
  • Production-grade LLM applications
  • Multi-step reasoning and orchestration workflows
  • Scalable and reliable AI systems in production

  • Strong background in:
  • FPGA / ASIC / EDA systems
  • Heterogeneous computing architectures

  • Familiarity with:
  • Hardware acceleration for AI workloads
  • Performance optimization across system stack

Technical Skills

  • Programming:
  • Python
  • C++ (preferred)

  • Experience with:
  • Distributed systems design
  • APIs and microservices architecture
  • Cloud and/or edge AI deployment

  • Hands-on experience with:
  • LLM fine-tuning, quantization, and model distillation
  • On-device / edge AI deployment
  • Robotics, autonomous systems, or real-time AI pipelines

  • Knowledge of:
  • Compiler stacks (e.g., MLIR, TVM)
  • AI model optimization for FPGA platforms

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…