AI Lab Infrastructure Engineer

Berkeley Research Group, LLC
United States
12 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Working hours
Regular working hours

Tech stack

Java (Programming Language) .NET Framework Artificial Intelligence Amazon Web Services Amazon Elastic Compute Cloud Amazon S3 User Authentication Cloud Engineering Continuous Integration Data Files Desktop Virtualization Distributed Systems
+22 more
Fault Tolerance Identity and Access Management Job Scheduling Python (Programming Language) Machine Learning Systems Development Life Cycle Remote Access Technology OpenAI Software Deployment Software Engineering AI Infrastructure Data Processing System Availability Large Language Models Concurrency Infrastructure Automation Frameworks Information Technology AWS Fargate Machine Learning Operations Hardware Infrastructure Terraform Programming Languages

Job description

Berkeley Research Group’s Ai Department is seeking an AI Infrastructure Engineer to lead the development of our Virtual Ai Lab initiative. Following the successful completion of Phase 01 (physical Ai Lab build-out), this role will focus on creating a virtual access layer that makes our high-performance Ai Lab remotely accessible to teams across BRG. The ideal candidate will design and implement scalable infrastructure to support processing 100,000+ documents daily using state-of-the-art LLMs from OpenAI and Anthropic., As an AI Infrastructure Engineer, you will architect and build the virtual access interface for our physical Ai Lab, ensuring secure, scalable, and efficient remote processing capabilities. You will lead the design and implementation of infrastructure that allows BRG teams to leverage our Ai Lab’s computational power remotely, while maintaining performance standards for large-scale document processing. Key responsibilities include developing customizable interfaces for different BRG groups, implementing secure access controls, and ensuring optimal resource allocation for concurrent users processing massive datasets through LLMs., * Design and implement a virtual access layer for the physical Ai Lab infrastructure

  • Build scalable remote processing capabilities supporting 100,000+ documents per day
  • Create customizable, expandable interfaces for different BRG business units
  • Optimize infrastructure for maximum LLM token throughput (OpenAI/Anthropic)
  • Implement secure authentication and access management systems
  • Ensure high availability and fault tolerance for mission-critical AI workloads
  • Lead infrastructure projects from conception to production deployment

Requirements

Artificial Intelligence (AI), Consulting, Artificial Intelligence (AI), Access Control, Concurrency, Resource Management, Data Sets, Process Capability, Scalable System Development, Authentication, * Bachelor’s degree in Computer Science, Information Technology, or a related field

  • Minimum six to eight (6-8) years of hands-on experience designing, deploying, and managing scalable cloud infrastructure
  • Strong experience with Infrastructure as Code (IaC) tools and methodologies
  • Experience designing, implementing, and maintaining scalable, secure, and cost-efficient cloud/on-prem solutions
  • Proven ability to manage and lead projects to deliver high-quality, replicable solutions
  • Proficiency in VCS (Git/GitHub), modern coding languages (Python, .NET, Java, etc.), Software Development Life Cycle, and CI/CD practices
  • Experience with API design and implementation for distributed systems
  • Knowledge of GPU infrastructure and optimization for AI workloads
  • Hands-on experience with AWS Services including:
  • EC2/Lambda (apps/functions)
  • SageMaker (ML)
  • S3 (file management)
  • Fargate/ECS/EKS (containerization)
  • CDK/Terraform (IaC)
  • Cost Explorer/Budgets

Preferred:

  • Experience with LLM deployment and optimization (OpenAI, Anthropic, etc.)
  • Background in building AI/ML infrastructure and platforms
  • Experience with virtual desktop infrastructure (VDI) or remote access solutions
  • Knowledge of distributed computing and job scheduling systems
  • AWS certifications (Solutions Architect, Machine Learning, or similar)
  • Experience with cost management and optimization strategies in the cloud
  • Familiarity with security best practices for AI systems and data handling

About the company

BRG combines world-leading academic credentials with world-tested business expertise purpose-built for agility and connectivity, which sets us apart-and gets you ahead.

At BRG, our top-tier professionals include specialist consultants, industry experts, renowned academics, and leading-edge data scientists. Together, they bring a diversity of proven real-world experience to economics, disputes, and investigations; corporate finance; and performance improvement services that address the most complex challenges for organizations across the globe.

Our unique structure nurtures the interdisciplinary relationships that give us the edge, laying the groundwork for more informed insights and more original, incisive thinking from diverse perspectives that, when paired with our global reach and resources, make us uniquely capable to address our clients’ challenges. We get results because we know how to apply our thinking to your world.

At BRG, we don’t just show you what’s possible. We’re built to help you make it happen.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…