Senior/Lead DevOps Engineer (On-Prem Infrastructure) - Remote

SoftServe, Inc.
New York, NY, United States
25 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$113,120 - $141,400
Working hours
Regular working hours

Tech stack

Artificial Intelligence Cloud Computing Computer Clusters Cyber Security DevOps Virtual Private Networks (VPN) Peering Inference Optimization Software Deployment Graphics Processing Unit (GPU) Load Balancing Delivery Pipeline
+8 more
Multi-Cloud Firewalls (Computer Science) Gitlab-ci Kubernetes Enterprise Integration Machine Learning Operations Hardware Infrastructure Software Version Control

Job description

Our client builds and operates hybrid infrastructure, spanning on-premises GPU clusters and multi-cloud environments, for enterprise banking clients. Youll join a delivery team managing large-scale Kubernetes and cloud infrastructure for demanding, security-critical AI/ML and business workloads., * Manage and operate large-scale on-premises Kubernetes clusters, with hands-on ownership of CNI and CSI configuration, networking, and storage integration

  • Manage operating systems across GPU nodes using NVIDIA BCM
  • Optimize GPU resource allocation and model performance tuning using NVIDIA Run: AI and GPU/model parameter configuration
  • Set up and manage CI/CD pipelines using GitLab CI/CD for infrastructure and application delivery
  • Configure networking, firewalls, and load balancing across on-prem environments
  • Ensure infrastructure meets banking-grade compliance and security standards
  • Collaborate directly with client stakeholders and lead small delivery teams

Requirements

DevOps, Banking Services, Team Lead/Manager, GPU (Graphics Processing Unit), Artificial Intelligence (AI), Cloud Computing, Security Infrastructure, Network Integration, Operating Systems, Systems Administration/Management, * 5+ years of experience in DevOps/Infrastructure Engineering, with deep hands-on expertise in on-premises Kubernetes

  • Strong experience managing GPU compute infrastructure (NVIDIA BCM, Run: AI, or equivalent)
  • Proficiency with GitLab CI/CD for pipeline automation
  • Solid networking fundamentals (firewalls, load balancing, VPNs, peering)
  • Experience working directly with banking or other regulated-industry clients
  • Prior cloud exposure (GCP or similar) is a plus, though not required for this role
  • Demonstrated LLMOps experience, including model versioning, inference optimization, production monitoring and evaluation, and ongoing lifecycle management of deployed models (required)

Benefits & conditions

This is a US-based role (New York City, Jersey City, Lake Mary, FL, or Pittsburgh) with an anticipated base salary range of $113,120-$141,400 annually.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…