WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Senior Software Engineer - Inference

NEURAL SOLUTIONS LLC
Columbia, MD, United States
10 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
$204,000.0 - $247,000.0
Working hours
Regular working hours
Job source
www.clearancejobs.com

Tech stack

Artificial Intelligence Amazon Web Services Continuous Integration Python (Programming Language) Octopus Deploy Reliability Engineering Cloud Services Large Language Models Kubernetes Programming Languages

Job description

  • Lead the evaluation, configuration, and deployment of inference models for our users.
  • Mentor engineers and grow development best practices and standards for the team.
  • Engage with other teams in our organization to establish solid infrastructure for our services and integrate LLM-powered tools for user needs.
  • Collaborate with teammates on surge efforts to support short-term, high-priority inference needs from our customer.

Requirements

  • Experience with Python and/or other modern programming languages.
  • Experience with Argo CD and/or other CI/CD frameworks.
  • Experience with Kubernetes/Helm.
  • Experience with AWS or other cloud service providers.
  • Strong communication skills and ability to mentor other engineers.
  • Excellent leadership and stakeholder management skills.

Nice to Have:

  • Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
  • Experience supporting production software using Site Reliability Engineering (SRE) best practices.
  • Knowledge of and interest in hosting AI capabilities.

Experience Required: 12 years with Bachelor’s degree in a technical discipline, or 16 years without degree

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.clearancejobs.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

2:41 min

Transitioning artificial intelligence infrastructure into scalable commodity cloud services

juarezjunior juarezjunior · WWC 2024

2:28 min

Understanding Kubernetes architecture and core cluster components

Marc Nimmerrichter · WWC 2022

4:13 min

Empowering developers with comprehensive AI software stacks

Markus Hacker Markus Hacker +1 · WWC 2025

47 sec

Advantages of edge inference over cloud API services

Sasha Denisov Sasha Denisov · WWC Europe 2026

4:04 min

Overview of Kubernetes operators and custom resource definitions

Philipp Krenn · WWC 2022

1:24 min

Comprehensive AI infrastructure stacks at the Linux Foundation

Matt White Matt White · WWC 2025

Videos

See all
Leverage Cloud Computing Benefits with Serverless Multi-Cloud ML thumbnail
39:58
LIVE • over 5 years ago

Leverage Cloud Computing Benefits with Serverless Multi-Cloud ML

Linda Mohamed

Understanding Kubernetes in a visual way thumbnail
29:05
WWC Europe 2026 • about 1 month ago

Understanding Kubernetes in a visual way

Aurélie Vache

LLMOps-driven fine-tuning, evaluation, and inference with NVIDIA NIM & NeMo Microservices thumbnail
29:20
WWC 2025 • 12 months ago

LLMOps-driven fine-tuning, evaluation, and inference with NVIDIA NIM & NeMo Microservices

Anshul Jindal

ZEISS & Microsoft - Building the Next Generation Medical Ecosystem in the Cloud thumbnail
20:32
WWC 2022 • about 4 years ago

ZEISS & Microsoft - Building the Next Generation Medical Ecosystem in the Cloud

Leo Lindhorst

Instant KAI Sandboxes with vCluster: Multi-Tenant, Multi-Scheduler GPU Sharing thumbnail
27:54
WWC Europe 2026 • about 1 month ago

Instant KAI Sandboxes with vCluster: Multi-Tenant, Multi-Scheduler GPU Sharing

Piotr Zaniewski

Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps thumbnail
35:19
Coffee With Developers • 3 months ago

Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps

Hazal Mestci, Raph Terrier

Related articles

See all