Senior Software Engineer

• Deploy and manage containerized AI/ML services using Kubernetes in on-premises environments.
• Implement observability and monitoring solutions using Prometheus, Grafana, and related tooling to track system health and usage metrics.
• Build and maintain CI/CD pipelines and infrastructure-as-code to enable reliable, automated deployment of platform services.
• Design and implement resilient infrastructure patterns to ensure high availability and performance of mission-critical capabilities.
• Collaborate with stakeholders to translate operational and reliability requirements into platform engineering solutions.

• Experience deploying and managing services in on-premises infrastructure environments.
• Service containerization and orchestration with Docker/Kubernetes in production environments.
• Experience with observability and monitoring tools such as Prometheus, Grafana, or equivalent platforms.
• Knowledge of CI/CD pipelines, GitOps workflows.
• Atlassian Tools (Jira, Confluence).

Nice to Have:

• Experience with model serving technologies (vLLM, TorchServe, TensorFlow Serving, Triton Inference Server).
• Knowledge of AI infrastructure tools and frameworks (LiteLLM, Bifrost, Ray, Ollama).

Experience Required: 12 years with Bachelor’s degree in a technical discipline or 16 years without degree