Machine Learning DevOps - Cloud and Compute Cluster - R&D Support

Pathway, Inc.
Palo Alto, CA, United States
2 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Artificial Intelligence Airflow Amazon Web Services Microsoft Azure Big Data Cloud Computing Computer Programming Continuous Integration Linux DevOps Github Python (Programming Language)
+26 more
Linux System Administration Machine Learning Tensorflow Prometheus Azure Machine Learning Shell Script Data Logging Graphics Processing Unit (GPU) Google Cloud Data Ingestion Pytorch Large Language Models Grafana Cloudformation Containerization Gitlab-ci Scikit Learn Kubernetes Information Technology Slurm Machine Learning Operations Cloudwatch Terraform Software Version Control Docker Jenkins

Job description

  • Optimize infrastructure for ML training and inference (e.g., GPUs, distributed compute).
  • Automate and maintain ML/LLM pipelines (data ingestion, training, validation, deployment).
  • Manage model versioning, reproducibility, and traceability.
  • Work with terabyte-large datasets.
  • Implement ML-centric CI/CD practices.
  • Monitor model performance and data drift in production.
  • Collaborate with machine learning engineers, software engineers, and platform teams.

The role focuses on operationalizing machine learning models, ensuring scalability, reliability, and automation across the ML lifecycle.

Requirements

Machine Learning, DevOps, Research & Development (R&D), Cloud Computing, Physics, Computer Science, Artificial Intelligence (AI), Research Skills, Writing Skills, Linux Administration, * Very good familiarity with Linux, shell scripts, and cluster configuration scripts as the basic work tool.

  • Proficiency in workload management, containerization and orchestration (Slurm, Docker, Kubernetes).
  • Solid grasp of CI/CD tools and workflows (GitHub Actions, Jenkins, Gitlab CI, etc.).
  • Cloud infrastructure knowledge (AWS, GCP, Azure) - especially in ML services (e.g., SageMaker Hyperpod, Vertex AI).
  • Familiarity with monitoring/logging tools (Grafana, CloudWatch, Prometheus, Loki).
  • Experience with infrastructure as code (Terraform, CloudFormation, cluster-toolkit).
  • Experience with ML pipeline orchestration tools (e.g., MLflow, Kubeflow, Airflow, Metaflow).
  • Programming skills in Python (with exposure to ML libraries like TensorFlow, PyTorch).
  • Experience with cluster, systems, and networks administration.
  • Willingness to learn.

This position holds a minimum requirement of a BSc in Computer Science or Information Technology.

Benefits & conditions

  • Intellectually stimulating work environment. Be a pioneer: you get to work with realtime data processing & AI.
  • Work in one of the hottest AI startups, with exciting career prospects. Team members are distributed across the world.
  • Responsibilities and ability to make significant contribution to the company’ success
  • Inclusive workplace culture

About the company

Pathway builds the first post-transformer frontier model that enables recurrent reasoning and recurrent memory, unbounded context, and real-time adaptation. We’re not optimizing yesterday’s technology; we’re building what comes after Transformers.

Pathway is currently scaling its internal models from billions of parameters towards hundreds of billions of parameters, aiming at achieving differentiated frontier intelligence.

Pathway is led by co-founder & CEO Zuzanna Stamirowska, a complexity scientist who created a team consisting of AI pioneers, including CTO Jan Chorowski who was the first person to apply Attention to speech and worked with Nobel laureate Geoff Hinton at Google Brain, as well as CSO Adrian Kosowski, a leading computer scientist and quantum physicist who obtained his PhD at the age of 20.

The company is backed by leading investors, as well as advisors including Lukasz Kaiser, co-author of the Transformer (β€œthe T” in ChatGPT) and a key researcher behind OpenAI’s reasoning models, and Jonathan Frankle, Chief AI Scientist at Databricks and Co-founder at Mosaic. Pathway is headquartered in Palo Alto, California.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…