Distributed Systems & AI Infrastructure Engineer

KREA LLC
San Francisco, CA, United States
2 days ago
Apply on www.juju.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Extract Transform Load (ETL) Relational Databases Software Debugging Distributed Computing Environment Distributed Data Store Distributed Systems InfiniBand Python (Programming Language) Machine Learning NumPy Remote Direct Memory Access SQL Databases
+7 more
Data Streaming AI Infrastructure Pytorch Pandas Containerization Kubernetes Apache Kafka

Requirements

Systems people. If you’ve read a blog post about InfiniBand debugging or building a custom distributed database and thought “I want to do that” - this is that team.

You’ll spend your time working heavily with Python, Kubernetes, Torch, and data tools like DuckDB, Arrow, etc. It’s OK if you don’t have K8s or ML experience - the main thing we hire for is an intuition for distributed systems, and a great mental model of how systems interact and function under different conditions.

Strong candidates may have experience with

  • Python, PyArrow, DuckDB, SQL, massive relational databases, PyTorch, Pandas, NumPy…
  • Kubernetes
  • Designing and implementing large-scale ETL systems
  • Fundamental knowledge of containerization, operating systems, file-systems, and networking
  • Distributed systems design
  • Distributed training systems (NCCL, InfiniBand, RDMA)
  • Streaming and event processing systems (Kafka, Pulsar, or similar)
  • PyTorch internals, custom dataloaders, and training infrastructure

About the company

At Krea, we are building next-generation AI creative tools.

We are dedicated to making AI intuitive and controllable for creatives. Our mission is to build tools that empower human creativity, not replace it.

We believe AI is a new medium that allows us to express ourselves through various formats-text, images, video, sound, and even 3D. We’re building better, smarter, and more controllable tools to harness this medium.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.juju.com
Prepare application

Good distractions

Loading talks and stories from around this role…