Senior Software Engineer - Dev Platform

Payward, Inc.
San Francisco, CA, United States
7 days ago
Apply on arc.dev
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Clean Code Principles Application Programming Interfaces (APIs) Continuous Integration Python (Programming Language) Routing OAuth Open Source Technology OpenID Role-Based Access Control System Software TypeScript Large Language Models
+4 more
Caching Backend Kubernetes Api Gateway

Requirements

  • Solid experience as a backend or platform software engineer building and operating APIs and distributed services in production
  • Strong skills in a backend language such as Rust, Python or TypeScript, with a habit of writing well-tested, maintainable code
  • Working knowledge of how LLM APIs behave: authentication, streaming responses, token accounting, rate limits and provider failure modes
  • Experience with observability, CI/CD and containers, and comfort with Kubernetes and a major cloud provider
  • Ability to design clean, well-documented APIs for internal customers and to weigh their feedback
  • Clear written and verbal communication, and the ownership to carry work from idea to production

Nice to Haves

  • Experience with API gateways, proxies or traffic management
  • Experience building LLM-powered systems, including routing, caching, evaluation or cost controls
  • Familiarity with authentication and authorization patterns (OAuth, OIDC, RBAC)
  • Contributions to open-source infrastructure or developer-platform projects

About the company

Payward - the parent company behind Kraken, NinjaTrader, Breakout, xStocks, Payward Services and CF Benchmarks - has spent the last 15 years building one of the most modern and globally accessible financial infrastructure platforms in the industry, built to advance an open, global financial system.

The Team

Founded in 2011, Kraken is one of the world’s longest-standing crypto platforms, trusted by over 10 million individuals and institutions across the globe. It offers spot trading, margin, futures, staking, and OTC services, with products built for both individual investors and institutional clients.

The Dev Platform team builds the internal platform that Kraken’s engineers use to build, ship and run software. Within Dev Platform, the AI Gateway is Kraken’s company-wide LLM gateway: a single, governed entry point that gives teams self-service access to leading models from providers such as Anthropic, OpenAI and Google, with visibility into usage and cost, configurable budgets and rate limits, and routing across models and providers for efficiency and resilience.

The Opportunity

  • Build and extend the AI Gateway: new model and provider integrations, routing policies, budgets, rate limits, and usage and cost reporting
  • Design the APIs, SDKs and self-service tooling that let engineers across Kraken onboard to the gateway quickly and safely
  • Help teams migrate their LLM workloads onto the gateway with minimal disruption
  • Implement access control, key management and audit logging in partnership with Security
  • Instrument the gateway so teams can see latency, errors, token usage and cost for their own workloads
  • Own features end to end, from design through production, and keep the service reliable alongside SRE
  • Support internal users with clear documentation, debugging help and a tight feedback loop that shapes the roadmap
  • Contribute to code review, design documents and engineering practices across Dev Platform

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on arc.dev
Prepare application

Good distractions

Loading talks and stories from around this role…