Senior Software Engineer, Backend/Infra

PIKA, LLC
Palo Alto, CA, United States
about 2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Compensation
$185,000.0 - $300,000.0
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Amazon Web Services Systems Engineering Automated Storage and Retrieval Systems Software as a Service Cloud Computing Code Review Continuous Integration Database Design Database Models Software Debugging Distributed Systems
+24 more
Python (Programming Language) Node.Js NoSQL Open Source Technology Performance Tuning Queueing Systems Software Engineering SQL Databases TypeScript Speech Recognition WebSocket Large Language Models Multi-Agent Systems Prompt Engineering Generative AI Backend Fastapi Event Driven Architecture Kubernetes Low Latency Api Design GPT Golang Microservices

Job description

We are seeking a Senior Backend & Infra Engineer to help shape the core infrastructure powering Pika’s products. In this role, you will operate at the intersection of systems engineering and advanced AI, taking ownership of the unified architecture that supports our platform-from real-time messaging and scalable APIs to cognitive agent runtimes and orchestration frameworks.

You will architect and build robust, distributed backend systems enabling autonomous AI agents to reason, use tools, recall memories, and act across multiple platforms at scale. This high-ownership position means your architectural decisions will directly impact how millions of users experience generative AI. As a senior engineer, you’ll also play a key role in raising the technical bar through guidance, RFCs, code reviews, and mentorship.

What You’ll Do * Architect Distributed Systems: Build scalable backend, infrastructure, and agentic services for Pika’s web, mobile, and multi-platform products.

  • Evolve the Agent Runtime: Design and optimize the core execution loop that handles agent reasoning, tool-use frameworks, function calling, memory retrieval, and multi-step orchestration.
  • Design Real-Time Architecture: Own and scale real-time messaging infrastructure, event-driven architectures, WebSocket connections, and pub/sub patterns for throughput, latency, and reliability.
  • Implement Core AI Capabilities: Optimize LLM integrations, multi-provider model routing (Claude, GPT, Gemini, open-source), context window management, cost optimization, and streaming responses.
  • Build Memory & Retrieval Systems: Design semantic search and vector-based embedding infrastructure to handle long-term memory, working memory, and episodic recall for autonomous agents.
  • Own Backend Logic End-to-End: Drive database modeling (SQL/NoSQL), API design, performance tuning, and production reliability for high-traffic pipelines.
  • Drive Technical Excellence: Write RFCs, evaluate complex technical trade-offs, mentor junior engineers through code reviews, and build alignment across engineering and product teams.

Requirements

Do you have experience in Systems engineering?, Experience: 5+ years of software engineering experience building production services at scale, with 2+ years hands-on with LLM-based orchestration, multi-agent systems, or agentic solutions.

  • Backend Mastery: Deep proficiency in modern backend technologies (Node.js, Python, Go) and frameworks (Express, FastAPI, TypeScript, etc.).
  • Systems & Infra Knowledge: Strong understanding of distributed systems, event-driven microservices, message queues, cloud infrastructure (AWS/GCP), Kubernetes, and CI/CD workflows.
  • AI & Agentic Expertise: Solid grasp of LLM capabilities and limitations, prompt engineering (system prompts, chain-of-thought, structured output), tool-use execution, and embedding models.
  • Real-Time Patterns: Comfort designing and debugging real-time streaming pipelines, long-polling, and highly concurrent networking setups.
  • Product & Data Intuition: Deep understanding of database design and the product sense needed to make an AI system feel “alive” and responsive.
  • Mindset: Ownership mentality-identify systemic bottlenecks and ship solutions without waiting for exact specifications. Strong communication and a collaborative, team-first attitude., Experience with multi-modal AI architectures (image generation, TTS, speech-to-text, video generation)
  • Experience with agent frameworks (LangChain, CrewAI, AutoGPT) or building custom, high-performance execution runtimes
  • Experience with fine-tuning, RLHF, or DPO pipelines
  • Background in multi-tenant SaaS or internal tooling and operational automation
  • Previous startup experience-comfortable with ambiguity and rapid experimentation
  • Competitive coding background (IOI, ICPC, Olympiad medalists, etc.)

Benefits & conditions

4.24.2 out of 5 stars Palo Alto, CA $185,000 - $300,000 a year - Full-time, Competitive salary in the AI industry

  • Equity in a fast-growing startup shaping the future of AI
  • Comprehensive health benefits, monthly stipends, company retreats
  • A supportive and collaborative office culture-we’re all building and launching together

About Pika

At Pika, we’re crafting a future where video creation is seamless, intuitive, and universally accessible. Our vision is a world where videos serve as a canvas for everyone’s unique expression, not just entertainment. Harnessing AI’s transformative power, we aim to remove the technical barriers that have traditionally limited video production. We focus on building the best technology to empower creativity-not only within our products, but as a core part of our culture.

We are a small, energetic team of smart and curious individuals valuing efficiency, collaboration, and creativity. We’re looking for team members with sharp intellect, a strong work ethic, and the ambition to make a meaningful impact. You’ll find significant growth opportunities here, supported by a culture that nurtures both individual and collective development.

Our headquarters is in Palo Alto, CA, and we work from the office 3-5 days a week.

Compensation Range: $185K - $300K

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:44 min

Balancing artisanal coding skills with automated agent oversight

Jyoti Bansal Jyoti Bansal +1 · WWC Europe 2026

40 sec

Generative pre-trained transformer models powering code completions

lgonta lgonta +1 · WWC 2024

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

1:08 min

Building solutions with open source GoLang infrastructure tools

Jad Wahab · LIVE

3:51 min

Shifting skill requirements for entry-level software engineers

Taroon Mandhana Taroon Mandhana +1 · WWC Europe 2026

51 sec

Assessing GPT-4o performance for pull request feedback

Merrill Lutsky Merrill Lutsky · WWC 2025

Videos

See all

Related articles

See all