Principal Software Engineer - Next-Generation API & AI Platform Architecture

Spycloud, Inc.
Austin, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Austin, United States of America

Tech stack

Adobe InDesign
API
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Big Data
Software Quality
Data Infrastructure
Data Stores
Data Systems
Distributed Systems
Elasticsearch
Graph Database
Python
PostgreSQL
Machine Learning
Neo4j
Performance Tuning
Redis
Azure
Systems Integration
Management of Software Versions
Snowflake
Data Layers
AI Platforms
Infrastructure Automation Frameworks
Low Latency
Api Design
Api Management
Redshift
Databricks

Job description

  • Architect and implement customer-facing data and intelligence APIs with clear versioning, SLAs, and backward compatibility.

  • Define and enforce API contracts for: o Low latency, high throughput endpoints o Agentic workflows (tools, actions, state transitions, handoffs) o Context retrieval and enrichment

  • Design APIs as durable platform interfaces, not thin wrappers over storage systems.

  • Establish standards for schema governance, payload design, and service boundaries.

  • Agentic & ML Platform Integration
  • Architect service layers that support agentic workflows, including orchestration interfaces, guardrails, and runtime observability.
  • Build API surfaces that expose model outputs safely and consistently.
  • Collaborate with MLEs and Data Scientists to move models from experimentation into robust inference services.
  • Ensure proper lifecycle management, monitoring, and rollback mechanisms for ML-powered endpoints.
  • Data Platform & Context Hubs
  • Design and implement service layers that sit on top of the gold-layer system of record.
  • Build and evolve context hubs derived from authoritative systems of record, enabling consistent entity, identity, or risk context for downstream services.
  • Ensure APIs are aligned with medallion architecture principles and platform data contracts.
  • Prevent fragmentation by maintaining strong coupling to canonical schemas and governed data models.
  • Distributed Systems & Reliability
  • Design high-throughput, low-latency services supporting batch and streaming workloads.
  • Implement scalable infrastructure patterns on AWS.
  • Ensure strong observability, error handling, performance tuning, and cost awareness.
  • Drive infrastructure-as-code practices and production readiness standards.
  • Technical Leadership
  • Serve as a senior architectural voice in design reviews.
  • Raise the bar on code quality, system design, and operational rigor.
  • Mentor engineers on API design, distributed systems, and ML integration patterns.
  • Influence platform direction through technical depth rather than organizational authority.

Requirements

  • 10+ years of experience building distributed systems, APIs, or large-scale data platforms.
  • Deep experience designing and implementing customer-facing APIs as long-lived products.
  • Strong understanding of schema governance, versioning strategies, and contract design.
  • Experience productionizing ML models and exposing inference services.
  • Experience designing or integrating agentic or autonomous workflows.
  • Experience building service layers on top of systems of record or semantic data layers.
  • Strong background in distributed systems reliability, observability, and scalability.
  • Proficiency in Go & Python (and/or Back End service languages).
  • Hands-on experience with Databricks/Snowflake.
  • Strong experience with AWS infrastructure and infrastructure-as-code tools.

Nice to Have

  • AWS services including Redshift, S3, EC2, and related cloud-native tooling.
  • Data stores including Elasticsearch, PostgreSQL, Redis, and graph databases (eg, Neo4j or AWS Neptune).
  • Experience building high-performance APIs and service layers over heterogeneous data systems.
  • Familiarity with Databricks/Snowflake and/or SageMaker is a plus.
  • Experience in cybersecurity, identity, fraud, or risk systems is a plus.

Benefits & conditions

U.S.-Based Benefits + Perks (for Full Time Employees)

  • 401(k) with Employer Contribution
  • Health, Vision, and Dental Insurance
  • Health Savings Account (HSA) available with Employer Contribution
  • Employer Paid Life, Short-term, and Long-term Disability Insurance
  • Generous PTO Plan and 16 paid holidays per year

U.K.-Based Benefits + Perks (for Full Time Employees)

  • Retirement Savings Plan with Employer Contribution
  • Employer Provided Private Health Insurance and Healthcare Cashplan
  • Employer Paid Life Insurance and Income Replacement
  • Generous Holiday Plan and 14 paid holidays per year

SpyCloud is not sponsoring visas at this time.

For applicants residing in California, please read SpyCloud's CCPA Notice.

For applicants residing in the UK, please read SpyCloud's Employee Privacy Notice.

Apply for this position