> Markdown version of [/jobs/ext/2716907-software-engineer-data-infrastructure](https://www.wearedevelopers.com/jobs/ext/2716907-software-engineer-data-infrastructure). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Software Engineer, Data Infrastructure - **Company:** DECAGON, LLC - **Location:** New York, United States - **Experience:** Expert - **Salary:** $200,000.0 - **Contract:** Permanent contract - **Skills:** Query Performance, Artificial Intelligence, Airflow, Amazon Web Services, Microsoft Azure, Big Data, BigQuery, Cloud Database, Continuous Integration, Data Infrastructure, Data Systems, Operational Databases, RabbitMQ, Prometheus, Data Streaming, Datadog, Google Cloud, System Availability, Large Language Models, Snowflake, Grafana, Apache Spark, Multi-Cloud, Debezium, Kubernetes, Low Latency, Apache Flink, Dask, Apache Kafka, Data Management, Vertica, Terraform, Stream Processing, Data Pipelines, Amazon Redshift, Databricks - **Published:** September 4, 2026 - **Apply:** https://startup.jobs/senior-software-engineer-data-infrastructure-decagon-8028815 ## About the Role * 5+ years building and operating production data infrastructure at scale. * Hands-on experience with Tier 1 data technologies: ClickHouse, Kafka (or MSK/Pub-Sub/RabbitMQ), and Flink or dbt. * Proven track record meeting high availability and low latency targets across streaming and batch workloads. * Excellent observability chops (OpenTelemetry, Prometheus/Grafana, Datadog) and strong incident response discipline. * Clear written communication and the ability to turn ambiguous data requirements into simple, reliable designs. Even better if you have * Experience with CDC tooling (Debezium) and orchestration frameworks (Airflow, Dagster, or Prefect) * Familiarity with Spark or Dask for large-scale data processing * Experience with cloud data warehouses (Snowflake, BigQuery, Redshift, Databricks) * Experience being an early data/platform/infrastructure engineer at another company * Strong Kubernetes experience (GKE/EKS/AKS) and multi-cloud exposure (GCP, AWS, Azure) * Experience with customer-managed deployments ## Description The Infrastructure team builds and operates the foundations that power Decagon: networking, data, ML serving, developer platform, and real-time voice. We partner closely with product, data, and ML to deliver high-scale, low-latency systems with clear SLOs and great developer ergonomics. We organize around four focus areas: * Core Infra: The foundational cloud stack-networking, compute, storage, security, and infrastructure-as-code-to ensure reliability, scale, and cost efficiency. * Data Infra: Streaming/batch data platforms powering analytics/BI and customer-facing telemetry, including for customer-managed and on-prem environments. * ML Infra: GPU and model-serving platforms for LLM inference with multi-provider routing and support for on-prem/air-gapped deployments. * Platform (DevEx): CI/CD, paved paths, and core services that make shipping fast, safe, and consistent across teams. Our mission is to deliver magical support experiences - AI agents working alongside humans to resolve issues quickly and accurately., We're hiring a Senior Data Infrastructure Engineer to design, build, and operate the data systems that power Decagon's AI products. You'll own critical data pipelines and storage layers end-to-end, improve reliability and performance, and create paved paths that let every Decagon engineer work confidently with data at scale. In this role, you will * Design and implement high-throughput data pipelines and streaming systems with strong SLOs, clear runbooks, and actionable telemetry. * Build and operate real-time and batch ingestion infrastructure using tools like Kafka, Flink, and Airflow. * Own our analytical data layer - schema design, query performance, and cost optimization across ClickHouse, BigQuery, or similar. * Partner with research and product teams to architect data solutions, evaluate performance, and scale new features. * Tune pipeline and query latencies: optimize data paths, apply smart caching/partitioning, and hit tight p95/p99 targets. * Lead infrastructure-as-code (Terraform) and GitOps practices for data systems; reduce drift with reusable modules and policy-as-code. * Participate in on-call and drive down toil through automation and elimination of recurring data issues. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [5 steps for running a Kubernetes environment at scale](https://www.wearedevelopers.com/videos/88-5-steps-for-running-a-kubernetes-environment-at-scale) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) - [All your telemetry data from any source in one place](https://www.wearedevelopers.com/videos/57-all-your-telemetry-data-from-any-source-in-one-place) - [How building an industry DBMS differs from building a research one](https://www.wearedevelopers.com/videos/768-how-building-an-industry-dbms-differs-from-building-a-research-one) ## Related Articles - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Dev Digest 139 - Soft and hard queries](https://www.wearedevelopers.com/magazine/487-dev-digest-139-soft-and-hard-queries) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)