> Markdown version of [/jobs/ext/4746573-data-engineer](https://www.wearedevelopers.com/jobs/ext/4746573-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** RAIN, Inc - **Location:** New York, NY, United States (Remote available) - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Sql Data Warehouse, Application Programming Interfaces (APIs), Artificial Intelligence, Airflow, Data Analysis, BigQuery, Databases, Data Deduplication, Data Systems, Software Debugging, Data Flow Control, Python (Programming Language), Operational Databases, Blockchain, Standard Sql, Data Streaming, File Transfer Protocol (FTP), Snowflake, Backend, Debezium, Apache Flink, Apache Kafka, Vertica, Data Pipelines - **Published:** November 16, 2026 - **Apply:** https://www.adzuna.com/details/5966053741 ## About the Role * At least 3 years building production data solutions, including owning both batch and streaming pipelines end to end, from source to warehouse. * Experience designing data solutions at scale. * Strong SQL and Python / Rust, plus experience with a cloud data warehouse such as BigQuery, ClickHouse, or Snowflake and an understanding of their trade-offs. * Streaming experience with tools such as Pub/Sub, Kafka, Dataflow/Beam, or Flink. * Batch experience with dbt and an orchestrator such as Dagster or Airflow. * Experience with production data quality testing, monitoring, and reconciliation. * Ability to debug across the source database, pipeline, warehouse, and report. * Ability to use AI tools to learn and work faster while checking their output. Nice to have * Building offline and real-time ML feature pipelines, such as fraud or risk features. * Working with payments, banking, or blockchain data, including EVM or Solana events and indexers. * Using CDC and ingestion tools such as Datastream, Debezium, Meltano, Fivetran, or Airbyte. * Experience with GCP. Things that enable a fulfilling, healthy and happy experience at Rain ## Description Rain builds payments and stablecoin infrastructure. Finance, Risk, Compliance, and our partners rely on data from card transactions, settlements, ledger entries, and onchain transfers., We're looking for a Data Engineer with batch and streaming experience to bring this data into our warehouse and keep it correct. You'll build scalable, idempotent pipelines that handle late and duplicate data and alert us when something breaks. At Rain, everyone models data, writes production-quality code, and automates their own workflows. We use AI to speed up repetitive work, but we own and check the results. In this role, you'll automate ingestion and quality checks so new sources come online quickly and stay trustworthy. What you'll do * Build scalable batch and streaming pipelines, choosing the right approach for latency, cost, and correctness. * Process events near real time, handling deduplication, windowing, and late or out-of-order events. * Own batch ingestion from databases (CDC), files (SFTP and GCS), APIs, and onchain sources. * Build incremental dbt models that handle late data, duplicates, CDC deletes, and backfills; reconcile streaming and batch outputs. * Orchestrate pipelines in Dagster with sensors, schedules, and alerts. * Add freshness, volume, and reconciliation checks to every source, and fix root causes. * Work with backend pods on event and table contracts to prevent downstream breakage. * Partner with Analytics Engineers, Data Scientists, and Risk on their data needs, including ML features.