> Markdown version of [/jobs/ext/4743990-data-platform-engineer](https://www.wearedevelopers.com/jobs/ext/4743990-data-platform-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Platform Engineer - **Company:** RAIN, Inc - **Location:** New York, NY, United States (Remote available) - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Training Data, Artificial Intelligence, Airflow, Amazon Web Services, Data Analysis, Audit Trail, Microsoft Azure, BigQuery, Cloud Database, Continuous Integration, Data Governance, Data Infrastructure, Data Flow Control, Identity and Access Management, Python (Programming Language), Metadata Repositories, Azure Machine Learning, SQL Databases, Data Streaming, Feature Store, Business Intelligence Development Studio, System Availability, Snowflake, Backend, Build Management, Debezium, Apache Flink, Apache Kafka, Data Management, Machine Learning Operations, Vertica, Terraform - **Published:** November 16, 2026 - **Apply:** https://www.adzuna.com/details/5966053740 ## About the Role * At least 4 years building and running data platforms in production on a cloud provider such as GCP, AWS, or Azure, in both batch and streaming: you have operated infrastructure for each, not only one. * Experience designing data platforms at scale: storage and compute choices, multi-team access, reliability, and cost. * Experience operating cloud data warehouses and real-time stores such as BigQuery and ClickHouse. * Experience operating streaming infrastructure such as Pub/Sub, Kafka, Dataflow, or Flink, including retention, schema evolution, replay, and lag monitoring. * Experience operating batch infrastructure: orchestration (Dagster or Airflow), CI/CD, and environments. * Infrastructure as code with Terraform. * Experience with access control and data governance, such as IAM, column- or row-level security, and PII handling. * Strong Python and SQL. * Proficiency using AI tools to learn new skills and accelerate your work, while taking responsibility for checking the output. Nice to have * ML infrastructure experience, such as feature stores, Vertex AI, or model serving. * Experience in regulated environments such as payments, banking, PCI, or SOC 2. * Experience with data catalogs and lineage tools. * Experience with cost optimization in BigQuery, ClickHouse, or Snowflake. * Experience with CDC tools such as Datastream or Debezium. ## Description Rain is building payments and stablecoin infrastructure, and our data platform holds some of the most sensitive data a company can have: cardholder, ledger, and partner data across many countries., We're looking for a Data Platform Engineer who has built and run data platforms for both batch and streaming to own the platform our data team and engineering pods depend on: the warehouse, streaming infrastructure, orchestration, BI, ML platform, access controls, and the tooling that makes all of it safe, reliable, and cost-efficient. Your product is the platform, and your customers are the engineers, analysts, and scientists who build on it. You'll own the platform layer: the data and ML platform, the infrastructure for ingestion and processing in batch and streaming, data governance and security compliance, the warehouse, and the analytics and BI tooling. Data Engineers, Analytics Engineers, Data Scientists, and engineering pods build on it to run experiments, operate reliably, and turn data into decisions. At Rain, we're builders who use AI to automate repetitive work. That changes what data roles look like: where a data scientist used to only analyze and an analyst used to only build dashboards, here everyone models data, writes production-quality code, and automates their own workflows. You own the result, including checking what the AI produces. For this role, that means automating access, deploys, and governance so the platform runs itself and stays compliant. What you'll do * Design and build data platforms at scale for both batch and streaming, choosing storage, compute, and processing based on latency, cost, and reliability needs. * Own the infrastructure for BigQuery, streaming (such as Pub/Sub or Kafka, and Dataflow or Flink), Dagster+, and Lightdash as code, including environments, CI/CD, and deploys. * Own access and governance: IAM, policy tags, PII contracts, masked and no-PII access paths, and audit logs, across tables and streams. * Provide ML platform capabilities: feature pipelines, training data, and serving real-time features to fraud and risk models. * Build platform tooling: templates, CI checks, schema registry and data contracts, catalog, and lineage. * Monitor platform reliability, latency, and cost, and fix what is slow or expensive. * Design how backend events and CDC land in the warehouse, and advise backend pods on event design. * Respond to platform incidents and access requests, and automate the repetitive ones away.