> Markdown version of [/jobs/ext/2166097-data-engineer](https://www.wearedevelopers.com/jobs/ext/2166097-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Railroad19, Inc. - **Location:** Saratoga Springs, NY, United States (Remote available) - **Experience:** Expert - **Salary:** $120,000.0 - $180,000.0 - **Contract:** Permanent contract - **Skills:** Apache HTTP Server, BigQuery, Software Quality, Data Hub, Data Sharing, Python (Programming Language), Role-Based Access Control, Software Engineering, Software Systems, Data Ingestion, Snowflake, Apache Spark, Data Lakes, Data Lineage, Apache Kafka, Databricks - **Published:** August 21, 2026 - **Apply:** https://www.workingnomads.com/job/go/1805578/ ## About the Role * 6+ years of proven enterprise-level experience in Python & Spark * Advanced experience in GCP BigQuery * Strong working knowledge of Apache Iceberg, Delta Lake, Iceberg UniForm * Experience with Delta Sharing; Kafka / CDC pipelines * Specific work experience in Snowflake Horizon Catalog; Databricks Unity Catalog * Solid experience with Data lake architecture & ingestion pipeline design * Excellent Communication skills and the ability to work cohesively with multiple teams. Preferred Experience - Nice to Have * Prior delivery in enterprise SaaS, media, or advertising technology. * Active daily use of AI-assisted development tools (Claude Code preferred). ## Description Railroad19, Inc is seeking a Senior Data Engineer with deep, hands-on experience in building modern lakehouse architectures on GCP. This role focuses on designing, developing in Python & Spark, and delivering reusable data-sharing adapters that connect BigQuery-backed data products to Snowflake and Databricks using Iceberg UniForm and Delta Sharing. About Railroad19: At Railroad19, Inc, we develop customized software solutions and provide software development services. We're a specialized team of developers and architects. As such, we only bring an "A" team to the table, through hard work and a desire to lead the industry - this is our company culture - this is what sets Railroad19 apart., * Design and implement the UniForm write layer (Delta + Iceberg dual metadata). * Build GCS * BigQuery ingestion pipelines for structured operational datasets. * Develop and implement in Python and Spark. * Implement Kafka-based CDC patterns for real-time and near-real-time ingestion. * Develop data lineage, dependency tracking, and modular adapter code. * Configure Snowflake Horizon external tables for zero-copy reads. * All data hub tables are to be written once using Delta Lake with Iceberg UniForm enabled… readable by all target consumers without conversion. * Implement and certify Delta Sharing endpoints for Databricks consumers. * Build governed access layer components: RBAC, connector registry entries, tenant-scoped authorization. * Align semantic layer models with LookML and KPI catalog definitions. * Collaborate with cross-functional teams to deliver end-to-end features. * Troubleshoot issues across the full stack and contribute to code quality. ## Related Videos - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [PoC “Austria Experience Data Hub”](https://www.wearedevelopers.com/videos/92-poc-austria-experience-data-hub) - [How Cisco embraced a DevOps culture within its network engineering team](https://www.wearedevelopers.com/videos/99-how-cisco-embraced-a-devops-culture-within-its-network-engineering-team) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)