> Markdown version of [/jobs/ext/2716780-data-engineer](https://www.wearedevelopers.com/jobs/ext/2716780-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** The Wheelhouse LLC - **Location:** United States (Remote available) - **Experience:** Expert - **Salary:** $156,000.0 - **Contract:** Permanent contract - **Skills:** Amazon Web Services, Big Data, Software as a Service, Computer Programming, Databases, Continuous Integration, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Data Synchronization, Relational Databases, Database Queries, DevOps, Distributed Systems, Python (Programming Language), PostgreSQL, Ruby on Rails, Cloud Services, Ruby, Datadog, Data Processing, Data Ingestion, Indexer, Cloudformation, Build Management, Amazon Relational Database Service, AWS Aurora, Infrastructure Automation Frameworks, Celery, Terraform, Data Pipelines - **Published:** September 4, 2026 - **Apply:** https://startup.jobs/senior-data-engineer-wheelhouse-7987118 ## About the Role * 5+ years of Data Engineering or Backend Engineering experience, specifically dealing with massive, high-velocity datasets (multi-TB scale) and 10+ years overall engineering experience at technology companies. * Deep database expertise: Advanced knowledge of relational databases, specifically PostgreSQL and AWS Aurora. You must know how to tune databases, optimize complex queries, and manage large-scale indexing. * Strong programming skills: Proficiency in Ruby and Ruby on Rails (or a strong willingness to learn, backed by expert-level experience in a similar language like Python) to navigate our core stack. * Job Orchestration: Experience with background processing frameworks at scale (Resque, Sidekiq, Celery, or similar). * DevOps & Cloud: Hands-on experience with AWS cloud services, infrastructure provisioning (Terraform/CloudFormation), and CI/CD pipelines. * Data Modeling: Strong ability to design data models that balance fast ingestion with efficient application querying. * Problem Solver: A track record of identifying performance bottlenecks in complex distributed systems and implementing elegant solutions. * Remote DNA: Demonstrated ability to work autonomously, communicate asynchronously, and manage your own "healthy hustle." ## Description We are looking for a Senior Data Engineer to take ownership of this massive daily ingestion engine. Working within a Ruby on Rails and Resque environment, backed by AWS RDS Postgres and Aurora as well as Athena, you will ensure our data pipelines are robust, scalable, and highly optimized. You will not only supervise and improve our existing daily ingestion but also design systems to integrate new data sources and seamlessly deliver this data to our core application. Your mission is to guarantee the reliability, speed, and scale of our data infrastructure. You will be the technical guardian of our multi-terabyte dataset, ensuring that as we grow to track even more listings and add new data sources, our ingestion engine scales gracefully and cost-effectively without missing a beat. Our revenue management algorithms rely entirely on the daily calendar sync of these 14 million listings to price our clients' properties accurately. If our data pipelines slow down or fail, our core product cannot function. We're looking for someone who: Works independently and takes ownership: You don't wait to be told what to optimize. You treat the data infrastructure as your own product, proactively identifying areas for improvement and driving them to completion. Thinks in systems: You understand that scaling isn't just about writing faster code; it's about how Resque, PostgreSQL, and our AWS infrastructure interact. You see the big picture and understand the cascading effects of your changes. Stays calm under pressure: Because this daily data sync is our lifeblood, pipeline hiccups are critical. You can troubleshoot complex, multi-terabyte issues methodically and keep a cool head when the pressure is on. Communicates technical concepts clearly: You can easily translate complex data engineering constraints and architecture decisions into plain language for the wider engineering and product teams. Values pragmatism over perfection: You know when to invest in an elegant, long-term architectural solution, and when the business just needs a robust, practical fix to keep the daily sync running smoothly. Is obsessed with observability: You believe a system isn't finished until it's properly monitored. You build alerts and dashboards to catch anomalies and bottlenecks before they ever impact our clients. Is super detail oriented: You intrinsically see that certain data problems can be needles in haystacks and you are process driven to build safeguards to flag the vast majority of issues before our customers notice the same. What you'll be doing * Architect, optimize, and supervise the daily ingestion pipelines that process calendar data for 14+ million listings. * Tune and scale our AWS RDS PostgreSQL and Aurora databases to handle extreme high-throughput read/write operations and multi-TB storage. * Optimize background job orchestration to ensure timely and efficient data processing. * Design and build robust ETL processes to integrate new, complex data sources into our ecosystem. * Collaborate with application engineers to make diverse versions and aggregations of our data easily accessible to the core application. * Apply DevOps best practices to maintain and improve our AWS infrastructure, CI/CD pipelines, and infrastructure-as-code. * Build comprehensive monitoring, alerting, and observability tooling to catch data bottlenecks before they impact the business., * Own the big data pipelines in a fast-growing SaaS company. * Directly improve the reliability and usability of our product. * Enjoy the power to shape your own projects and help set the direction for new development. * Collaborative, small-team environment where your impact is highly visible ## Related Videos - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [Celery on AWS ECS - the art of background tasks & continuous deployment](https://www.wearedevelopers.com/videos/561-celery-on-aws-ecs-the-art-of-background-tasks-continuous-deployment) - [Coffee with Developers: David Heinemeier Hansson](https://www.wearedevelopers.com/videos/875-coffee-with-developers-david-heinemeier-hansson) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Fireside Chat with Werner Vogels, VP & CTO, Amazon.com & Daniel Gebler, CTO at Picnic](https://www.wearedevelopers.com/videos/1405-fireside-chat-with-werner-vogels-vp-cto-amazon-com-daniel-gebler-cto-at-picnic) - [Walking into the era of Supply Chain Risks](https://www.wearedevelopers.com/videos/376-walking-into-the-era-of-supply-chain-risks) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)