> Markdown version of [/jobs/ext/1850444-telecommute-director-of-data-engineering](https://www.wearedevelopers.com/jobs/ext/1850444-telecommute-director-of-data-engineering). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # TELECOMMUTE Director of Data Engineering - **Company:** Red Ventures - **Location:** United States (Remote available) - **Salary:** $190,000.0 - $240,000.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Amazon Web Services, Amazon S3, Big Data, Computer Programming, Data as a Services, Information Engineering, Data Files, Data Infrastructure, Extract Transform Load (ETL), Relational Databases, Distributed Computing Environment, Distributed Systems, Amazon DynamoDB, Python (Programming Language), PostgreSQL, Microsoft SQL Server, MySQL, Oracle (Applications), Performance Tuning, Raw Data, Software Engineering, SQL Databases, Data Processing, Apache Spark, Ansi Sql, Spark Streaming, Functional Programming, Data Pipelines, Databricks - **Published:** July 21, 2026 - **Apply:** https://www.dice.com/job-detail/57e4896d-758e-42c1-abcf-eae5ffd00638 ## About the Role * 8-10 years of data or software engineering experience, including 5+ years managing engineering teams and at least 1 year managing managers * Track record of communicating technical strategy and tradeoffs clearly to non-technical executives, and building trust quickly with cross-functional peers * Deep curiosity about the systems and processes that produce our data, with enough understanding of the source to help your team strengthen and troubleshoot pipelines rather than treating data as a black box * Track record of leading engineering teams in an agile environment, coaching both engineers and managers, and giving teams enough context to operate independently * Deep hands-on experience building large-scale Spark applications for batch and streaming workloads * Experience with modern lakehouse platforms (Databricks or similar) in addition to traditional Spark-based pipelines * Expertise with the Spark RDD and DataFrame/Dataset APIs, with emphasis on DataFrames, for querying and data manipulation * Experience with Spark Structured Streaming and SparkSQL, including broadcast joins * Strong programming background in Python and/or Scala, with SQL fluency across large-scale datasets * Hands-on experience with AWS data services (Kinesis, S3, Lambda, DynamoDB) * Experience with ANSI SQL relational databases (Oracle, SQL Server, Postgres, MySQL) * Strong grounding in distributed systems and distributed data processing frameworks ## Description You'll lead the team that builds and scales Red Ventures' data infrastructure, using Databricks, Spark, and our proprietary platforms to move data across the business and turn raw data into the analytics we run on. As a Director who stays close to the technical details, you'll set multi-year direction and grow a team of engineers and engineering managers, while making sure your team has the context and guidance to move fast on their own. Our data team exists to make data easy to use for everyone, and this role owns how we get there, in close partnership with the business leaders who depend on that data. What You'll Do * Lead a team of data engineers and engineering managers building large-scale, real-time data pipelines in Spark * Act as the primary technical liaison to business leadership, translating trade-offs between technology and business priorities in both directions * Set the multi-year technical direction for Data Engineering and communicate that strategy across both technical and business audiences * Partner with data scientists, analysts, and business stakeholders to turn business requirements into data products the team builds against * Represent Data Engineering in cross-functional and executive planning, building alignment across engineering, product, and business leaders * Set the architectural direction and standards for how data moves across platforms, from streaming ingestion through ETL to aggregation and analytics, hold your managers and teams accountable to that direction, and establish the engineering and agile practices that support delivery speed and quality * Stay close to the technical details to guide architecture design decisions, performance tuning, and tradeoff calls, and to give your team the context they need to move quickly without waiting on you * Work with your teams and the RV Data Platform team to design scalable solutions across distributed systems using AWS, Databricks, and modern big data technologies * Champion a governance-first mindset across your team, making sure the way we collect, move, and use data protects the privacy of the people behind it * Manage and develop the data engineering managers on your team, setting the bar for how they coach, hire, and run their teams * Own career development across your org, building growth paths for individual contributors and managers alike, and coaching through regular, direct feedback * Hold the team accountable for delivering high-quality, scalable solutions across the full data lifecycle ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Remote Driving on Plant Grounds with State-of-the-Art Cloud Technologies](https://www.wearedevelopers.com/videos/251-remote-driving-on-plant-grounds-with-state-of-the-art-cloud-technologies) - [Cloud Vendor Lock-In - Is it just a new version of the Database Abstraction Layers?](https://www.wearedevelopers.com/videos/1185-cloud-vendor-lock-in-is-it-just-a-new-version-of-the-database-abstraction-layers) - [MySQL Protocol Features You Should Be Aware Of](https://www.wearedevelopers.com/videos/100267-mysql-protocol-features-you-should-be-aware-of) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Implementing continuous delivery in a data processing pipeline](https://www.wearedevelopers.com/videos/73-implementing-continuous-delivery-in-a-data-processing-pipeline) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Best Paying Remote Jobs](https://www.wearedevelopers.com/magazine/255-best-paying-remote-jobs) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)