> Markdown version of [/jobs/ext/3736251-staff-software-engineer](https://www.wearedevelopers.com/jobs/ext/3736251-staff-software-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Staff Software Engineer - **Company:** The Trade Desk - **Location:** United States - **Experience:** Expert - **Salary:** $137,300.0 - $251,800.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Microsoft Azure, Big Data, Cloud Computing, Databases, Computer Engineering, Data as a Services, Data Validation, Information Engineering, Data Governance, Data Infrastructure, Data Warehousing, Distributed Systems, Python (Programming Language), NoSQL, Recommender Systems, Search Technologies, Software Engineering, Data Processing, Data Storage Management, Snowflake, Apache Spark, Backend, Data Strategy, Containerization, Kubernetes, Information Technology, Integration Frameworks, Apache Kafka, Machine Learning Operations, Vertica, Data Pipelines, Databricks, Programming Languages - **Published:** October 14, 2026 - **Apply:** https://diversityjobs.com/career/18629145/Staff-Software-Engineer-New-York-Bellevue ## About the Role * Extensive experience with data warehousing solutions like Vertica, Snowflake, or Databricks to support large-scale data operations. * Strong knowledge of data governance and data quality frameworks to ensure accuracy, consistency, and compliance in data pipelines. * Hands-on experience with machine learning pipelines and MLOps, particularly in personalization, content recommendations, ad-tech solutions, or e-commerce optimization within streaming or TVOS platforms. * Expertise in content metadata processing and management, ideally within a streaming, TVOS, or e-commerce environment. * Familiarity with entertainment catalog systems, taxonomy structures, and content discovery workflows. * Prior work on recommendation systems or search technologies, enhancing user experiences through AI-driven content surfacing. * Strong ability to communicate effectively across technical and non-technical stakeholders, ensuring alignment on data strategies and priorities. * A solid foundation in computer science and engineering fundamentals, enabling you to design scalable, high-performance systems. * Deep experience with distributed systems and data processing frameworks, working with large-scale datasets in a high-traffic environment. * Proficiency in one or more programming languages such as Java, Scala, or Python for building and maintaining robust data pipelines. * Strong expertise in big data technologies such as Apache Spark, Kafka, and other scalable data processing tools. * Solid understanding of data modeling concepts and experience with both relational and NoSQL database systems. * Hands-on experience with cloud platforms like AWS, GCP, or Azure, and containerization technologies such as Kubernetes. * Proven ability to lead and complete projects with high levels of technical ambiguity while mentoring and contributing to the growth of peers. * 7+ years of software development experience, with at least 5 years specializing in data engineering or pipeline development. * A Bachelor's or Master's degree in Computer Science, Engineering, or a related field, or equivalent industry experience. ## Description This role is ideal for someone passionate about streaming, TVOS, or e-commerce data ecosystems, who thrives in high-scale, data-intensive environments and enjoys solving complex technical challenges. If you're looking to shape the future of personalized content delivery and consumer experiences, please read on - we'd love to hear from you! In addition to the core responsibilities of our backend engineers, you will specifically: * Be part of a nimble, innovative team where engineering drives the vision. If you're excited about building the future of CTV, we'd love to hear from you. * Design, build, and maintain data pipelines for processing content catalog data using technologies like Apache Spark for the Ventura OS project * Develop efficient data processing workflows that can handle large-scale data with optimal performance * Create robust APIs that securely expose data services to other parts of our platform * Collaborate with data scientists to integrate with their models and algorithms in production environments * Build scalable data integration solutions that connect various data sources and destinations * Implement monitoring and observability for data pipelines to ensure reliability and performance * Optimize data storage and retrieval mechanisms for our specific use cases * Contribute to architectural decisions around data infrastructure * Work closely with cross-functional teams to understand business requirements and translate them into technical solutions * Apply best practices for data engineering, including data quality checks, error handling, and recovery mechanisms WHO YOU ARE: One of the best things about being a software engineer at The Trade Desk is the variety of technical opportunities available. We don't expect you to know every technology we use from day one-what matters most is your ability to learn quickly and solve complex problems using the best tools for the job. What you know is less important than how well you adapt, innovate, and think critically. We're not looking for engineers who have all the answers-we need engineers who can invent answers no one has thought of yet and solve problems that haven't even been defined. Our culture goes beyond just having fun together (though we do that well, too). We take pride in being trust-builders, generous givers, scrappy problem solvers, and relentless pursuers of excellence. You don't have to meet every requirement below, but if you check most of these boxes, you're likely to thrive in this role.