Data Engineer II

You will join the Innovative Services Group (part of the wider Audience team). Innovative services build solutions across the Audience group (and beyond) that are leveraged by other teams. Examples include probabilistic services able to handle over 500k requests a second, and optimising how compute is deployed in our data pipelines yielding very high cost savings across the teams.

The wider Audience team is responsible for managing and delivering the first and third-party data that powers all of the platforms that Magnite operates. We're a globally distributed team of software and data engineers who build and operate huge scale data pipelines and real-time scaled services to enable Magnite and Magnite's customers to reach their goals.

In this role, you will:

Note: given the seniority of this position, we don't expect you to be here on day one, but this is what you can expect to grow into.

This role is focused on the data engineering side of the team's responsibilities, and this job listing reflects that, but there is an opportunity to get involved more broadly.

• Build and optimize data pipelines using Apache Spark and Python, processing billions of events in both streaming and batch modes. We work at TB scale.
• Collaborate with senior data engineers to improve Magnite's Audience data pipelines by identifying and implementing innovative solutions.
• Own the operational performance of your builds, ensuring uptime and implementing recovery strategies.
• Collaborate with SRE teams to provision infrastructure using Terraform and AWS (future Kubernetes on-premise).
• Proactively identify and help solve impactful problems.

We're looking for someone with:

More than anything we expect you to love learning and see problems as things to overcome rather than blockers. You are part of a team that moves fast, makes incremental improvements towards a vision and solves problems other teams are struggling with., * Python, Golang, Rust, Java / Spring Boot

• ECS, Fargate, Kubernetes
• Spark, Databricks
• Luigi, Airflow
• Docker
• ALB, HAProxy
• RDS, MariaDB, Postgres
• Redis, Memcache
• Kafka, SNS, SQS
• Terraform, Github Actions, Jenkins
• JavaScript / TypeScript / React
• Linux (both on-premise and AWS), Magnite's culture is rooted in collaboration and connection, recognizing that both are essential to success. Our hybrid schedule includes two remote workdays (Monday and Friday) and three in-office days (Tuesday through Thursday), where employees can take advantage of catered lunches, beverages, snacks, training opportunities, and engaging office events that enhance the work experience. In addition, we support our team through meaningful benefits and programs, including community service and volunteer opportunities, company-matched charitable contributions, access to mental health resources, structured career development initiatives and growth frameworks, culture and inclusion programs, and our Bonusly peer-to-peer recognition platform.

Do you have experience in Public Cloud?, You should look at this list and our tech stack and think "wow i want to learn that", rather than being an expert. We expect you to have expertise with 1-2 items and familiarity with a couple more. Most candidates will have 2+ years of experience.

• Hands-on experience with Apache Spark (mainly PySpark). Ideally, you will have written a variety of pipelines that you have deployed in production.
• Strong Python skills, particularly in the context of Databricks and Spark.
• Data pipeline design knowledge, from sourcing event data to creating queryable data layers.
• Familiarity with event-based data architecture (e.g., Kafka).
• SQL experience for data analysis and transformations.
• Hands-on experience with AWS and Terraform for IaaS solutions.
• Experience writing Jenkins or Github actions pipelines to run build and integration actions.
• GoLang for distributed service development
• Kubernetes experience

Pulled from the full job description

• Employee stock purchase plan
• Parental leave
• Health insurance
• 401(k) matching
• Gym membership
• Life insurance
• Disability insurance, In the US East Coast (including NYC and Boston), the base salary range for this role is $120,000 - $135,000. Actual compensation will be determined based on location, experience, skills, and internal equity.

This role is also eligible for:

• Annual performance-based bonus
• Equity (NASDAQ: MGNI)
• Comprehensive benefits package

During the interview process, candidates will receive more specific information about the salary range applicable to their experience and location.

Perks and Benefits:

• Comprehensive Healthcare Coverage from Day One
• Generous Time Off
• Holiday Breaks and Quarterly Wellness Days
• Equity and Employee Stock Purchase Plan
• Family-Focused Benefits and Parental Leave
• 401k Retirement Savings Plan with Employer Match
• Disability and Life Insurance
• Cell Phone Subsidy
• Monthly Fitness and Reimbursement

Career Growth:

We support internal mobility, skill development, and leadership pathways through structured career frameworks and learning programs.

At Magnite, we cultivate an environment of continuous growth and collaboration. Our work impacts what millions of people read, watch, and buy, and we're looking for people to help us tackle that responsibility with creativity and focus. Magnite (NASDAQ: MGNI) is the world's largest independent sell-side advertising platform. Publishers use our technology to monetize their content across all screens and formats including CTV / streaming, online video, display, and audio. Our tech fuels billions of transactions per day!, The world's leading agencies and brands trust our platform to access brand-safe, high-quality ad inventory and execute billions of advertising transactions each month. Anchored in bustling New York City, sunny Los Angeles, mile-high Denver, historic London, and down under in Sydney, Magnite has offices across North America, EMEA, LATAM, and APAC. Magnite is an Equal Opportunity Employer and does not discriminate against applicants due to race, color, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, sexual orientation or any other federal, state or local protected class. Our Commitment: We aim to incorporate a wide range of voices into our Magnite culture, cultivating an environment where employees feel welcomed, cared for, and encouraged to freely share ideas. We are committed to employee growth, collaboration, inclusion, and innovation. We invest in Magnite's local communities. We seek talent from all backgrounds to champion corporate values of seeing the big picture and being catalysts of change.