> Markdown version of [/jobs/ext/4657386-engineering-manager-big-data-job-understanding](https://www.wearedevelopers.com/jobs/ext/4657386-engineering-manager-big-data-job-understanding). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Engineering Manager, Big Data, Job Understanding

- **Company:** ZipRecruiter, Inc.
- **Location:** Los Angeles, CA, United States
- **Experience:** Experienced
- **Salary:** $200,000 - $265,000
- **Contract:** Permanent contract
- **Skills:** Geographic Information Systems, Amazon Web Services, Microsoft Azure, Big Data, Cloud Computing, Data Files, Data Integration, Data Structures, Data Stores, Fraud Prevention and Detection, Apache Hadoop, Apache HBase, Apache Hive, Machine Learning, Software Engineering, Google Cloud, Data Storage Technologies, Large Language Models, Apache Spark, Backend, Containerization, Data Lakes, Core Data, Apache Flink, Apache Kafka, Data Management, User Generated Content, Machine Learning Operations, Video Streaming, Software Coding, Data Pipelines, Docker
- **Published:** November 10, 2026
- **Apply:** https://www.juju.com/job/16_247f7ed2

## About the Role

* 5+ years of professional software development experience.
 * 2+ years of experience as a software engineering leader
 * Deep experience with modern big data frameworks (e.g. Spark, Hadoop, Hive).
 * Streaming technologies (Kafka, Flink, Beam).
 * Strong CS fundamentals (data structures, algorithms) and coding skills.
 * Experience with containerization technologies like Docker and Kubernetes.
 * Experience working on a B2C or B2B Product
 * This role is for engineers who are talking with their Product Managers about problems to solve and turning them into engineering solutions. They are naturally curious, problem solvers, and deeply understand the product they work on.
 * Must have experience dealing with messy/unreliable data (third party data sets, data integrations, migrations)

Preferred Qualifications:

 * Cloud platforms (GCP, AWS, Azure).
 * Modern data storage solutions (Delta Lake, HBase, Hudi).
 * Scala

## Description

* Jobs Corpus Understanding: ZipRecruiter takes in millions of job postings from employers, partners, and feeds. We own the ingestion and enrichment pipelines that turn raw postings into structured data. We use ML classifiers to infer job attributes like education requirements and pay, and we attach company and location data. We find and suppress fraudulent listings or terms of use violations, so the marketplace stays safe and worth using. The result is a canonical view of every job that recommendations, search, and employer products build on.
 * Foundational Models and Embeddings: At the core of ZipRecruiter's matching ecosystem are models that encode everything we can learn about jobs and job seekers. We build LLM-based embedding models from job content, resumes, and behavioral signals. These are the building blocks for matching and other ML models across the company, and we serve them at scale online and in batch.
 * Matching Engines: We are responsible for the ML systems that recommend jobs to job seekers and job seekers to employers across our app, website, and email. The engines cover large-scale candidate retrieval over vector DBs and orchestration that delivers fresh, personalized recommendations.

About the Job:

ZipRecruiter's Recommendation Ecosystem Group provides the backend machine learning and data platforms that connect job seekers to the right jobs. Within this group, the Job Understanding team is the authoritative source for foundational job data, pipelines, and matching intelligence.

We are seeking an Engineering Manager to lead an experienced, high-impact engineering team. In this role, you will guide the team in modernizing core data pipelines, storage solutions, and access methods while enhancing data quality and security systems.

 * Lead, mentor, and unblock a senior team of 5 engineers responsible for core job ingestion pipelines and data stores.
 * Drive the rebuild of the job ingestion pipeline and refine how job data is exposed to consuming engineering teams.
 * Prioritize initiatives that improve underlying input data quality and handle low-structure, user-generated content.
 * Own and lead improvements to fraud detection and blocking mechanisms.
 * Partner closely with other Engineering stakeholders, Data Scientists, and a dedicated Product Manager to balance requests and roadmap priorities.
 * Ensure we can act on everything we learn about jobs in a scalable real time manner. Scale our data pipelines both for performance and maintainability so we can be ambitious about what data we collect and where we can personalize the job seeker experience.