Senior ML Data Processing Developer

LawZero
Berlin, Germany
1 day ago
Apply on startup.jobs
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Airflow Data Deduplication Data Governance Distributed Computing Environment Python (Programming Language) Machine Learning Natural Language Processing Software Engineering Management of Software Versions Data Processing Large Language Models
+10 more
Apache Spark Kubernetes Infrastructure Automation Frameworks Information Technology Apache Flink SGLang Machine Learning Operations Model Inference Data Pipelines Docker

Job description

  • Partner with the Research team to define, build, automate, scale, and manage data pipelines that transform raw web-scale data into training datasets for the Scientist AI.
  • Build and maintain data processing pipelines, including deduplication, model-based quality scoring, heuristic filtering, toxicity removal, PII scrubbing, metadata extraction, and proprietary data transformations, with full dataset versioning and provenance tracking, optimizing for throughput and cost at scale.
  • Ensure all ingested data meets compliance requirements, internal Data Governance policies, and legal obligations.
  • Develop and refine the scoring and filtering toolchain: heuristics, LLM-as-a-judge evaluators, ML classifiers, metadata extraction modules, and human-in-the-loop review workflows required for data processing and quality assurance.
  • Instrument data processing pipelines with data-quality monitoring, guardrails, and alerting to catch regressions before they propagate downstream.
  • Collaborate with the Research team and other teams to understand evolving data requirements, then identify and acquire large-scale text corpora that meet those requirements. This includes conducting systematic coverage analyses to identify gaps in the corpus and develop targeted acquisition strategies to address them, and working with the Legal & Governance Team to license new data sources.
  • Design and maintain strict leakage detection mechanisms to guard against evaluation contamination across all stages of the data processing pipeline.
  • Build internal tooling and interfaces that let researchers explore, query, and understand available datasets with minimal friction.

Requirements

  • Degree in computer science, software engineering, or a related field.
  • Proven track record of handling massive unstructured text datasets (trillion-token scale), with 5+ years of experience in data processing, machine learning engineering or Natural Language Processing (NLP).
  • Hands-on experience with distributed processing frameworks (e.g., Spark, Ray, Flink), designing and optimizing high-throughput pipelines.
  • Experience with data privacy implementation (PII scrubbing), content-safety filtering (toxicity, bias), and evaluation-contamination prevention.
  • Demonstrated ability to work across Research, Engineering, and/or Legal/Governance teams, translating varied requirements into concrete pipeline work.
  • Strong Python proficiency, including experience writing production-grade data-processing code.
  • Experience with pipeline orchestration frameworks (e.g., Airflow, Prefect, Dagster)., * Experience training, fine-tuning, or deploying ML models for data-quality tasks (classifiers, LLM-based evaluators) and familiarity with LLM inference optimization (e.g. vLLM, SGLang).
  • Familiarity with containerized deployment (Docker, Kubernetes) and infrastructure-as-code practices.
  • Familiarity with ML experiment tracking tools (e.g. Weights and Biases).
  • Experience with data licensing workflows or web-scale data acquisition.
  • Contributions to open-source data processing or NLP tooling.

About the company

In this role, you will not just manage data; you will engineer its quality. You will design algorithmic filtering, build model-based scoring mechanics, and ensure rigorous benchmark integrity to power the next generation of AI. And as our models push beyond established paradigms, you will design and implement novel data transformations that don’t yet have playbooks, working at the frontier of what training data can be., LawZero is a non-profit organization committed to advancing research and creating technical solutions that enable safe-by-design AI systems. Its scientific direction is based on new research and methods proposed by Professor Yoshua Bengio, the most cited AI researcher in the world. Based in Montreal, LawZero’s research aims to build AI that learns primarily to understand the world rather than to act in it, giving truthful answers to questions based on transparent and externalized probabilistic reasoning. Such AI systems could be used to accelerate scientific discovery, to provide oversight for agentic AI systems, and to advance the understanding of AI risks and how to avoid them. LawZero believes that AI should be cultivated as a global public good-developed and used safely towards human flourishing. For more information, visit www.lawzero.org

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on startup.jobs
Prepare application

Good distractions

Loading talks and stories from around this role…