Machine Learning Engineer III, Search Relevance
Role details
Job location
Tech stack
Job description
We're looking for a Machine Learning Engineer III to improve search quality end-to-end-signals, ranking, retrieval, and evaluation-while building scalable, low-latency services that serve queries in real time. You'll collaborate with senior engineers, Product, Data, and Infra partners to productionize modern retrieval techniques and experimentation frameworks that directly impact how millions of users work. WHAT YOU'LL DO
- Design, build, and iterate on components for ranking, retrieval, and recommendations that improve measurable relevance and latency.
- Implement production features leveraging embeddings, semantic/hybrid search, and LLM-enabled retrieval under mentorship and design guidance.
- Contribute to offline/online evaluation, A/B tests, and relevance tuning using metrics such as NDCG, MRR, and precision@k.
- Develop reliable, observable microservices and near real-time indexing pipelines across distributed systems.
- Own well-scoped projects from design to rollout, writing clear design docs, tests, and operational runbooks.
- Improve data and feature pipelines (batch/streaming) to ensure quality, freshness, and end-to-end performance.
- Document patterns and contribute to team best practices that raise the bar on code quality and reliability.
- Participate in our on-call rotation, available at all times while on-call to help respond to and triage any issues that arise., Box makes reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please complete this form. Reasonable accommodations may include scheduling adjustments, document dictation and beyond.
Notice to applicants in Los Angeles: Box, Inc and its related branches will consider for employment, qualified applicants with criminal histories in a manner consistent with the Los Angeles Fair Chair Ordinance. The Fair Chance Ordinance is provided here.
Notice to applicants in San Francisco: Box, Inc and its related branches will consider for employment, qualified applicants with criminal histories in a manner consistent with the San Francisco Fair Chair Ordinance. The Fair Chance Ordinance is provided here.
Requirements
- 3+ years of industry experience building backend or distributed systems, with production ownership of services or data pipelines.
- Proficient in at least one of: Java, Scala, C++, or Python; comfortable writing production-grade Python is a plus.
- Exposure to search, ranking, recommendations, or applied ML in production; understand the basics of training-to-serving workflows.
- Experience with data pipelines, message queues, or streaming systems (e.g., Kafka, Pub/Sub) and near real-time processing.
- Familiarity with cloud-native microservices, CI/CD, observability, and performance tuning.
- BS in Computer Science or related field, or equivalent practical experience.
- Pragmatic, metrics-driven mindset-eager to experiment, measure impact, and iterate quickly in collaboration with partners.
Preferred
- Experience with Elasticsearch, Solr, Lucene, or custom search systems; understanding of inverted indexes and scoring functions.
- Knowledge of relevance tuning, learning-to-rank concepts, and offline/online experimentation practices.
- Exposure to vector search, dense/sparse embeddings, and hybrid retrieval architectures.
- Familiarity with IR fundamentals (BM25, TF-IDF, multi-stage retrieval) and query understanding.
- Experience with Kubernetes/Terraform and a major cloud (GCP/AWS/Azure).
- Practical exposure to PyTorch or TensorFlow; LLM familiarity helpful but not required.
Box lives its values, with community and in-person collaboration being a core part of our culture. Boxers are expected to work from their assigned office a minimum of 3 days per week.Your Recruiter will share more about how we work and company culture during the hiring process.
Benefits & conditions
Box is committed to fair and equitable compensation practices. Actual base salary (or OTE if commissionable role) is dependent upon factors such as: knowledge, skill level, experience, and work location. This role is also eligible for equity and benefits. For more information, check out our benefits and perks.