Information Retrieval Engineer

Adobe Inc.
San Jose, United States of America
6 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
$ 234K

Job location

San Jose, United States of America

Tech stack

Artificial Intelligence
Airflow
Automated Storage and Retrieval Systems
Cloud Computing
Information Systems
Data Deduplication
Information Engineering
Elasticsearch
Graph Database
Information Retrieval
Python
Knowledge Management
Machine Learning
Neo4j
Search Technologies
Data Processing
Data Ingestion
Large Language Models
Generative AI
Indexer
Information Technology
HuggingFace
Performance Monitor
Machine Learning Operations
Software Version Control
Docker

Job description

We are seeking a highly skilled Information Retrieval Engineer to lead the development and optimization of retrieval systems that power context-aware large language models (LLMs). This role focuses on building robust Retrieval-Augmented Generation (RAG) pipelines to ensure AI agents and applications have access to the most relevant, timely, and high-quality information.

You'll work at the intersection of data engineering, machine learning, and knowledge management-enabling better reasoning, accuracy, and performance for enterprise-grade AI systems., RAG System Design:

  • Architect and deploy scalable retrieval pipelines using vector databases (e.g., FAISS, Weaviate, Pinecone, Qdrant)
  • Implement semantic search infrastructure and hybrid retrieval systems (semantic + keyword)

Data Processing & Ingestion:

  • Build ingestion pipelines for both structured and unstructured data sources
  • Implement document chunking strategies, embedding generation (e.g., OpenAI, Cohere, HuggingFace), and metadata tagging

Retrieval Optimization:

  • Fine-tune relevance scoring, reranking algorithms, and query understanding mechanisms
  • Develop techniques to improve precision/recall for specific business domains or user tasks

Knowledge Enhancement:

  • Create and maintain knowledge graphs to support context linking and disambiguation
  • Manage data freshness and version control to ensure consistency and reliability of retrieved content

Reasoning Support:

  • Design and iterate on context window strategies that improve LLM reasoning (e.g., adaptive injection, task-based retrieval)
  • Collaborate with prompt engineers and model developers to align retrieval outputs with downstream model behavior

Performance Monitoring:

  • Track key retrieval metrics such as accuracy, latency, and fallback rate
  • Implement caching, prefetching, and deduplication strategies to optimize system responsiveness, * High-recall, low-latency retrieval pipelines that enhance LLM outputs with accurate, relevant context
  • Modular, reusable RAG components that can be applied across use cases and domains
  • Continuous improvement of retrieval relevance and reasoning alignment through experimentation and monitoring
  • Strong collaboration with AI engineers, prompt engineers, and data owners to maintain data quality and user trust

Requirements

Required:

  • 4+ years in data engineering, ML infrastructure, or information retrieval
  • Experience building and deploying RAG pipelines or semantic search systems
  • Strong Python skills and familiarity with retrieval libraries (e.g., Haystack, LangChain, Elasticsearch, Milvus)
  • Proficiency with embedding models, vector similarity search, and document indexing
  • Familiarity with cloud platforms and MLOps tooling (e.g., Airflow, dbt, Docker)

Preferred:

  • Knowledge of graph databases (e.g., Neo4j, TigerGraph) or knowledge graph design
  • Experience optimizing retrieval for LLMs (e.g., OpenAI, Anthropic, Mistral)
  • Background in IR/NLP, Search Engineering, or Cognitive Computing
  • Bachelors or Masters Degree in Computer Science, Information Systems, or a related field

Benefits & conditions

Our compensation reflects the cost of labor across several U.S. geographic markets, and we pay differently based on those defined markets. The U.S. pay range for this positionis $125,600 -- $234,150 annually. Paywithin this range varies by work locationand may also depend on job-related knowledge, skills,and experience. Your recruiter can share more about the specific salary range for the job location during the hiring process.

In California, the pay range for this position is $161,700 - $234,150

At Adobe, for sales roles starting salaries are expressed as total target compensation (TTC = base + commission), and short-term incentives are in the form of sales commission plans. Non-sales roles starting salaries are expressed as base salary and short-term incentives are in the form of the Annual Incentive Plan (AIP).

In addition, certain roles may be eligible for long-term incentives in the form of a new hire equity award.

About the company

Adobe empowers everyone to create through innovative platforms and tools that unleash creativity, productivity and personalized customer experiences. Adobe's industry-leading offerings including Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud, Adobe Experience Platform, Adobe Experience Manager, and GenStudio enable people and businesses to turn ideas into impact, powered by AI and driven by human ingenuity. Our 30,000+ employees worldwide are creating the future and raising the bar as we drive the next decade of growth. We're on a mission to hire the very best and believe in creating a company culture where all employees are empowered to make an impact. At Adobe, we believe that great ideas can come from anywhere in the organization. The next big idea could be yours. Let's Adobe together At Adobe, we believe in creating a company culture where all employees are empowered to make an impact. Learn more about Adobe life, including our values and culture, focus on people, purpose and community, Adobe for All, comprehensive benefits programs, the stories we tell, the customers we serve, and how you can help us advance our mission of empowering everyone to create., At Adobe, we empower employees to innovate with AI - and we look for candidates eager to do the same. As part of the hiring experience, we provide clear guidance on where AI is encouraged during the process and where it's restricted during live interviews. See how we think about AI in the hiring experience.

Apply for this position