> Markdown version of [/jobs/ext/3786185-senior-data-search-engineer-data-scientist](https://www.wearedevelopers.com/jobs/ext/3786185-senior-data-search-engineer-data-scientist). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Search Engineer (Data Scientist)

- **Company:** Idc Inc
- **Location:** United States (Remote available)
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, ARM Architecture, Encodings, Data as a Services, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Data Warehousing, Information Retrieval, Python (Programming Language), Natural Language Processing, Standard Sql, Search Technologies, Snowflake, Database Optimization, Data Layers, Virtual Agents
- **Published:** October 16, 2026
- **Apply:** https://arc.dev/remote-jobs/j/redirect/przbd8tga3

## About the Role

* 3+ years of experience in data engineering, search engineering, or a related field
 * Experience building and maintaining ETL pipelines and working with data warehouses
 * Familiarity with semantic search concepts and embedding-based retrieval
 * Proficiency in Python and SQL
 * Experience with document processing, text extraction, or content transformation
 * A strong data quality mindset. You care about correctness, completeness, and consistency, * Experience with Snowflake or Snowflake Cortex
 * Hands-on experience with vector databases
 * Background in information retrieval or natural language processing
 * Experience implementing access control at the data layer
 * Familiarity with data quality monitoring and pipeline observability tools

## Description

IDC is building the next generation of AI-powered intelligence platforms that transform how technology decisions get made. Our platform re-imagines the way decision-makers discover and interact with trusted research and data, and is foundational to IDC's future. We are looking for a Data/Search Engineer to join the Search & Data Services team. This role sits at the intersection of data engineering and information retrieval. You will automate and extend the pipelines that feed IDC's content into the platform, build embedding pipelines for semantic search, and develop the document processing infrastructure that powers customer uploads. Your work ensures that when users ask questions, the system finds the right content and returns it accurately. This is a foundational role. The quality of every AI-generated response depends on the data infrastructure you build and maintain.

What You'll Do

 * Automate and extend ETL pipelines that ingest, transform, and deliver IDC's research content to the platform
 * Build embedding pipelines that power semantic search across the platform's content library
 * Develop document processing and extraction capabilities for customer uploads, including text extraction, chunking, and citation anchor generation
 * Improve search relevance through indexing strategies, ranking tuning, and retrieval optimization
 * Build data infrastructure that supports AI agent queries with accurate, well-structured results
 * Monitor pipeline performance and data quality, identifying and resolving issues before they affect users