> Markdown version of [/jobs/ext/732100-backend-data-rag-engineer-in-new-york-ny-10036-hybrid](https://www.wearedevelopers.com/jobs/ext/732100-backend-data-rag-engineer-in-new-york-ny-10036-hybrid). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Backend Data / RAG Engineer in New York, NY 10036 (Hybrid)

- **Company:** Sumeru Global Technologies Private Limited
- **Location:** New York, NY, United States
- **Experience:** Expert
- **Salary:** $135,200.0 - $145,600.0
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), .NET Framework, Application Programming Interfaces (APIs), Artificial Intelligence, Audit Trail, Microsoft Azure, Cloud Computing Security, Cloud Storage, Encodings, Databases, Continuous Integration, Information Engineering, Data Governance, Data Security, Elasticsearch, Graph Database, Python (Programming Language), Node.Js, Parsing, Role-Based Access Control, Standard Sql, Search Technologies, Management of Software Versions, Indexer, Backend, Search Engines
- **Published:** June 29, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=bb79d40e15c65053

## About the Role

Do you have experience in Search engines?, · Strong backend/data engineering using Python, Java, Node.js, or .NET. Strong SQL and database experience.

· Minimum 2 years hands-on AI/RAG implementation experience.

· Experience with embeddings, vector search, hybrid search, document ingestion, and RAG pipelines.

· Experience with Azure AI Search, pgvector, Pinecone, Weaviate, Qdrant, Milvus, Elasticsearch, OpenSearch, or equivalent.

· Understanding of chunking, retrieval tuning, reranking, context assembly, citations, and retrieval evaluation. BFSI, banking, insurance, capital markets, payments, or regulated enterprise experience. Client implementation experience.

Preferred Skills:

· Azure Blob Storage, Azure AI Search, Azure Document Intelligence, Azure OpenAI, or similar Azure services.

· Experience with data governance, document lineage, metadata models, knowledge graphs, or ontology-driven retrieval.

· Experience with CI/CD, containers, observability, and secure cloud deployment

## Description

· Build document ingestion, parsing, chunking, metadata extraction, embedding, indexing, and versioning pipelines.

· Implement RAG services using vector search, keyword search, hybrid retrieval, metadata filters, reranking, and citations.

· Integrate with Azure AI Search, pgvector, Pinecone, Weaviate, Qdrant, Milvus, Elasticsearch, OpenSearch, or similar platforms.

· Build APIs for retrieval, source traceability, ingestion status, feedback capture, and citation support. Implement permission-aware retrieval, RBAC, tenant isolation, audit logging, PII handling, and secure data access.

· Support retrieval quality evaluation, grounding, hallucination reduction, client demos, UAT, and production readiness.


## Related Videos

- [Optimizing Discovery: PostgreSQL's Role in Transforming GetYourGuide's Search](https://www.wearedevelopers.com/videos/1647-optimizing-discovery-postgresql-s-role-in-transforming-getyourguide-s-search)
- [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock)
- [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json)
- [RAG's Not Dead, You're Just Using It Wrong! - Phil Nash](https://www.wearedevelopers.com/videos/1906-rag-s-not-dead-you-re-just-using-it-wrong-phil-nash)
- [OLAP for AI Applications and why you should care](https://www.wearedevelopers.com/videos/100212-olap-for-ai-applications-and-why-you-should-care)
- [Nest.js - TypeScript in the backend can also be clean](https://www.wearedevelopers.com/videos/1033-nest-js-typescript-in-the-backend-can-also-be-clean)

## Related Articles

- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [Find a Developer Job: 12 Best Job Sites For Developers](https://www.wearedevelopers.com/magazine/165-find-a-developer-job-12-best-job-sites-for-developers)
- [The Best Job Search Websites of 2025](https://www.wearedevelopers.com/magazine/368-the-best-job-search-websites-of-2025)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)