> Markdown version of [/jobs/ext/671098-sr-ai-platform-engineer-retrieval-knowledge-systems](https://www.wearedevelopers.com/jobs/ext/671098-sr-ai-platform-engineer-retrieval-knowledge-systems). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Sr AI Platform Engineer - Retrieval & Knowledge Systems - **Company:** LPL Financial - **Location:** Fort Mill, SC, United States (Remote available) - **Experience:** Expert - **Salary:** $115,154.0 - $191,889.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Artificial Intelligence, Automated Storage and Retrieval Systems, Automation of Tests, Big Data, Cloud Computing, Cloud Engineering, Computer Programming, Continuous Integration, Shard (Database Architecture), DevOps, Distributed Systems, Elasticsearch, Fault Tolerance, Python (Programming Language), Knowledge-Based Systems, Performance Tuning, Search Technologies, Data Streaming, Unstructured Data, Retrieval-Augmented Generation, Large Language Models, Reliability of Systems, Indexer, Backend, Build Management, Containerization, AI Platforms, Kubernetes, Real Time Data, Apache Kafka, Build Tools, Search Engines, Data Pipelines, Microservices - **Published:** June 27, 2026 - **Apply:** https://lplfinancial.wd1.myworkdayjobs.com/External/job/Fort-MillCharlotte/Sr-AI-Platform-Engineer---Retrieval---Knowledge-Systems_R-051530 ## About the Role * Minimum of 8 years of experience in backend or platform engineering. * Experience building distributed systems, search platforms, or large-scale data services. * Hands-on experience with APIs, microservices, and cloud-native architectures. * Experience with search systems, indexing, or retrieval pipelines. * Experience programming skills in Java, Python, or Go. Preferences: * Experience with cloud platforms and containerized environments (Kubernetes). * Experience with Elasticsearch/OpenSearch, vector databases, or hybrid retrieval architectures. * Familiarity with RAG systems, embeddings, and LLM integration patterns. * Experience building AI platforms, copilots, or agent-based systems. * Experience with real-time data systems (Kafka, streaming pipelines). * Strong understanding of performance optimization in distributed systems. ## Description This role focuses on distributed systems, retrieval architectures, and AI platform services, enabling applications and agents to discover, retrieve, and reason over large-scale enterprise data. You will work at the intersection of search, vector retrieval, LLMs, and real-time data systems, building high-performance platforms used by AI and application teams. The ideal candidate is a strong backend/platform engineer with deep experience in building scalable systems and modern AI-powered retrieval architectures., AI Retrieval & Search Platform * Design and build high-scale retrieval systems combining keyword search, semantic search, and vector-based retrieval. * Develop RAG (Retrieval-Augmented Generation) infrastructure including indexing, retrieval, ranking, and context assembly. * Build and optimize search indices, vector stores, and hybrid retrieval systems for relevance, latency, and scale. * Implement advanced ranking, relevance tuning, and personalization pipelines. Data Pipelines & Indexing Systems * Build streaming and batch pipelines for ingesting and transforming structured and unstructured data. * Develop enrichment pipelines (chunking, embeddings, metadata extraction, classification). * Design systems for real-time indexing, incremental updates, and freshness guarantees. * Optimize data flow, storage, and compute efficiency at scale. AI Platform Services & APIs * Build low-latency, highly available APIs that expose retrieval and knowledge services to applications and AI agents. * Develop reusable SDKs and service abstractions for easy integration into product teams. * Enable context retrieval, query understanding, and response augmentation for downstream AI systems. * Establish patterns for multi-tenant, scalable platform services. LLM & Intelligent Systems Integration * Integrate LLMs with retrieval systems to enable grounded, context-aware experiences. * Build systems for context construction, prompt augmentation, and response orchestration. * Implement evaluation frameworks for relevance, grounding quality, and user experience. * Support use cases like AI assistants, copilots, search experiences, and automation agents. Performance, Scalability & Reliability * Design for low-latency (<100ms retrieval), high-throughput, and horizontal scalability. * Implement caching, sharding, and distributed query execution strategies. * Build observability pipelines (metrics, logs, tracing) for system performance and usage insights. * Drive resiliency, fault tolerance, and system reliability at scale. Technical Leadership * Lead design and architecture of large-scale AI platform components. * Mentor engineers on distributed systems, retrieval architectures, and AI engineering practices. * Drive adoption of modern engineering practices (CI/CD, infrastructure-as-code, automated testing). * Partner with AI, data, and product teams to shape next-gen intelligent platform capabilities. What are we looking for? We're looking for strong collaborators who deliver exceptional client experiences and thrive in fast-paced, team-oriented environments. Our ideal candidates pursue greatness, act with integrity, and are driven to help our clients succeed. We value those who embrace creativity, continuous improvement, and contribute to a culture where we win together and create and share joy in our work. ## Related Videos - [OLAP for AI Applications and why you should care](https://www.wearedevelopers.com/videos/100212-olap-for-ai-applications-and-why-you-should-care) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Optimizing Discovery: PostgreSQL's Role in Transforming GetYourGuide's Search](https://www.wearedevelopers.com/videos/1647-optimizing-discovery-postgresql-s-role-in-transforming-getyourguide-s-search) - [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock) - [Coffee with Developers - Maria Apazoglou](https://www.wearedevelopers.com/videos/1209-coffee-with-developers-maria-apazoglou) - [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)