> Markdown version of [/jobs/ext/213590-senior-ai-engineer-internal-ai-platforms](https://www.wearedevelopers.com/jobs/ext/213590-senior-ai-engineer-internal-ai-platforms). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior AI Engineer, Internal AI Platforms - **Company:** HERMEUS CORPORATION - **Location:** United States (Remote available) - **Experience:** Expert - **Salary:** $136,000.0 - $226,550.0 - **Contract:** Permanent contract - **Skills:** Microsoft Windows, Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, ARM Architecture, Automated Storage and Retrieval Systems, Confluence, JIRA, Audit Trail, Business Systems, Cloud Computing, Cloud Engineering, Computer Programming, Content Analysis, Continuous Integration, Data Governance, Data Infrastructure, Information Leak Prevention, Data Security, Identity and Access Management, Python (Programming Language), Machine Learning, Open Source Technology, Regression Testing, Search Technologies, Software Engineering, Systems Integration, TypeScript, Datadog, Large Language Models, Multi-Agent Systems, IT Architecture, AI Platforms, Kubernetes, Infrastructure Automation Frameworks, Slack, Devsecops - **Published:** May 29, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=4de3e5772b893772 ## About the Role Do you have experience in Systems integration?, This is a hands-on engineering role focused on building secure, scalable, production-grade AI systems for enterprise use. The ideal candidate has experience developing LLM-enabled applications, retrieval systems, and agentic workflows within regulated or security-conscious environments, and is comfortable operating across architecture, infrastructure, integrations, observability, and user experience., * 5+ years of professional software engineering experience * 2+ years building AI, ML, automation, or LLM-enabled applications in production environments * Strong programming experience in Python, TypeScript, or both * Hands-on experience building production AI systems using LLMs, RAG pipelines, vector databases, embeddings, and orchestration frameworks * Experience deploying scalable services in cloud or private infrastructure environments, preferably AWS * Experience building AI systems that integrate with enterprise platforms, APIs, and governed data sources * Strong understanding of security, permissions models, identity management, and enterprise data governance * Practical understanding of LLM limitations including hallucinations, prompt injection, data leakage, and evaluation challenges * Ability to operate in ambiguity, rapidly prototype solutions, and harden successful systems into production-ready platforms, * Aerospace, defense, national security, financial services, healthcare, or other regulated industry experience * Experience with AWS-native AI and infrastructure services including Bedrock, SageMaker, EKS, OpenSearch, or GovCloud * Familiarity with commercial and open-source model providers such as Anthropic Claude, OpenAI, Llama, Mistral, or similar * Experience with AI orchestration and agent frameworks such as LangChain, LlamaIndex, Semantic Kernel, CrewAI, or similar tooling * Experience with vector databases and search technologies such as OpenSearch, Pinecone, Weaviate, pgvector, or FAISS * Experience building AI evaluation pipelines including regression testing, retrieval scoring, and red-team validation * Familiarity with secure software development, DevSecOps, CI/CD, infrastructure as code, and observability tooling * Experience designing systems for CUI, ITAR, export-controlled, or otherwise sensitive data environments * Strong communication skills with the ability to explain AI architecture, risks, and tradeoffs to technical and non-technical stakeholders ## Description We are seeking a Senior AI Engineer, Internal AI Platforms to help design, build, and scale Cortex, our internal AI platform. Cortex is intended to become the centralized AI platform across the company - enabling employees to securely interact with internal knowledge, business systems, workflows, and future agentic capabilities within a highly governed environment., * Design, build, and improve Cortex, including retrieval systems, document analysis, workflow automation, and internal AI capabilities * Develop integrations with enterprise platforms such as Jira, Confluence, Microsoft 365, Slack/GovSlack, and internal business systems * Build and optimize RAG pipelines including ingestion, chunking, embeddings, vector search, permissions enforcement, and response evaluation * Develop agentic workflows that safely perform actions such as summarization, ticket updates, governed data access, and business process automation * Define architecture for secure self-hosted, private, or cloud-isolated AI systems within regulated environments * Partner with Security, IT, and Compliance teams to implement governance controls, auditability, permissions, and secure API access * Evaluate and integrate commercial, open-source, and cloud-native LLM providers and orchestration frameworks * Build observability into AI systems including monitoring, evaluation metrics, latency tracking, error handling, and workflow reliability * Contribute reusable AI engineering standards, patterns, and platform capabilities to support long-term internal AI adoption, Senior AI Engineer IV - $167,450 - $226,550 The salary information provided is a general guideline only. Hermeus takes various factors into account, including, but not limited to, the position's scope and responsibilities, the candidate's professional background, education and training, essential skills, and market and business considerations, when presenting a job offer. ## Related Videos - [Debugging in the Dark](https://www.wearedevelopers.com/videos/1658-debugging-in-the-dark) - [Coffee with Developers - Maria Apazoglou](https://www.wearedevelopers.com/videos/1209-coffee-with-developers-maria-apazoglou) - [Stack Overflow: Community and AI](https://www.wearedevelopers.com/videos/600-stack-overflow-community-and-ai) - [Improving quality with Agentic AI with Rovo Dev and Xray](https://www.wearedevelopers.com/videos/2005-improving-quality-with-agentic-ai-with-rovo-dev-and-xray) - [Software Engineering Social Connection: Yubo’s lean approach to scaling an 80M-user infrastructure](https://www.wearedevelopers.com/videos/1583-software-engineering-social-connection-yubo-s-lean-approach-to-scaling-an-80m-user-infrastructure) - [Cloud as the new mainframe: why the cloud hype does not reflect the dev reality](https://www.wearedevelopers.com/videos/797-cloud-as-the-new-mainframe-why-the-cloud-hype-does-not-reflect-the-dev-reality) ## Related Articles - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this)