> Markdown version of [/jobs/ext/3571827-principal-ai-genai-platform-architect-onsite-austin-san-francisco-los-angeles-chicago-w2-only](https://www.wearedevelopers.com/jobs/ext/3571827-principal-ai-genai-platform-architect-onsite-austin-san-francisco-los-angeles-chicago-w2-only). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Principal AI/GenAI Platform Architect ONSITE - Austin/ San Francisco/ Los Angeles/ Chicago - W2 Only - **Company:** HYR Global Source - **Location:** Austin, TX, United States - **Experience:** Expert - **Salary:** $163,400.0 - **Contract:** Permanent contract - **Skills:** LangGraph Framework, AI Evaluation, Java (Programming Language), Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Microsoft Azure, Cloud Computing, Cloud Engineering, Code Review, Continuous Integration, Extract Transform Load (ETL), Data Warehousing, Distributed Systems, Memory Management, Failover, Python (Programming Language), Key Management, Network Control, Systems Development Life Cycle, OpenAI, Search Technologies, Software Engineering, SQL Databases, TypeScript, Management of Software Versions, Enterprise Software Applications, ReactJS, Retrieval-Augmented Generation, Large Language Models, Generative AI, Langfuse — LLM Observability and Analytics Platform, Agentic-AI, Rate Limiting, Build Management, AI Platforms, Kubernetes, Infrastructure Automation Frameworks, Information Technology, Amazon Bedrock, Low Latency, Production Code, Pure Data, Enterprise Integration, LiteLLM, Machine Learning Operations, Golang, Microservices - **Published:** October 3, 2026 - **Apply:** https://www.careerjet.com/jobad/us41d2e8ebce171d5633842d9343d40595 ## About the Role Education Requirement - Bachelor's Degree in: Computer Science, Information Technology, Or related field Level: Senior Technical Lead / Architect / Director-mapped Player-Coach, * 10 15+ years of experience across software engineering, platform engineering, distributed systems, cloud architecture or related engineering disciplines. * Strong early-career and continuing foundation as a hands-on Software Engineer. * Significant recent experience architecting or building enterprise AI, GenAI or agentic AI platforms in production. * Strong hands-on development experience with Python plus at least one of Java, Go or TypeScript. * Strong understanding of APIs, microservices, distributed systems, testing, code reviews and secure software development. * Hands-on understanding of LLMs, model gateways, RAG, vector databases/search, embeddings, agents, prompts, tool calling and AI evaluation. * Experience with AI observability, tracing, governance and guardrails. * Strong cloud experience with Azure, AWS and/or GCP. * Experience with Kubernetes, containers, CI/CD and infrastructure as code. * Experience designing highly available, secure and scalable production platforms. * Demonstrated ability to make architecture decisions and communicate with senior technical and business stakeholders. * Ability to remain technically hands-on while providing leadership to engineering teams. Strongly Preferred Azure OpenAI, Amazon Bedrock and/or Vertex AI LiteLLM or comparable model-gateway architecture LangChain, LangGraph or comparable agent frameworks MCP / enterprise AI tool integration Vector and hybrid search technologies OpenTelemetry Langfuse, Arize or comparable AI observability/evaluation platforms Enterprise identity and secrets-management technologies Experience protecting PII/PHI or other sensitive enterprise data Experience in healthcare or another highly regulated industry Fortune 500 enterprise experience Combination of enterprise + startup/product-building experience ## Description * We are seeking a Senior AI/GenAI Platform Architect / Technical Lead who started their career as a hands-on Software Engineer and has evolved into designing and leading enterprise AI/ML and Generative AI platforms. * This is not a pure Data Scientist, ML Researcher, AI Strategy, or management-only position. * The ideal candidate has a strong software engineering foundation in Python, Java, Go and/or TypeScript/React, distributed systems, APIs and cloud-native architecture, combined with recent hands-on experience building enterprise AI/GenAI platforms and agentic systems in production. * We are particularly interested in candidates who have built AI platforms or products from the ground up, rather than primarily supporting existing environments. * Experience working with Fortune 500 enterprises and complex or highly regulated environments is strongly preferred. A combination of large-enterprise and startup/product-building experience is especially valuable. What You'll Do * Own the architecture and technical direction of an enterprise AI/GenAI platform. * Define the reference architecture for the AI control plane, shared platform services, SDKs, templates and developer experience. * Architect and build model gateways supporting multiple AI providers such as Azure OpenAI, Amazon Bedrock, Vertex AI and other LLM providers. * Implement model routing, failover, quotas, rate limiting, tenant isolation, key management, token accounting and cost allocation. * Design and build enterprise GenAI runtimes supporting LLM applications, RAG, context and memory management, vector/hybrid search and tool execution. * Architect agentic AI platforms, including agent, model, prompt and tool registries, versioning, lineage, approvals and promotion processes. * Implement MCP-style tool interoperability and secure integration between AI agents and enterprise systems. * Build AI observability and traceability covering prompts, model calls, tool calls and agent execution. * Establish evaluation frameworks for AI quality, hallucination/accuracy, drift, latency, reliability and cost. * Implement enterprise AI security and guardrails, including PII/PHI protection, prompt-injection defenses, identity, least-privilege access and policy enforcement. * Establish platform engineering practices using Kubernetes, infrastructure as code, CI/CD, secrets management, secure SDLC and cloud-native architectures. * Define production SLOs, capacity and reliability standards and participate in incident management. * Remain hands-on with production code, architecture reviews, prototypes and critical technical components. * Make pragmatic build-vs-buy decisions and evaluate AI platform technologies and vendors. * Partner with Product, AI Engineering, Data Science, Security and enterprise application teams. * Initially operate as a player-coach and help build and lead a platform engineering team of approximately 3 8 engineers., Principal Architect \n Primary Skills DataStream, ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data Warehousing, Time Travel and Fail Safe, Snowpipe, SnowSQL, Modern … + 2 days ago ## Related Videos - [Building a Multi-Agent Orchestration Engine That Actually Follows the Rules](https://www.wearedevelopers.com/videos/100159-building-a-multi-agent-orchestration-engine-that-actually-follows-the-rules) - [Develop AI-powered Applications with OpenAI Embeddings and Azure Search](https://www.wearedevelopers.com/videos/828-develop-ai-powered-applications-with-openai-embeddings-and-azure-search) - [Go with the Flow: Stop the Leaks Before Your Memory's a Waterfall!](https://www.wearedevelopers.com/videos/100073-go-with-the-flow-stop-the-leaks-before-your-memory-s-a-waterfall) - [On a Secret Mission: Developing AI Agents](https://www.wearedevelopers.com/videos/1510-on-a-secret-mission-developing-ai-agents) - [Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!](https://www.wearedevelopers.com/videos/1204-coding-an-immersive-copilot-using-unity-net-and-azure-openai) - [Scoring 2000 Products per Request: Performance Pitfalls in Golang](https://www.wearedevelopers.com/videos/2073-scoring-2000-products-per-request-performance-pitfalls-in-golang) ## Related Articles - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)