> Markdown version of [/jobs/ext/1449417-director-of-ai-platforms-texas-institute-for-electronics](https://www.wearedevelopers.com/jobs/ext/1449417-director-of-ai-platforms-texas-institute-for-electronics). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Director of AI Platforms, Texas Institute for Electronics - **Company:** The University of Texas - **Location:** Austin, TX, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Automation of Tests, Code Reuse, Code Review, Data Retrieval, Software Debugging, DevOps, Programming Tools, Distributed Systems, Machine Learning, Language Modeling, Open Source Technology, Software Architecture, Rapid Prototyping Process, Reliability Engineering, Software Engineering, AI Infrastructure, Data Ingestion, Retrieval-Augmented Generation, Large Language Models, Backend, AI Platforms, Information Technology, Free and Open-Source Software, Machine Learning Operations, Data Pipelines - **Published:** July 26, 2026 - **Apply:** https://jobs.localjobnetwork.com/apply/add/85455740/1 ## About the Role * BS in Computer Science, Engineering, or a related field. * 8 or more years of software engineering experience, including 3 or more years focused on AI/ML and LLM-based applications. * Deep knowledge of LLM architectures and tools - you understand transformer models inside and out and are fluent in the surrounding ecosystem (from tokenization and embedding techniques to prompt engineering and fine-tuning methods). * Proven track record of productionizing LLM applications end-to-end. You have built and deployed AI-powered solutions (using both commercial APIs and open-source models) into real-world production environments - including experience with on-prem or private cloud deployments of AI systems. * Hands-on experience with the LLM tech stack: this includes building pipelines with vector databases (for embedding storage/search) and using LLM orchestration frameworks like LangChain or LlamaIndex to compose prompts, tools, and data retrieval. * Experience with modern model serving and scaling - familiarity with frameworks such as vLLM, LMDeploy, Ray (for distributed inference), or Triton Inference Server to optimize runtime performance of large models. * Exceptional engineering and problem-solving skills. You can design elegant solutions for complex challenges and debug issues across the ML stack (data, model, infrastructure) when things go wrong. * Excellent communication skills. You know how to articulate complex technical concepts clearly and adjust your message for engineers, founders, or other stakeholders. You can document architectures, write clear project plans, and mentor others by explaining the "why" behind technical decisions. * You have the ability to work effectively in fast-paced environments. You have the ability to act with urgency, adapt quickly to new information, and take ownership of. * Execution mindset. You have demonstrated experience driving projects forward in a hands-on role without heavy process or management overhead. You excel at managing multiple priorities, staying organized, and delivering results in a lean team setting. Relevant education and experience may be substituted as appropriate. Preferred Qualifications * MS or PhD in Computer Science, Machine Learning, or a related discipline. * Prior technical leadership experience. Experience leading an engineering team or serving as a tech lead for complex AI/ML projects. Ability to mentor others and experience managing project roadmaps or teams in previous roles. * Domain expertise in NLP/LLMs. Publications, open-source contributions, or recognized expertise in the NLP/LLM field (e.g. contributions to Transformer libraries, research in language modeling, etc.) will set you apart. * Enterprise AI experience. Familiarity with the unique challenges of applying AI in enterprise settings - such as handling sensitive data, ensuring compliance (e.g. GDPR, SOC2), or integrating with enterprise IT systems - is a plus., A criminal history background check will be required for finalist(s) under consideration for this position., * E-Verify Poster (English and Spanish) [PDF] * Right to Work Poster (English) [PDF] * Right to Work Poster (Spanish) [PDF] ## Description Drive the design, deployment, and optimization of enterprise-grade LLM systems, ensuring scalable, secure, and high-performance AI solutions tailored to complex organizational needs. Lead technical innovation across architecture, MLOps, and retrieval-augmented generation to deliver impactful, privacy-compliant AI capabilities., * Define and lead the software architecture and implementation roadmap for a scalable, modular AI infrastructure platform. You will work across backend, orchestration, and deployment layers-focusing on performance, security, and reliability. * Build and manage a high-caliber engineering team, including backend developers, platform engineers, and site reliability engineers. You will be responsible for mentoring, hiring, and setting a culture of technical excellence and operational discipline. * Own core services that power AI pipelines, including APIs for data ingestion and transformation, orchestration of model inference jobs, and integration with LLM orchestration layers and vector stores. * Establish technical strategy and design standards that support rapid prototyping, automated testing, and code reuse across teams. You will define best practices and lead by example in system design, code reviews, and architectural discussions. * Lead on-premise deployment strategy, ensuring our stack is optimized for hybrid environments. You will manage challenges around air-gapped deployments, resource management, and update rollouts in constrained environments. * Collaborate cross-functionally with AI engineering, product management, and customer success to align engineering priorities with product goals. You'll help translate high-level needs into deliverable milestones. * Implement and maintain CI/CD pipelines and DevOps best practices, focusing on security, observability, rollback safety, and developer productivity. * Develop and enforce SLAs/SLOs for critical services, putting in place monitoring, alerting, and incident response practices that ensure uptime and stability in enterprise-grade deployments. * Stay on top of evolving technologies in distributed systems, containerization, service mesh, observability, and developer tooling-bringing in the best ideas to future-proof our platform. Other related functions as assigned., The retirement plan for this position is Teacher Retirement System of Texas (TRS), subject to the position being at least 20 hours per week and at least 135 days in length. This position has the option to elect the Optional Retirement Program (ORP) instead of TRS, subject to the position being 40 hours per week and at least 135 days in length., Employees may be required to report violations of law under Title IX and the Jeanne Clery Disclosure of Campus Security Policy and Crime Statistics Act (Clery Act). If this position is identified a Campus Security Authority (Clery Act), you will be notified and provided resources for reporting. Responsible employees under Title IX are defined and outlined in HOP-3031. ## Related Videos - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock) - [Introduction to sCrypt - a smart contract language for Bitcoin SV](https://www.wearedevelopers.com/videos/24-introduction-to-scrypt-a-smart-contract-language-for-bitcoin-sv) - [Coffee with Developers - Maria Apazoglou](https://www.wearedevelopers.com/videos/1209-coffee-with-developers-maria-apazoglou) - [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment) - [Three years of putting LLMs into Software - Lessons learned](https://www.wearedevelopers.com/videos/1508-three-years-of-putting-llms-into-software-lessons-learned) ## Related Articles - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)