> Markdown version of [/jobs/ext/1136034-ai-engineer](https://www.wearedevelopers.com/jobs/ext/1136034-ai-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # AI Engineer - **Company:** FIRST SERVICE CREDIT UNION - **Location:** Houston, TX, United States - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Automated Storage and Retrieval Systems, Audit Trail, Ubuntu (Operating System), Encodings, Information Engineering, Information Leak Prevention, Data Warehousing, IBM DB2, Debian Linux, Linux, Python (Programming Language), Machine Learning, Microsoft SQL Server, Open Source Technology, Software Engineering, AI Infrastructure, Data Processing, Application Enhancement Tool, Pytorch, Large Language Models, AI Platforms, Information Technology, Low Latency, Deployment Automation, HuggingFace, Hardware Infrastructure, Data Pipelines, Docker - **Published:** July 1, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=13f20eadfa9ec212 ## About the Role Do you have experience in Software engineering?, Do you have a Bachelor's degree?, Experience: Three years or more of experience building and deploying machine learning or LLM-based applications in production, including experience architecting systems rather than solely implementing within existing ones. Education: Equivalent to a college degree, in the field of Computer Science (BS or BA in a relevant field), or related professional work experience. Interpersonal Skills: Work involves regular collaboration with Data Engineering, departmental leadership, and end users across the credit union. Ability to clearly explain complex technical concepts to non-technical stakeholders and to operate with a high degree of independence and sound judgment is essential. Other Skills: Strong Python skills, including experience with ML/AI frameworks (PyTorch, Hugging Face Transformers, LangChain/LlamaIndex/ Haystack, or similar). Experience with vector databases and embedding-based retrieval systems. Hands-on experience with containerized deployment (Docker) on Linux (Debian/Ubuntu) servers. Demonstrated ability to operate independently in greenfield environments, building from zero with limited existing infrastructure or precedent. Understanding of data privacy and PII handling practices. Experience operating self-hosted LLMs (Ollama, vLLM, text-generation-inference) on GPU hardware, including GPU resource planning and capacity management, preferred. Experience in financial services, banking, or another regulated industry preferred. Familiarity with NCUA, GLBA, or similar regulatory frameworks governing data handling preferred. Must have good communication skills. Ability to maintain a high level of confidentiality at all times. Must have a proactive attitude toward members, supervisors, co-workers and the credit union. Physical Requirements: Work Environment On-site role supporting on-premises infrastructure; no cloud deployment of sensitive data permitted. Occasional off-hours support for production AI systems may be required. ## Description The AI Engineer holds primary responsibility for architecting and implementing FSCU's on-premises AI platform from scratch u2014 including LLM infrastructure, retrieval-augmented generation (RAG), agentic search, and related intelligent automation systems. This is a foundational role: there is no pre-existing AI infrastructure or precedent at FSCU, and the work performed in this position will establish the technical foundation upon which AI at FSCU is built for years to come. The role works closely with Data Engineering to ensure AI systems are supported by clean, governed data pipelines, and partners directly with the VP of Software Development to ensure all AI deployments meet NCUA and Texas Credit Union Department regulatory expectations around data sovereignty, auditability, and PII protection. Essential Functions & Responsibilities: * Architects and implements FSCU's on-premises AI platform from the ground up, leveraging newly acquired on-prem GPU hardware (H200-based) to deliver enterprise AI capability with no cloud dependency. Designs and builds LLM-based applications, including RAG pipelines, agentic search, and vector retrieval systems, using self-hosted frameworks such as Haystack, LlamaIndex, Ollama, or comparable tools. * Establishes foundational standards, patterns, and best practices for AI development at FSCU, since none currently exist. Sets the technical and architectural precedent for how AI is built, deployed, secured, and governed going forward, including PII and data-governance safeguards (redaction, access controls, audit logging) sufficient to meet NCUA examination standards. * Deploys, tunes, and monitors models on on-prem GPU infrastructure, optimizing for throughput, latency, and resource utilization across shared workloads. Collaborates with Data Engineering to define data contracts, feature pipelines, and integration points between the MS SQL Server/DB2 data warehouse and AI systems. * Evaluates and prototypes emerging AI tooling, both open-source and commercial, for fit within a strict on-premises, no-cloud-egress environment. Develops internal tools and APIs that expose AI capabilities to other departments, such as virtual agent support, document processing, and ticket triage. * Performs other job related duties as assigned. Performance Measurements 1. Successfully architect and stand up FSCU's on-premises AI platform on schedule, establishing a stable foundation for future AI initiatives. 2. Design and implement AI systems that operate entirely within FSCU's on-premises environment, with no unauthorized cloud egress of sensitive data. 3. Establish documented standards, patterns, and governance practices for AI development that can be adopted across future projects and team members. 4. Ensure all AI deployments satisfy NCUA and Texas Credit Union Department regulatory expectations, including auditability and PII protection. 5. Collaborate effectively with Data Engineering and the VP of Software Development to align AI systems with broader data platform architecture. 6. Provide informed, professional, and accurate support to internal stakeholders leveraging AI-powered tools and capabilities. 7. Stay current on LLM and AI security risks (e.g., prompt injection, data leakage, model drift) and implement appropriate mitigations. 8. Demonstrate sound judgment and independent decision-making when operating in a greenfield environment with limited existing precedent. 9. Accept individual accountability and responsibility for the success of FSCU's AI initiatives, including meeting assigned goals and project milestones. ## Related Videos - [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding) - [Pioneering AI Assistants in Banking](https://www.wearedevelopers.com/videos/1627-pioneering-ai-assistants-in-banking) - [Docker exec without Docker](https://www.wearedevelopers.com/videos/1094-docker-exec-without-docker) - [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [How to start an AI project for a good cause and boost your career](https://www.wearedevelopers.com/magazine/15-how-to-start-an-ai-project-for-a-good-cause-and-boost-your-career) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)