> Markdown version of [/jobs/ext/3652295-principal-ai-software-engineer](https://www.wearedevelopers.com/jobs/ext/3652295-principal-ai-software-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Principal AI Software Engineer

- **Company:** Insight Global
- **Location:** Schenectady, NY, United States
- **Experience:** Expert
- **Salary:** $187,200.0 - $208,000.0
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Agile Methodology, Artificial Intelligence, Amazon Web Services, Application Integration Architecture, Computer Vision, Microsoft Azure, Software Code Optimization, Computer Programming, Computer Engineering, Memory Management, Python (Programming Language), Machine Learning, Natural Language Processing, Node.Js, Search Technologies, Software Engineering, Pinecone, ReactJS, Retrieval-Augmented Generation, Large Language Models, IT Architecture, Llamaindex, Vue.js, Pgvector, Containerization, AI Platforms, AngularJS, Information Technology, Performance Monitor, Weaviate, Milvus, Machine Learning Operations, Front End Software Development
- **Published:** October 9, 2026
- **Apply:** https://www.techcareers.com/job.asp?id=3426262350&tx=TT3734TYZ&pt=1&aff=0B19D771-A501-4A5E-8338-2A822B784D54&utm_source=Job%20Feed&utm_medium=textkernel&utm_campaign=DE&utm_term=0B19D771-A501-4A5E-8338-2A822B784D54

## About the Role

Bachelor's degree in Computer Science, Computer Engineering, or related technical field. 10+ years of programming experience in a relevant language using modern front-end frameworks (React, Vue, or Angular) and multiple backend languages (Python preferred, Java, Node.js or Go). Proven track record designing and shipping production applications that incorporate LLMs or AI services at scale. Experience with vector databases (e.g. Milvus, Pinecone, Weaviate, pgvector) and advanced embedding model optimization in production applications. Expertise with multiple LLM providers and advanced AI orchestration frameworks (LangChain, LlamaIndex, custom frameworks). Extensive experience leading technical teams, driving cross-team initiatives, and providing technical mentorship. Expert-level experience with cloud platforms (AWS, GCP, or Azure) and advanced containerization (EKS). 13+ years of full software development lifecycle experience, including architecture design, technical leadership, and
large-scale system optimization. Advanced understanding of enterprise RAG architectures, semantic search optimization, and conversation memory management at massive scale. Experience with multi-modal AI integration, model fine-tuning, and deployment of custom AI models. Experience with AI observability tools, cost optimization strategies, and performance monitoring at enterprise scale. Experience with cross-organizational collaboration and influencing other teams' directions and road maps. Experience with technical strategy development and technology roadmap planning.

## Description

Insight Global is looking for a Principal AI Software Engineer to support a global client. As a Principal AI Software Engineer, you will drive technical vision and architect enterprise AI applications for multiple initiatives across the company. You'll integrate LLMs, agent workflows, NLP, computer vision, and predictive analytics to build secure, high-availability and cost-efficient AI based solutions. You'll partner with product, data science, and engineering leaders, mentor teams, and raise standards in Agile, testing, security, and documentation. We support growth, autonomy, and collaboration across research and product., Set AI architecture and technical vision across products. Lead cross-team initiatives with product and data science. Design RAG and agent workflows; optimize LLM integrations. Build multi-tenant, high-availability systems with observability. Establish AI cost management, monitoring, and security standards.