> Markdown version of [/jobs/ext/3817997-mgr-software-eng](https://www.wearedevelopers.com/jobs/ext/3817997-mgr-software-eng). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Mgr - Software Eng

- **Company:** Ally Financial Inc.
- **Location:** Charlotte, NC, United States (Remote available)
- **Experience:** Experienced
- **Salary:** $110,000.0 - $180,000.0
- **Contract:** Permanent contract
- **Skills:** LangGraph Framework, Artificial Intelligence, Amazon Web Services, Microsoft Azure, Cloud Computing, Code Review, Python (Programming Language), Machine Learning, Search Technologies, Software Engineering, Management of Software Versions, Google Cloud, Enterprise Software Applications, LangChain, Retrieval-Augmented Generation, Large Language Models, Multi-Agent Systems, Prompt Engineering, Llamaindex, Generative AI, Agentic-AI, Containerization, Kubernetes, AutoGen, Machine Learning Operations, Model Context Protocol, Docker, Microservices
- **Published:** October 18, 2026
- **Apply:** https://dejobs.org/x/x/34C069D18B2A4F4AB3C1A918759C0810/job/

## About the Role

* 7+ years of relevant experience or equivalent combination of education and experience
 * Bachelor's Degree in relevant field or equivalent, * Architecture & Design: Design scalable, secure, and production-ready GenAI applications utilizing Large Language Models (LLMs), fine-tune and deploy open-source models that meets business needs, Retrieval-Augmented Generation (RAG) pipelines, and vector databases.
 * Agentic Workflows: Build and orchestrate multi-agent AI systems and tool-calling frameworks (e.g., LangChain, LangGraph, AutoGen).
 * Technical Leadership: Lead code reviews, establish engineering best practices, enforce coding standards, and mentor junior-to-mid-level software engineers.
 * Prototyping & R&D: Rapidly build Proof of Concepts (PoCs) and Minimum Viable Products (MVPs) to test emerging AI models and frameworks
 * LLMOps & Monitoring: Implement monitoring, caching, prompt versioning, cost tracking, and evaluation guardrails for models running in production
 * Cross-Functional Collaboration: Partner with product managers, data scientists, security teams, and business stakeholders to align technical deliverables with organizational goals
 * Experience: 8+ of Software Engineering experience with 5+ years in machine learning engineering, with at least 2+ years hands-on focus building and deploying GenAI/LLM enterprise applications.
 * Core Technologies: Advanced proficiency in Python and cloud-native development (AWS, Azure, or Google Cloud).
 * AI Frameworks: Deep practical knowledge of RAG architectures, vector search, prompt engineering, and orchestration libraries (LangChain, LlamaIndex, LangGraph).
 * Infrastructure: Familiarity with CI/CD pipelines, containerization (Docker, Kubernetes), and API microservices.
 * Soft Skills: Proven track record of technical leadership, mentoring, and translating complex technical concepts into clear business value. Strong analytical, communication (written and oral), and interpersonal skills. Ability to prioritize workload and balance multiple initiatives and efforts. Ability to respond quickly to a changing environment.
 * Experience fine-tuning open-weight foundation models.
 * Background in highly regulated industries (bank/finance) navigating strict security protocols.
 * Active curiosity about emerging AI tooling, Model Context Protocol (MCP), and automated evaluation loops.