Mgr - Software Eng

• 7+ years of relevant experience or equivalent combination of education and experience
• Bachelor’s Degree in relevant field or equivalent, * Architecture & Design: Design scalable, secure, and production-ready GenAI applications utilizing Large Language Models (LLMs), fine-tune and deploy open-source models that meets business needs, Retrieval-Augmented Generation (RAG) pipelines, and vector databases.
• Agentic Workflows: Build and orchestrate multi-agent AI systems and tool-calling frameworks (e.g., LangChain, LangGraph, AutoGen).
• Technical Leadership: Lead code reviews, establish engineering best practices, enforce coding standards, and mentor junior-to-mid-level software engineers.
• Prototyping & R&D: Rapidly build Proof of Concepts (PoCs) and Minimum Viable Products (MVPs) to test emerging AI models and frameworks
• LLMOps & Monitoring: Implement monitoring, caching, prompt versioning, cost tracking, and evaluation guardrails for models running in production
• Cross-Functional Collaboration: Partner with product managers, data scientists, security teams, and business stakeholders to align technical deliverables with organizational goals
• Experience: 8+ of Software Engineering experience with 5+ years in machine learning engineering, with at least 2+ years hands-on focus building and deploying GenAI/LLM enterprise applications.
• Core Technologies: Advanced proficiency in Python and cloud-native development (AWS, Azure, or Google Cloud).
• AI Frameworks: Deep practical knowledge of RAG architectures, vector search, prompt engineering, and orchestration libraries (LangChain, LlamaIndex, LangGraph).
• Infrastructure: Familiarity with CI/CD pipelines, containerization (Docker, Kubernetes), and API microservices.
• Soft Skills: Proven track record of technical leadership, mentoring, and translating complex technical concepts into clear business value. Strong analytical, communication (written and oral), and interpersonal skills. Ability to prioritize workload and balance multiple initiatives and efforts. Ability to respond quickly to a changing environment.
• Experience fine-tuning open-weight foundation models.
• Background in highly regulated industries (bank/finance) navigating strict security protocols.
• Active curiosity about emerging AI tooling, Model Context Protocol (MCP), and automated evaluation loops.

Ally’s compensation program offers market-competitive base pay and pay-for-performance incentives (bonuses) based on achieving personal and company goals. Our Total Rewards program includes industry-leading compensation and benefits plus additional incentives that are designed to meet your needs and those of your family so you can get the most out of your career and your life, including:

Time Away: Program starts at 20 paid time off days in addition to 11 paid holidays and 8 hours of volunteer time off yearly (time off days are prorated based on start date and program varies based on full or part-time status and management level).

Planning for the Future: plan for the near and long term with an industry-leading 401K retirement savings plan with matching and company contributions, student loan pay downs and 529 educational save up assistance programs, tuition reimbursement, employee stock purchase plan, and financial learning center and financial coach access.

Supporting your Health & Well-being: flexible health and insurance options including medical, dental and vision, employee, spouse and child life insurance, short- and long-term disability, pre-tax Health Savings Account with employer contributions, Healthcare FSA, critical illness, accident & hospital indemnity insurance, and a total well-being program that helps you and your family stay on track physically, socially, emotionally, and financially.

Building a Family: adoption, surrogacy and fertility assistance as well as paid parental and caregiver leave, Dependent Day Care FSA back-up child and adult/elder care days and childcare discounts.

Work-Life Integration: other benefits including Mentally Fit Employee Assistance Program, subsidized and discounted Weight Watchers® program and other employee discount programs.

Ally Financial is a customer-centric, leading digital financial services company with passionate customer service and innovative financial solutions. We are relentlessly focused on “Doing it Right” and being a trusted financial-services provider to our consumer, commercial, and corporate customers. For more information, visit www.ally.com .