> Markdown version of [/jobs/ext/735507-ai-llm-sr-manager-of-software-engineering-java-and-python](https://www.wearedevelopers.com/jobs/ext/735507-ai-llm-sr-manager-of-software-engineering-java-and-python). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # AI/LLM Sr Manager of Software Engineering - Java and Python - **Company:** JPMorgan Chase & Co. - **Location:** New York, NY, United States - **Experience:** Expert - **Salary:** $171,000.0 - $260,000.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Artificial Intelligence, Amazon Web Services, Automation of Tests, Cloud Engineering, Code Review, Databases, Continuous Integration, Software Debugging, DevOps, Distributed Systems, Software Engineering, Software Systems, Workflow Management Systems, GitHub Copilot, Large Language Models, IT Architecture, Cloudformation, Information Technology, Api Design, Terraform - **Published:** June 29, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=51611c56a4f1e7a4 ## About the Role Do you have experience in Technology management?, * Formal training or certification on Software Engineering concepts and 5+ years applied experience. In addition, 2 + years of experience leading technologists to manage and solve complex technical items within your domain of expertise. * Experience leading teams of technologists. * Ability to guide and coach teams on approach to achieve goals aligned against a set of strategic initiatives * Strong software engineering foundation with hands-on experience building services in Java and Python, working with databases, and using modern integration patterns. * Working knowledge of AI/LLM-enabled application development, including prompt/context design, orchestration and agentic patterns, and evaluation/quality approaches. * Hands-on experience using AI coding assistants (e.g., GitHub Copilot, Claude Code, or firm-approved equivalents) to accelerate secure, high-quality development, test automation, and code review within enterprise guardrails. * Ability to set clear technical direction while remaining flexible and adaptive in a rapidly evolving problem space (e.g., AI-enabled product development). * Demonstrated experience partnering with product leaders and stakeholders to translate ambiguous requirements into actionable technical plans and measurable delivered results. * Experience hiring, developing, and recognizing talent, with a track record of building strong engineering culture and effective feedback mechanisms. * Practical cloud-native experience designing, deploying, and operating production systems on AWS. * Experience in Computer Science, Engineering, Mathematics, or a related field and expertise in technology disciplines. Preferred qualifications, capabilities, and skills * Experience working at code level, including contributing to production-grade services, debugging complex issues, and setting engineering standards through exemplars. * Experience building AI-assisted and AI-native software systems, including LLM integration patterns, tool/skill design, retrieval/context enrichment, and agentic workflow orchestration. * Experience operating distributed systems in AWS (e.g., compute, storage, messaging, observability), with a track record of reliability and cost-aware scaling * Experience balancing delivery across multiple concurrent initiatives while managing dependencies across teams and stakeholder groups. * Experience with cloud-native DevOps practices, including CI/CD pipelines, infrastructure as code (e.g., Terraform, CloudFormation), and automated testing in distributed environments. ## Description When you mentor and advise multiple technical teams and move financial technologies forward, it's a big challenge with big impact. You were made for this., * Provide overall direction, oversight, and coaching for a team of mid-level software engineers delivering AI-enabled capabilities across the ProductGPT ecosystem, spanning basic to moderately complex tasks, and evolving toward more advanced agentic and workflow-based solutions * Lead with a hands-on mindset: stay close to design and implementation, unblock delivery, and drive engineering excellence through code reviews, architecture guidance, and pragmatic decision-making * Be accountable for decisions that influence teams' resources, budget, tactical operations, and the execution and implementation of processes and procedures, especially as priorities shift in a fast-moving AI domain * Establish and iterate on AI development strategies for use-case delivery, including LLM integration approaches, evaluation strategies, prompt/context management, orchestration patterns, and safe deployment practices * Ensure successful collaboration across teams and stakeholders in multiple locations, partnering closely with product team representation to align on outcomes, milestones, tradeoffs, and sequencing * Manage and prioritize multiple concurrent requests and initiatives, balancing near-term delivery with platform health, operational readiness, and long-term technical direction * Drive cloud-native engineering practices leveraging AWS services and modern data/storage patterns, ensuring solutions are scalable, observable, secure, and cost-aware * Promote strong engineering fundamentals across the stack, including API design, data modeling, resiliency, testing discipline, CI/CD, and operational excellence * Identifies and mitigates issues to execute a book of work while escalating issues as necessary * Provides input to leadership regarding budget, approach, and technical considerations to improve operational efficiencies and functionality for the team * Creates a culture of diversity, opportunity, inclusion, and respect for team members and prioritizes diverse representation ## Related Videos - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon) - [Kubernetes and Microservices with Multi-Model Databases](https://www.wearedevelopers.com/videos/382-kubernetes-and-microservices-with-multi-model-databases) - [Agentic employees in world's most downloaded FinTech app](https://www.wearedevelopers.com/videos/100123-agentic-employees-in-world-s-most-downloaded-fintech-app) - [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment) - [Agentic AI Systems for Critical Workloads](https://www.wearedevelopers.com/videos/1592-agentic-ai-systems-for-critical-workloads) ## Related Articles - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [What is Agentic Programming and Why Should Developers Care?](https://www.wearedevelopers.com/magazine/625-what-is-agentic-programming-and-why-should-developers-care) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)