AI/LLM Sr Manager of Software Engineering - Java and Python

JPMorgan Chase & Co.
New York, NY, United States
about 1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Compensation
$171,000.0 - $260,000.0
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Artificial Intelligence Amazon Web Services Automation of Tests Cloud Engineering Code Review Databases Continuous Integration Software Debugging DevOps Distributed Systems Software Engineering
+9 more
Software Systems Workflow Management Systems GitHub Copilot Large Language Models IT Architecture Cloudformation Information Technology Api Design Terraform

Job description

When you mentor and advise multiple technical teams and move financial technologies forward, it’s a big challenge with big impact. You were made for this., * Provide overall direction, oversight, and coaching for a team of mid-level software engineers delivering AI-enabled capabilities across the ProductGPT ecosystem, spanning basic to moderately complex tasks, and evolving toward more advanced agentic and workflow-based solutions

  • Lead with a hands-on mindset: stay close to design and implementation, unblock delivery, and drive engineering excellence through code reviews, architecture guidance, and pragmatic decision-making
  • Be accountable for decisions that influence teams’ resources, budget, tactical operations, and the execution and implementation of processes and procedures, especially as priorities shift in a fast-moving AI domain
  • Establish and iterate on AI development strategies for use-case delivery, including LLM integration approaches, evaluation strategies, prompt/context management, orchestration patterns, and safe deployment practices
  • Ensure successful collaboration across teams and stakeholders in multiple locations, partnering closely with product team representation to align on outcomes, milestones, tradeoffs, and sequencing
  • Manage and prioritize multiple concurrent requests and initiatives, balancing near-term delivery with platform health, operational readiness, and long-term technical direction
  • Drive cloud-native engineering practices leveraging AWS services and modern data/storage patterns, ensuring solutions are scalable, observable, secure, and cost-aware
  • Promote strong engineering fundamentals across the stack, including API design, data modeling, resiliency, testing discipline, CI/CD, and operational excellence
  • Identifies and mitigates issues to execute a book of work while escalating issues as necessary
  • Provides input to leadership regarding budget, approach, and technical considerations to improve operational efficiencies and functionality for the team
  • Creates a culture of diversity, opportunity, inclusion, and respect for team members and prioritizes diverse representation

Requirements

Do you have experience in Technology management?, * Formal training or certification on Software Engineering concepts and 5+ years applied experience. In addition, 2 + years of experience leading technologists to manage and solve complex technical items within your domain of expertise.

  • Experience leading teams of technologists.
  • Ability to guide and coach teams on approach to achieve goals aligned against a set of strategic initiatives
  • Strong software engineering foundation with hands-on experience building services in Java and Python, working with databases, and using modern integration patterns.
  • Working knowledge of AI/LLM-enabled application development, including prompt/context design, orchestration and agentic patterns, and evaluation/quality approaches.
  • Hands-on experience using AI coding assistants (e.g., GitHub Copilot, Claude Code, or firm-approved equivalents) to accelerate secure, high-quality development, test automation, and code review within enterprise guardrails.
  • Ability to set clear technical direction while remaining flexible and adaptive in a rapidly evolving problem space (e.g., AI-enabled product development).
  • Demonstrated experience partnering with product leaders and stakeholders to translate ambiguous requirements into actionable technical plans and measurable delivered results.
  • Experience hiring, developing, and recognizing talent, with a track record of building strong engineering culture and effective feedback mechanisms.
  • Practical cloud-native experience designing, deploying, and operating production systems on AWS.
  • Experience in Computer Science, Engineering, Mathematics, or a related field and expertise in technology disciplines.

Preferred qualifications, capabilities, and skills

  • Experience working at code level, including contributing to production-grade services, debugging complex issues, and setting engineering standards through exemplars.
  • Experience building AI-assisted and AI-native software systems, including LLM integration patterns, tool/skill design, retrieval/context enrichment, and agentic workflow orchestration.
  • Experience operating distributed systems in AWS (e.g., compute, storage, messaging, observability), with a track record of reliability and cost-aware scaling
  • Experience balancing delivery across multiple concurrent initiatives while managing dependencies across teams and stakeholder groups.
  • Experience with cloud-native DevOps practices, including CI/CD pipelines, infrastructure as code (e.g., Terraform, CloudFormation), and automated testing in distributed environments.

Benefits & conditions

Pulled from the full job description

  • Tuition reimbursement
  • Health insurance
  • Retirement plan, We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.

About the company

Chase is a leading financial services firm, helping nearly half of America’s households and small businesses achieve their financial goals through a broad range of financial products. Our mission is to create engaged, lifelong relationships and put our customers at the heart of everything we do. We also help small businesses, nonprofits and cities grow, delivering solutions to solve all their financial needs.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:13 min

Enhancing personal developer productivity with AI tools

Eric Bowman Eric Bowman · WWC Europe 2026

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · WWC Europe 2026

1:34 min

Essential commands for running and testing Terraform configurations

Hennie Francis · LIVE

3:04 min

Database evolution and the funding behind vector databases

Erik Bamberg · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:18 min

Scaling global network engineering through DevOps culture

Stuart Clark · LIVE

Videos

See all

Related articles

See all