Staff Software Engineer (AI / LLM Platform)

TALENER GROUP
Hoboken, NJ, United States
about 2 months ago
Apply on talener.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$150,000.0 - $170,000.0
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Artificial Intelligence Amazon Web Services Microsoft Azure Software as a Service Cloud Computing Python (Programming Language) Software Deployment Software Engineering ReactJS Large Language Models Backend
+1 more
Front End Software Development

Job description

· Enhance and scale existing AI agentic pipelines that support personalized user experiences across a large-scale SaaS platform · Design, develop, and deploy production-grade LLM-based solutions using modern agentic frameworks · Collaborate with cross-functional teams to translate product requirements into scalable technical implementations · Contribute across the full software development lifecycle, from system design through deployment and optimization · Work within a cloud-native architecture leveraging both AWS and Azure environments · Partner with engineering leadership to drive best practices, improve system performance, and ensure reliability at scale, fr-original-style=”” style=”box-sizing: border-box; font-family: inherit; font-size: inherit;”>
</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">Job Title: Staff Software Engineer (AI / LLM Platform)
Location: Hoboken, NJ (hybrid -3x)</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">
</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">Responsibilities</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Enhance and scale existing AI agentic pipelines that support personalized user experiences across a large-scale SaaS platform</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Design, develop, and deploy production-grade LLM-based solutions using modern agentic frameworks</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Collaborate with cross-functional teams to translate product requirements into scalable technical implementations</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Contribute across the full software development lifecycle, from system design through deployment and optimization</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Work within a cloud-native architecture leveraging both AWS and Azure environments</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Partner

Requirements

· 8-10+ years of professional software engineering experience, with a strong emphasis on backend development · Hands-on, production-level experience building and deploying AI/LLM-based applications (agentic workflows required) · Proficiency in Python and modern AI frameworks such as LangChain or LangGraph · Experience working with multi-LLM systems, model fine-tuning, and real-world AI deployment challenges · Strong experience with both AWS and Azure cloud platforms (AWS primary, Azure for AI/ML workloads) · Ability to operate independently while collaborating effectively within a team environment · Strong computer science fundamentals; a CS degree is highly preferred Preferred Qualifications · Experience with React for light frontend contributions (~10-15% of role) · Familiarity with Java-based systems · Exposure to vector databases such as Pinecone or similar technologies · Cloud certifications (AWS and/or Azure) are a plus, · Must be authorized to work in the United States - no visa sponsorship available, with engineering leadership to drive best practices, improve system performance, and ensure reliability at scale</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">
</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">Required Skills & Experience</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· 8-10+ years of professional software engineering experience, with a strong emphasis on backend development</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Hands-on, production-level experience building and deploying AI/LLM-based applications (agentic workflows required)</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Proficiency in Python and modern AI frameworks such as LangChain or LangGraph</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Experience working with multi-LLM systems, model fine-tuning, and real-world AI deployment challenges</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Strong experience with both AWS and Azure cloud platforms (AWS primary, Azure for AI/ML workloads)</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Ability to operate independently while collaborating effectively within a team environment</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Strong computer science fundamentals; a CS degree is highly preferred</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">
</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">Preferred Qualifications</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Experience with React for light frontend contributions (~10-15% of role)</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Familiarity with Java-based systems</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Exposure to vector databases such as Pinecone or similar technologies</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Cloud certifications (AWS and/or Azure) are a plus</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;"><br

Benefits & conditions

· Base Salary: $150,000 - $170,000 · Bonus: 15% annual performance bonus

About the company

We are seeking a Staff Software Engineer to join a product-focused engineering team building next-generation AI-driven platforms within the education technology space. This role will focus on enhancing and scaling agentic AI pipelines that power personalized learning experiences for higher education users. This is a full-time position based in the U.S. with a hybrid schedule in Northern New Jersey. The ideal candidate has strong backend engineering fundamentals combined with hands-on experience delivering production-grade AI/LLM solutions. U.S. work authorization is required. No visa sponsorship is available at this time.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on talener.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:21 min

Exploring the target application for front end tests

Anna Mcdougall · JS Congress

1:52 min

Structuring and scaling the backend engineering team

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

1:06 min

Outline of free tools for Microsoft Azure

Radu Vunvulea Radu Vunvulea · World Congress 2022

2:37 min

Optimizing technical profiles for AI sourcing and recruitment

Mina Golesorkhi Mina Golesorkhi · World Congress 2026 Europe

2:59 min

Introduction and transitioning into the tech industry

Anna Mcdougall · JS Congress

2:08 min

Essential engineering roles in the generative AI space

Mary Grygleski Mary Grygleski · LIVE

Videos

See all

Related articles

See all