Staff Software Engineer (AI / LLM Platform)
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+1 more
Job description
· Enhance and scale existing AI agentic pipelines that support personalized user experiences across a large-scale SaaS platform
· Design, develop, and deploy production-grade LLM-based solutions using modern agentic frameworks
· Collaborate with cross-functional teams to translate product requirements into scalable technical implementations
· Contribute across the full software development lifecycle, from system design through deployment and optimization
· Work within a cloud-native architecture leveraging both AWS and Azure environments
· Partner with engineering leadership to drive best practices, improve system performance, and ensure reliability at scale, fr-original-style=”” style=”box-sizing: border-box; font-family: inherit; font-size: inherit;”>
</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">Job Title: Staff Software Engineer (AI / LLM Platform)
Location: Hoboken, NJ (hybrid -3x)</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">
</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">Responsibilities</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Enhance and scale existing AI agentic pipelines that support personalized user
experiences across a large-scale SaaS platform</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Design, develop, and deploy production-grade LLM-based solutions using modern agentic frameworks</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Collaborate with cross-functional teams to translate product requirements into scalable technical implementations</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Contribute across the full software development lifecycle, from system design through deployment and optimization</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Work within a cloud-native architecture leveraging both AWS and Azure environments</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Partner
Requirements
· 8-10+ years of professional software engineering experience, with a strong emphasis on backend development
· Hands-on, production-level experience building and deploying AI/LLM-based applications (agentic workflows required)
· Proficiency in Python and modern AI frameworks such as LangChain or LangGraph
· Experience working with multi-LLM systems, model fine-tuning, and real-world AI deployment challenges
· Strong experience with both AWS and Azure cloud platforms (AWS primary, Azure for AI/ML workloads)
· Ability to operate independently while collaborating effectively within a team environment
· Strong computer science fundamentals; a CS degree is highly preferred
Preferred Qualifications
· Experience with React for light frontend contributions (~10-15% of role)
· Familiarity with Java-based systems
· Exposure to vector databases such as Pinecone or similar technologies
· Cloud certifications (AWS and/or Azure) are a plus, · Must be authorized to work in the United States - no visa sponsorship available, with engineering leadership to drive best practices, improve system performance, and ensure reliability at scale</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">
</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">Required Skills & Experience</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· 8-10+ years of professional software engineering experience, with a strong emphasis on backend development</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Hands-on, production-level experience building and deploying AI/LLM-based applications (agentic workflows required)</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">·
Proficiency in Python and modern AI frameworks such as LangChain or LangGraph</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Experience working with multi-LLM systems, model fine-tuning, and real-world AI deployment challenges</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Strong experience with both AWS and Azure cloud platforms (AWS primary, Azure for AI/ML workloads)</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Ability to operate independently while collaborating effectively within a team environment</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Strong computer science fundamentals; a CS degree is highly preferred</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">
</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">Preferred Qualifications</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Experience with React for light frontend contributions (~10-15% of role)</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Familiarity with Java-based systems</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Exposure to vector databases such as Pinecone or similar technologies</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;">· Cloud certifications (AWS and/or Azure) are a plus</div><div fr-original-style="" style="box-sizing: border-box; font-family: inherit; font-size: inherit;"><br
Benefits & conditions
· Base Salary: $150,000 - $170,000 · Bonus: 15% annual performance bonus
About the company
We are seeking a Staff Software Engineer to join a product-focused engineering team building next-generation AI-driven platforms within the education technology space. This role will focus on enhancing and scaling agentic AI pipelines that power personalized learning experiences for higher education users. This is a full-time position based in the U.S. with a hybrid schedule in Northern New Jersey. The ideal candidate has strong backend engineering fundamentals combined with hands-on experience delivering production-grade AI/LLM solutions. U.S. work authorization is required. No visa sponsorship is available at this time.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
How to Become an AI Engineer
Are Software Engineer Wages Being Pushed Down? A Report on Tech Salaries
Dev Digest 121 - AI goes offline
Is Software Engineering Over-Saturated?