Prompt Systems Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+13 more
Job description
Design, test, deploy, and continuously improve prompts and system instructions for AI agents supporting enrollment, learning, and student success. Build evaluation frameworks, monitor production performance with observability tools, conduct red-team testing, manage prompt versioning, and collaborate with engineers, product managers, learning designers, faculty, and university stakeholders. Translate educational and operational requirements into reliable agent behavior across RAG, multi-turn, voice, and multimodal experiences. The summary above was generated by AI Noodle is higher education’s leading strategy, services, and technology partner. We develop infrastructure, provide life-changing learning experiences, and grow the awareness of and the enrollment in some of the best academic institutions in the world. Our vision is “to empower universities to change the world.” We achieve this vision by offering our university partners various products and services that help them be more resilient, responsive, efficient, and interconnected.
We’re looking for a Prompt Systems Engineer to sit at the intersection of AI capability and educational effectiveness. You will own the design, testing, and continuous improvement of the prompts and system instructions that power Noodle’s AI agents across enrollment, learning, and student support use cases.
This is a hands-on, high-impact role. You’ll work directly with product managers, learning designers, university stakeholders, and engineers to translate operational and pedagogical goals and business requirements into agent behavior - and you’ll build the evaluation frameworks to prove that behavior is working.
As a Prompt Systems Engineer, you will: Prompt Design & Engineering
- Write, iterate, and maintain system prompts and instruction sets for Noodle’s AI agents focused on students enrollment, learning, and retention
- Translate complex educational and operational requirements into clear, reliable agent behavior - including persona definition, tone, scope constraints, fallback handling, and multi-turn conversation logic
- Design prompt architectures for multi-step and chained agent workflows, including RAG-augmented agents that draw from program-specific knowledge bases
- Collaborate with the engineering team to configure and deploy agents through Noodle’s AI orchestration platform, including primary prompts, secondary context, knowledge base attachments, and embed definitions
- Create the learner experiences defined by “three-way” chat between the learner, a campus or Noodle support staff member, and that staff member’s AI assistant Evaluation & Quality
- Build and maintain evaluation frameworks to measure agent accuracy, tone, hallucination rate, task completion, and alignment with rubric-based learning objectives
- Use Langfuse (Noodle’s LLM observability platform) to monitor prompt performance in production, identify regressions, and prioritize prompt improvements
- Design red-teaming and adversarial testing protocols to surface edge cases and failure modes before agents reach students
- Establish prompt versioning practices and maintain a library of tested, reusable prompt components
- Collaboration & Enablement
- Partner with Noodle teammates and university stakeholders to design, build, and test agents - translating learning objectives, operational flows, rubric assessments, and more into prompt-level agent instructions
- Work with enrollment and student success teams to tune companion agents for specific programs and university partner contexts
- Contribute prompt engineering guidelines and best practices documentation for internal teams who configure their own agents on Noodle’s AI orchestration platform
- Stay current with model capability changes across OpenAI, Anthropic, and other providers integrated into Noodle’s stack, and proactively surface opportunities or risks
- Perform other duties as assigned, Lead customer implementations of SOPHiA GENETICS genomic analysis solutions, from planning and sample selection through configuration, training, adoption, and issue resolution. Manage MaxCare Program schedules, timelines, sampling strategies, Statements of Work, technical setup, and cross-functional delivery. Translate laboratory, bioinformatics, data, and clinical regulatory requirements into practical solutions while building trusted customer relationships. The field-based US role includes approximately 30% travel. Top Skills: BioinformaticsCustom ReportingFederated Sso AuthenticationLibrary PreparationNext-Generation SequencingSophia Ddm Platform PNC Bank
Software Engineer
2 Hours Ago Remote or Hybrid USA 75K-150K Annually Junior 75K-150K Annually Junior Machine Learning * Payments * Security * Software * Financial Services Develops, tests, deploys, maintains, and debugs software across the full project lifecycle. Translates business requirements into technical designs, supports production systems, documents solutions, estimates development tasks, collaborates with teammates, and mentors newer developers. The role requires application architecture, SDLC, testing, troubleshooting, and maintenance experience using Java, .NET, and/or Delphi, with Delphi preferred. Top Skills: .NetDelphiJava PNC Bank
Senior Software Engineer
2 Hours Ago Remote or Hybrid USA Senior level Senior level Machine Learning * Payments * Security * Software * Financial Services Designs, develops, tests, deploys, maintains, and debugs software solutions. Leads complex technical initiatives, Java microservices and API integration, OpenShift deployments, server and database administration, release management, production support, vulnerability remediation, incident resolution, and vendor coordination. Supports remote deposit platforms while managing application resiliency, security compliance, documentation, and stakeholder communication. Top Skills: AgileAPIsCandescent Remote Deposit/CaptureCloud-Native ArchitecturesConnect:DirectContainerizationDevOpsJavaLinuxMicroservicesMicrosoft Sql ServerOpenshift Container PlatformPowershellPythonSdlcShell ScriptingWindows Server
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
Requirements
- 2+ years of experience designing and iterating on prompts for LLM-powered applications in a production environment
- Deep familiarity with prompt patterns: few-shot examples, chain-of-thought, system vs. user roles, output formatting constraints, tool-use prompting, and RAG integration
- Strong written communication - you can write clearly, precisely, and persuasively, because that’s the core of the job
- Experience building and running prompt evaluations: defining metrics, writing test cases, and interpreting results to make improvement decisions
- Comfort working across disciplines - you can hold a conversation with an engineer about context windows and with a faculty member about Bloom’s Taxonomy
- Experience with LLM observability tools (Langfuse, Weights & Biases, or similar)
- Familiarity with LTI (Learning Tools Interoperability) and how AI tools plug into LMS platforms like Moodle, Canvas, or Instructure
- Experience with voice agents or multimodal prompting
- Comfort reading and writing basic code (JavaScript, Python) to support prompt automation and testing pipelines
- Knowledge of OpenAI, Anthropic, or other model provider APIs
- Ability to thrive in ambiguity and iterate quickly based on user feedback
- Ability to work effectively in dynamic, rapidly changing, team-based environment, This position is based in the United States, and applicants must be legally authorized to live and work in the United States. Employees are required to reside within the United States for the duration of their employment.
Benefits & conditions
- Work from our beautiful NYC office OR the comfort of your home office!
- Computer and charger on us!
- 401(k) with company match, plus equity opportunities
- Medical, dental, and vision insurance for you and your family (including mental health benefits like Headspace and Talkspace)
- Employer-paid life and disability insurance
- Optional voluntary coverage, including supplemental life, accident, critical illness, and hospital insurance
- Health Savings Account (HSA), Flexible Spending Accounts (FSA), and commuter benefits
- Pre-tax benefit options that help you save on eligible healthcare, dependent care, and commuting expenses
- Employee Assistance Program (EAP)
- Paid parental leave
- Wellness initiatives and resources
- Free subscription to the Calm app
- Employee discount program
- 4 weeks of paid vacation + 10 paid holidays + paid sick leave
- Monthly mobile connectivity stipend
- Annual education stipend for lifelong learning
- Growth opportunities - we pride ourselves on creating environments where employees can be themselves and grow within and around the company, Noodle is committed to creating a welcoming and inclusive workplace for everyone. We value and celebrate our differences because those differences are what make our team shine. We hire great people from different backgrounds, not just because it’s the right thing to do, but because it makes us stronger as a whole. Women, people of color, LGBTQIA2S+ individuals, and members of other underrepresented groups are strongly encouraged to apply. Noodle is an equal opportunity employer and does not discriminate against candidates on the basis of race, ethnicity, religion, sex, gender, sexual orientation, gender identity, disability status, or veteran status.
About the company
At Noodle, we hire people who will help us change the future of online education. Even if you don’t think you check off every bullet point on this list, we still encourage you to apply! We value both current experience and future potential.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Prompt Engineering is a Job of the Past
What Are Large Language Models?
Dev Digest 171: AI in disguise, Doomed tech and system prompts
How to Bypass ChatGPT’s Filter With Examples