AI / ML Engineer

Nelnet
Madison, WI, United States
4 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Compensation
$95,000.0 - $130,000.0
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services Amazon S3 Application Frameworks Automation of Tests Computer Programming Continuous Integration Data Security Python (Programming Language) Machine Learning Regression Testing
+18 more
Software Engineering Data Streaming Systems Integration Workflow Management Systems Retrieval-Augmented Generation Large Language Models Multi-Agent Systems Containerization Kubernetes Infrastructure Automation Frameworks Information Technology Low Latency Deployment Automation AWS Fargate Machine Learning Operations Terraform Automation Anywhere Docker

Job description

As an AI / ML Engineer at Nelnet, you’ll be at the intersection of applied AI and software engineering. Your primary focus will be twofold: keeping our existing fleet of deployed agents healthy, evaluated, and improving over time, and designing new agentic capabilities that extend what those systems can do. Beyond building, you’ll help expand the agentic approach across the organization, partnering with business stakeholders to identify high-value use cases, establishing reusable patterns and guardrails, and raising the bar for how teams evaluate and ship AI systems. You’ll collaborate closely with Data Scientists, Product, Software Engineers, and business partners to move solutions from concept to production., 1. Agent Development : Design, build, and deploy LLM-powered agents to solve concrete business problems. This includes tool use, multi-step reasoning, orchestration, and human-in-the-loop patterns.

  1. Operating the Existing Fleet : Own the day-to-day health of agents already in production: monitor behavior, diagnose failures, tune prompts and tooling, and manage model and dependency upgrades without regressing quality.

  2. Evaluation : Build and maintain evaluation suites for agent systems, including offline test sets, LLM-as-judge scoring, regression testing, and online metrics.

  3. Observability and Monitoring : Instrument agents end to end, including traces, tool calls, token usage, latency, cost, and outcome quality and act on what the data shows.

  4. Context and Retrieval Engineering : Design retrieval and context strategies (RAG, structured data access, caching, chunking, ranking) that give agents the right information at the right time.

  5. Tooling and Integrations : Build and maintain the tools, APIs, and connectors agents rely on, ensuring safe and reliable interaction with internal systems and data.

  6. Scalability and Infrastructure : Design and implement scalable AI pipelines and services on AWS, using infrastructure as code (Terraform) and CI/CD to automate deployment and maintenance.

  7. Guardrails and Responsible AI : Implement safety controls, input/output validation, access boundaries, and audit trails appropriate to a regulated environment.

  8. Expanding Agentic Adoption : Partner with teams across the organization to identify where agents add real value, prototype quickly, and turn one-off wins into reusable frameworks and standards.

  9. Documentation : Maintain clear documentation of agent architectures, prompts, tool contracts, data flows, evaluation results, and known limitations.

  10. Innovation : Track the fast-moving foundation model and agent tooling landscape, and bring what’s genuinely useful into our stack.

  11. Mentorship : Provide guidance to team members on agent design, evaluation practices, and applied AI best practices.

Requirements

This posting covers multiple levels within the AI / ML Engineer role. We are currently seeking candidates at the equivalent of a Level I or II AI / ML Engineer. The responsibilities and qualifications below describe the full scope of the role; expectations for depth, autonomy, and scope of ownership will vary by level. Level and corresponding compensation are determined during the interview process based on demonstrated experience. We encourage you to apply if you meet the core qualifications, even if you don’t match every item listed., 1. Strong programming skills in Python.

  1. Working knowledge of AWS services for AI workloads (e.g., Bedrock, Lambda, ECS/Fargate, S3, OpenSearch, Step Functions).

  2. Familiarity with agent frameworks and orchestration tooling, and sound judgment about when a framework helps versus when to build directly.

  3. Practical prompt and context engineering skill, with an evaluation-driven approach to improving them.

  4. Experience with infrastructure as code (IaC) tools like Terraform.

  5. Proficiency using CI/CD pipelines to automate testing and deployment of AI workflows.

  6. Experience with containerization technologies like Docker and orchestration tools like Kubernetes.

  7. Solid grounding in machine learning fundamentals and statistical reasoning, sufficient to evaluate systems rigorously and know when a non-LLM approach is the better answer.

  8. Excellent problem-solving skills and the ability to work in a collaborative environment.

  9. Strong critical thinking, analytical, and quantitative problem-solving ability.

  10. Strong organization, time management, and coordination skills to drive projects to completion.

  11. Ability to communicate AI capabilities and limitations clearly to non-technical stakeholders.

  12. Ability to lead end-to-end development of new products.

Nelnet believes in a hybrid work environment that accommodates both in-office and remote work. This model promotes a positive work-life balance and culture, enabling in-person collaboration when possible while also providing benefits associated with remote work. The standard hybrid work schedule includes a 24/16 hour (in-office/work-from-home) split for associates that reside within 30 miles of an office. This is subject to change, based on manager discretion., * Bachelor’s or Master’s degree in Computer Science, Machine Learning, Artificial Intelligence, or a related field (or equivalent experience).

  • U.S. Citizenship AND the ability to obtain a U.S. 6C Security Clearance.

  • Minimum of 2 years of experience in machine learning engineering, AI engineering, software engineering, or related roles.

  • Demonstrated experience building agentic systems with large language models. Examples include tool calling, orchestration, multi-step workflows - not just single-turn prompting.

  • Hands-on experience evaluating LLM and agent systems, including designing eval sets and interpreting results to drive iteration.

  • Experience deploying and supporting AI or ML systems in production environments.

  • Experience with retrieval-augmented generation and other approaches to grounding models in enterprise data.

About the company

Nelnet is a diversified and innovative company committed to enriching lives through the power of service as a student loan servicer, professional services company, consumer loan originator and servicer, payments processor, renewable energy solutions, and K-12 and higher education expert. For over 40 years, Nelnet has been serving its customers, associates, and communities.

The perks of working at Nelnet go beyond our benefits package. When you join the Nelnet team, you’re part of a community invested in the success of each individual. That support comes through in our work, as we are united by our mission of creating opportunities for people where they live, learn, and work.

At Nelnet, we believe in the transformative power of data and technology to drive business innovation. Our AI / ML Engineer role sits at the center of that work: building, operating, and scaling the AI agents that automate processes, surface insights, and help our teams make better decisions faster. If you’re passionate about taking agentic systems from prototype to dependable production capability, we invite you to join our team and help shape how AI gets used across our business., Nelnet is a Drug Free and Tobacco Free Workplace.

Use of Artificial Intelligence in Hiring

We may use automated or artificial intelligence enabled tools to assist with the initial review of applications, such as identifying relevant skills or experience. These tools are used to support human review and do not make hiring decisions. A recruiter reviews applications and determines which candidates move forward in the hiring process. For more information, see our Privacy Policy and Pre-Use Notice: Automated Tools in Hiring

You may know Nelnet as the nation’s largest student loan servicer - but we do more than that. A lot more. We’re also a professional services company, consumer loan originator and servicer, payment processor, renewable energy innovator, and K-12 and higher education expert (and that’s just a shortlist). For over 40 years, we’ve been serving our customers, associates, and communities to make dreams possible.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.juju.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · WWC 2025

3:43 min

The enduring legacy of the amazon S3 storage API

Chris Heilmann +3 · LIVE

1:34 min

Essential commands for running and testing Terraform configurations

Hennie Francis · LIVE

2:14 min

Exploring internal AI product initiatives and global engineering roles

Maria Apazoglou · Coffee With Developers

2:34 min

Docker sandbox architecture and microVM environment integration

Manuel de la Peña Manuel de la Peña · WWC Europe 2026

2:08 min

Essential engineering roles in the generative AI space

Mary Grygleski Mary Grygleski · LIVE

Videos

See all

Related articles

See all