Senior Data Scientist III - AI Assurance Researcher
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
Job description
PNNL is seeking a deep learning researcher to investigate how AI models learn and make decisions, and to develop methods for assessing and improving their reliability. You will connect internal representations and computations to observable behavior, using those findings to explain model decisions and examine how uncertainty, changing conditions, or adversarial inputs affect the reliability of model outputs.
At PNNL, your research will address national security and safety needs. You will have opportunities to collaborate across the U.S. government and develop and pursue new research ideas that advance AI Assurance and address mission needs.
You will lead research projects or major parts of larger efforts, develop research questions and methods, and mentor colleagues while remaining hands-on in experimental research. Relevant experience may include research on deep learning fundamentals, such as optimization, representations, or generalization., * Lead research projects or major parts of larger efforts, coordinating the technical approach, team contributions, and research milestones.
- Formulate research questions, develop or adapt methods, and design and execute deep learning experiments, including large-scale experiments on high-performance computing (HPC) infrastructure as appropriate.
- Investigate how model architectures, training dynamics, and internal computations shape behavior, using findings from systems such as large language and vision models to explain observed capabilities and failure modes.
- Develop methods to quantify uncertainty and assess robustness under distribution shifts or adversarial inputs, using red and blue teaming to identify vulnerabilities and evaluate defensive methods.
- Develop reproducible evaluations to investigate model reliability and failure modes, compare methods against appropriate baselines, and communicate findings, uncertainty, and limitations.
- Develop reproducible research code and collaborate with engineers to translate findings and prototypes into useful tools and capabilities.
- Lead the preparation of publications, technical reports, and presentations that communicate the teamβs findings.
- Mentor researchers and engineers through technical discussions, feedback, and collaborative research.
- Develop research ideas and contribute to proposals with collaborators.
- Conduct work in secure environments in accordance with operational security requirements.
Requirements
- BS/BA and 5+ years of data science experience -OR-
- MS/MA and 3+ years of data science experience -OR-
- PhD with 1+ year of data science experience
- Experience conducting deep learning research to investigate how models learn, behave, or generalize.
- Experience using Python and PyTorch for deep learning research., * Experience explaining model behavior through analysis of internal representations and computations, including mechanistic interpretability of large language or vision models.
- Experience developing or evaluating methods to assess tool-using models and multi-step agentic workflows, including analysis of execution traces, task outcomes, and failure modes.
- Experience designing and executing large-scale deep learning experiments.
- Experience leading research projects or major technical efforts, including formulating research questions, developing or adapting methods, coordinating contributors, and evaluating and communicating results.
- Experience translating research prototypes into tools or capabilities or contributing peer-reviewed publications or other technical contributions in relevant research areas.
- Experience supporting national security missions.
Hazardous Working Conditions/Environment
Not Applicable
Additional Information
This position requires the ability to obtain and maintain a federal security clearance.
A security clearance background investigation includes review of your employment, education, financial, and criminal history, as well as interviews with you and your personal references, neighbors, and co-workers to determine trustworthiness, reliability, and loyalty to the United States. The investigation also examines your foreign connections, drug and alcohol use, foreign influence, and overall conduct., * U.S. Citizenship
- Background Investigation: Applicants selected will be subject to a Federal background investigation and must meet eligibility requirements for access to classified matter in accordance with 10 CFR 710, Appendix B.
- Drug Testing: All Security Clearance positions are Testing Designated Positions, which means that the applicant selected for hire is subject to pre-employment drug testing, and post-employment random drug testing. In addition, applicants must be able to demonstrate non-use of illegal drugs, including marijuana, for the 12 consecutive months preceding completion of the requisite Questionnaire for National Security Positions (QNSP).
Note: Applicants will be considered ineligible for security clearance processing by the U.S. Department of Energy if non-use of illegal drugs, including marijuana, for 12 months cannot be demonstrated.
Benefits & conditions
PNNL lists the full pay range for the position in the job posting. Starting pay is calculated from the minimum of the pay range and actual placement in the range is determined based on an individualβs relevant job-related skills, qualifications, and experience. This approach is applicable to all positions, with the exception of positions governed by collective bargaining agreements and certain limited-term positions which have specific pay rules.
As part of our commitment to fair compensation practices, we do not ask for or consider current or past salaries in making compensation offers at hire. Instead, our compensation offers are determined by the specific requirements of the position, prevailing market trends, applicable collective bargaining agreements, pay equity for the position type, and individual qualifications and skills relevant to the performance of the position.
Minimum Salary
USD $140,200.00/Yr.
Maximum Salary
USD $228,800.00/Yr.
About the company
At PNNL, our core capabilities are divided among major departments that we refer to as Directorates within the Lab, focused on a specific area of scientific research or other function, with its own leadership team and dedicated budget.
Our Science & Technology directorates include National Security, Earth and Biological Sciences, Physical and Computational Sciences, and Energy and Environment. In addition, we have an Environmental Molecular Sciences Laboratory, a Department of Energy, Office of Science user facility housed on the PNNL campus.
The National Security Directorate (NSD) drives science-based, mission-focused solutions to take on complex, real-world threats to our nation and the world.
The AI and Data Analytics Division, part of the National Security Directorate, combines profound domain expertise and creative integration of advanced hardware and software to deliver computational solutions that address complex data and analytic challenges. Working in multidisciplinary teams, we connect foundational research to engineering to operations, providing the tools to innovate quickly and field results faster. Our strengths are integrated across the data analytics lifecycle, from data acquisition and management to analysis and decision support., Pacific Northwest National Laboratory (PNNL), is a world-class research institution powered by a highly educated, diverse workforce committed to the values of Integrity, Creativity, Collaboration, Impact, and Courage. Every year, scores of dynamic, driven people come to PNNL to work with renowned researchers on meaningful science, innovations and outcomes for the U.S. Department of Energy and other sponsors; here is your chance to be one of them!
At PNNL, you will find an exciting research environment and excellent benefits including health insurance, and flexible work schedules. PNNL is located in eastern Washington State-the dry side of Washington known for its stellar outdoor recreation and affordable cost of living. The Labβs campus is only a 45-minute flight (or ~3 hour drive) from Seattle or Portland, and is serviced by the convenient PSC airport, connected to 8 major hubs., Please be aware that the Department of Energy (DOE) prohibits DOE employees and contractors from having any affiliation with the foreign government of a country DOE has identified as a βcountry of riskβ without explicit approval by DOE and Battelle. If you are offered a position at PNNL and currently have any affiliation with the government of one of these countries, you will be required to disclose this information and recuse yourself of that affiliation or receive approval from DOE and Battelle prior to your first day of employment.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦