WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Mid-Level AI Software Engineer [$259k/yr+] TS/SCI-FS Poly

SYSTOLIC, INC.
Annapolis Junction, MD, United States
16 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
7 years minimum
Compensation
$259,000.0
Working hours
Regular working hours
Job source
www.clearancejobs.com

Tech stack

Testing (Software) Artificial Intelligence Confluence JIRA Data Visualization Python (Programming Language) Machine Learning MongoDB Software Engineering Git Virtual Agents

Job description

  • Design and implement AI model and agentic AI benchmarks.
  • Curate evaluation datasets and analyze performance metrics.
  • Utilize Python, MongoDB, Git, Jira, Confluence, and data visualization tools to support software engineering efforts., * Design, implement, and maintain benchmark suites that measure AI model performance against defined evaluation criteria, including dataset curation, scoring, and results reporting.
  • Develop benchmarks and test scenarios that evaluate agentic workflows and multi-step task performance, including tool-use, task completion, and reliability metrics.
  • Curate, validate, and version evaluation datasets and test scenarios, including adversarial or edge-case sets needed to stress agent behavior.
  • Produce scoring frameworks, visualizations, and written analyses that translate raw evaluation results into actionable findings for stakeholders.
  • Apply key skills including Agentic AI, Software Development, Software Testing, Python, MongoDB, Git, JIRA, Confluence, Data Visualization, and Machine Learning/Artificial Intelligence.

Requirements

  • Degree: Technical bachelor’s degree or equivalent experience
  • Years of experience: 7+ years
  • Total Compensation: $259k+ yearly

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.clearancejobs.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

4:41 min

Scale and diversity of software development teams

Bastian Heilemann Bastian Heilemann +1 · WWC 2025

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

3:05 min

Integrating an assistant application with Jira software

Felix Augenstein · LIVE

2:01 min

Migrating existing applications from MongoDB to Postgres

Nikita Shamgunov Nikita Shamgunov · WWC 2024

2:37 min

Optimizing technical profiles for AI sourcing and recruitment

Mina Golesorkhi Mina Golesorkhi · WWC Europe 2026

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

Videos

See all
How a Small Team Shrank a Microsoft Monorepo by 94% thumbnail
33:23
Coffee With Developers • almost 2 years ago

How a Small Team Shrank a Microsoft Monorepo by 94%

Jonathan Creamer

Improving quality with Agentic AI with Rovo Dev and Xray thumbnail
51:27
Europe 2026 Virtual • about 1 month ago

Improving quality with Agentic AI with Rovo Dev and Xray

Sergio Freire

40 Minutes to Build a Serverless COVID-19 REST and GraphQL APIs thumbnail
47:16
WWC 2021 • about 5 years ago

40 Minutes to Build a Serverless COVID-19 REST and GraphQL APIs

Maxime Beugnet

Agentic employees in world's most downloaded FinTech app thumbnail
30:37
WWC Europe 2026 • about 1 month ago

Agentic employees in world's most downloaded FinTech app

Sasa Fajkovic

Git for Code Reviews thumbnail
24:19
WWC 2022 • about 4 years ago

Git for Code Reviews

Johannes Haux

Grappling With Clunky Old Software? Start by Understanding What’s Inside! thumbnail
30:23
WWC 2024 • almost 2 years ago

Grappling With Clunky Old Software? Start by Understanding What’s Inside!

Luc Perard

Related articles

See all