Ai Engineer Mid Level

Vega Consulting Solutions
Baltimore, MD, United States
7 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
1 year minimum
Working hours
Regular working hours
Job source

Tech stack

Testing (Software) Agile Methodology Artificial Intelligence Amazon Web Services Application Testing Confluence JIRA Cloud Computing Relational Databases Database Connection Database Queries Machine Learning
+8 more
Azure Machine Learning Requirements Management Selenium Cloud Platform System Large Language Models Generative AI AI Platforms Data Pipelines

Job description

Mid Level Ai Engineer to Conduct deep technical analysis and testing of AI/ML and Generative AI systems, including validation and verification of model outputs, prompt behavior, and end-to-end application workflows.

Requirements

  • ML concepts and GEN AI concepts
  • 3+ years of relevant testing experience with a strong background in Software QA with cloud technologies, including 3+ years of experience with hands-on exposure to AI/ML application testing.
  • 2+ years of relational database experience including generating complex queries, setting up database connections, and automating query processing, with familiarity in querying ML feature stores or data pipelines.
  • Experience in automated and manual testing in cloud environments, particularly for AI/ML and Gen AI applications, including validation of model outputs, embeddings, and LLM-generated responses.
  • Experience designing test strategies for non-deterministic systems, including techniques for evaluating accuracy, relevance, and safety of Gen AI outputs.
  • 1+ years of experience with BDD/Selenium and automation tools, with a plus for experience in AI testing frameworks.
  • Experience using Agile team collaboration and requirements management tools (Jira, Confluence).
  • Excellent written and oral communication skills and problem-solving abilities, with the ability to clearly articulate AI/ML testing findings to both technical and non-technical stakeholders.
  • Strong aptitude to learn and adapt to emerging AI/ML technologies and evolving Gen AI tooling.
  • Familiarity with AWS AI/ML services (SageMaker, Bedrock) or equivalent cloud AI platforms is a plus.
  • Bachelor’s degree required; technical degree preferred.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:33 min

Expanding enterprise search integrations with Jira, Confluence, and GitHub

Prashanth Chandrasekar Prashanth Chandrasekar · World Congress 2024

3:05 min

Integrating an assistant application with Jira software

Felix Augenstein · LIVE

2:35 min

Selecting Selenium for browser automation and testing

Benjamin Bischoff Benjamin Bischoff · Europe 2026 Virtual

2:06 min

Elevating the QA engineering role for complex challenges

Ondřej Gróf Ondřej Gróf · World Congress 2026 Europe

5:47 min

Integrating user stories and test automation via Jira tools

Christoph Ruggenthaler · LIVE

1:34 min

Transitioning from traditional software development to artificial intelligence consulting

Patrick Schnell Patrick Schnell · Coffee With Developers

Videos

See all

Related articles

See all