Software Engineer AI/ML QA Engineer

We are seeking a Software Engineer / AI/ML QA Engineer with strong experience in QA automation, Salesforce, AI/ML, and Generative AI testing. The ideal candidate will have hands-on experience testing LLMs, RAG applications, prompts, ML models, APIs, chatbots, and AI-powered workflows, along with strong Selenium/BDD automation, SQL, and Oracle skills., * Test and validate AI/ML and Generative AI applications, including LLM responses, prompts, model predictions, and end-to-end workflows.

• Develop test strategies for AI-powered applications and non-deterministic GenAI outputs.
• Perform manual, exploratory, API, UI, and automated testing for Salesforce and AI/ML applications.
• Develop and maintain automated test suites using Selenium, BDD, and related automation frameworks.
• Test Salesforce Einstein and integrations with external LLM/AI platforms.
• Validate RAG pipelines, embeddings, vector databases, ML pipelines, and intermediate data outputs.
• Evaluate AI applications for accuracy, relevance, hallucinations, bias, model drift, and safety.
• Write and execute complex SQL queries across multiple databases, with strong Oracle experience.
• Collaborate with Product Owners, Developers, Data Scientists, and Business stakeholders to define requirements and testing strategies.
• Participate in Agile ceremonies and maintain project documentation using Jira and Confluence.

• 3+ years of Software Engineering experience.
• 12 years of hands-on AI/ML/Generative AI project experience.
• 3+ years of Cloud experience with AWS, GCP, or another major cloud platform.
• Strong QA/Software Testing experience, including AI/ML outputs and chatbot responses.
• Strong hands-on experience with Selenium, BDD, and test automation.
• Experience with API, UI, manual, and automation testing.
• Strong SQL skills and experience with Oracle.
• Understanding of relational and non-relational databases.
• Understanding of data pipelines and ability to validate intermediate pipeline outputs.
• Experience working with Jira and Confluence.
• Bachelor’s degree required; technical degree preferred.

Nice to Have

• Experience with AWS Bedrock and/or SageMaker.
• Experience with AI/ML testing frameworks.

Lumen SolutionsGroupInc. is a technology consulting Services company based inFlorida. Weprovidea wide array of experienced business and IT professionals supporting clients from solution design to implementation and support.We specialize in professional IT consulting services, IT Staffing, Business/IT Strategy, Business Process Blueprints, Enterprise Architecture, and EnterpriseTransformation.