> Markdown version of [/jobs/ext/3015655-remote](https://www.wearedevelopers.com/jobs/ext/3015655-remote). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Remote - **Company:** MAG 24 LLC - **Location:** New York, NY, United States (Remote available) - **Experience:** Experienced - **Salary:** $62,400.0 - $166,400.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Spreadsheets, Intelligence Analysis - **Published:** September 20, 2026 - **Apply:** https://www.careerjet.com/jobad/usb1de277d8c9a4a5829d769b0d4f1d551 ## About the Role * Active Series 7/63 licence or relevant international equivalent is strongly preferred * Minimum 4 years of experience at a brokerage, bank, trading platform, or comparable financial institution * Strong exposure to securities, commodities, trading, or compliance-driven workflows * Direct experience executing or supporting financial-market transactions * Client advisory experience is highly valuable * Strong market judgement and ability to interpret complex financial data * Familiarity with regulatory, compliance, and client documentation * Excellent written and verbal communication skills * Experience designing analytical tasks, benchmarks, or detailed grading rubrics is advantageous * Strong attention to detail and ability to work independently * No prior AI-training or model-evaluation experience is required ## Description We are sharing a specialised consulting opportunity for experienced securities and commodities professionals with strong expertise in brokerage or trading workflows, client advisory, market judgement, compliance-sensitive decision-making, and financial documentation to contribute to an advanced AI benchmark and evaluation project. Selected professionals will design realistic evaluation tasks reflecting complex securities and commodities workflows, interpret financial and regulatory materials, define defensible market or advisory actions, and create detailed grading frameworks for AI evaluation. No prior experience in AI is required., Market, Trading & Advisory Task Design * Develop realistic benchmark tasks covering brokerage, trading, client advisory, and securities or commodities workflows * Interpret market data, client information, and financial documentation * Design scenarios requiring substantive market judgement and multi-step reasoning * Evaluate trading or advisory decisions against available evidence * Define clear objectives, constraints, expected outcomes, and defensible actions Compliance, Documentation & Source Analysis * Incorporate relevant regulatory and compliance considerations into task design * Identify compliance-sensitive decision points and distinguish substantive issues from operational errors * Review client documentation, regulatory references, spreadsheets, CSV files, PDFs, and market data * Build scenarios requiring synthesis across multiple information sources * Ensure supporting materials are internally consistent and sufficient for objective evaluation Benchmark Development & Quality Review * Create comprehensive grading rubrics with 35+ evaluation items * Define criteria for market judgement, compliance awareness, client communication, and decision quality * Distinguish critical failures from partial or acceptable responses * Review tasks for ambiguity, unrealistic assumptions, or missing information * Verify expected answers, decision logic, and supporting materials * Collaborate with technical teams to refine benchmark tasks and explain domain-specific requirements, Engagement Details * Independent contractor engagement * Fully remote * Displayed compensation range: $30-$80/hour * Actual compensation structure is output-based, with payment made per task that meets project specifications * Task completion time may vary depending on experience and workflow * Minimum weekly submission requirements apply; the source does not specify the exact number of required tasks * Work may involve securities and commodities markets, client advisory, market analysis, compliance reasoning, regulatory documentation, benchmark development, and AI evaluation * Contributors may work with CSV files, PDFs, spreadsheets, client documents, market data, and regulatory materials * Comprehensive grading rubrics of 35+ items may be required for individual tasks * Roles are typically filled within approximately 48 hours * Selected experts are expected to begin initial tasks within approximately 24-48 hours after onboarding * Project scope, financial topics, benchmark requirements, and evaluation standards may evolve depending on project needs * Work must be completed without using confidential, proprietary, personally identifiable, client-sensitive, material non-public, restricted, or otherwise protected information belonging to any employer, client, brokerage, financial institution, exchange, regulator, or other third party About the Platform This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams. By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy ## Related Videos - [Launching a marketplace on-time: A lesson in taking shortcuts using spreadsheets!](https://www.wearedevelopers.com/videos/477-launching-a-marketplace-on-time-a-lesson-in-taking-shortcuts-using-spreadsheets) - [Your First Pitch Is to AI: How to Make Your Brand/Product Visible in the Age of Generative Search](https://www.wearedevelopers.com/videos/100121-your-first-pitch-is-to-ai-how-to-make-your-brand-product-visible-in-the-age-of-generative-search) - [Edit Your Future: Queerverse Radical AI](https://www.wearedevelopers.com/videos/909-edit-your-future-queerverse-radical-ai) - [Agentic employees in world's most downloaded FinTech app](https://www.wearedevelopers.com/videos/100123-agentic-employees-in-world-s-most-downloaded-fintech-app) - [Angstfreude - AI and Corporate Culture - The Thrill and the Threat](https://www.wearedevelopers.com/videos/100354-angstfreude-ai-and-corporate-culture-the-thrill-and-the-threat) - [HR ROBO SAPIENS: Decoding AI Agents and Workflow Automation for Modern Recruitment](https://www.wearedevelopers.com/videos/1470-hr-robo-sapiens-decoding-ai-agents-and-workflow-automation-for-modern-recruitment) ## Related Articles - [13 AI Tools You Have to Try](https://www.wearedevelopers.com/magazine/219-13-ai-tools-you-have-to-try) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)