> Markdown version of [/jobs/ext/2043813-hybrid](https://www.wearedevelopers.com/jobs/ext/2043813-hybrid). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Hybrid - **Company:** Broadridge Financial Solutions, Inc. - **Location:** New York, NY, United States (Remote available) - **Experience:** Expert - **Salary:** $83,200.0 - $166,400.0 - **Contract:** Temporary contract - **Skills:** Artificial Intelligence, Large Language Models - **Published:** August 13, 2026 - **Apply:** https://www.careerjet.com/jobad/us6b7ac3d81b4ec9c6fcd05713b91e52da ## About the Role * Juris Doctor (JD) from an accredited law school * 5+ years of substantive post-qualification legal practice * Professional experience within an established law firm, corporate legal department, regulatory body, court, or comparable legal environment * Genuine specialisation in at least one substantive legal practice area * Relevant expertise may include corporate and transactional law, litigation, regulatory and compliance, intellectual property, employment and labour, or tax * Demonstrated progression to a senior legal position such as Partner, Of Counsel, Counsel, Senior Associate, Senior In-House Counsel, General Counsel, or comparable level * Active admission to at least one U.S. state bar and good standing * Direct ownership of significant legal matters, transactions, disputes, regulatory work, or advisory responsibilities * Hands-on professional experience using large language models or AI tools * Strong ability to distinguish rigorous legal reasoning from plausible but technically incorrect analysis * Excellent written communication and ability to provide precise, structured feedback * Must live in the San Francisco Bay Area and be able to attend occasional onsite sessions when required ## Description We are sharing a specialised full-time opportunity for experienced attorneys with deep expertise in a substantive legal practice area and the ability to evaluate, structure, and improve advanced AI systems working on real-world legal tasks. This role works closely with AI research and programme teams to improve how advanced models reason about professional legal work. Selected experts will review legal tasks and model outputs, develop instruction specifications and reference solutions, design challenging benchmarks, and translate senior-level legal judgement into clear, reproducible evaluation standards., Legal Quality Review & Analysis * Review legal knowledge-work tasks and AI-generated outputs for substantive accuracy and professional quality * Identify weak reasoning, missing considerations, unsupported conclusions, and answers that would not withstand professional legal scrutiny * Evaluate legal analyses for completeness, precision, and appropriate application of governing authority * Assess model performance across complex legal scenarios * Provide precise written feedback explaining errors and required improvements Instruction Design & Reference Solutions * Develop detailed instruction specifications for legal AI tasks * Produce high-quality reference solutions that establish clear standards for correct responses * Design tasks that accurately reflect how legal work is performed in professional practice * Translate experienced legal judgement into explicit and teachable evaluation criteria * Ensure reference materials demonstrate strong substantive depth and practical legal reasoning Benchmark & Evaluation Development * Design challenging legal benchmarks and evaluation sets * Create tasks that test substantive knowledge, analytical depth, issue spotting, and professional judgement * Develop evaluation criteria that distinguish rigorous legal reasoning from plausible but incomplete responses * Refine benchmarks based on model performance and research requirements * Help develop legal-specific evaluation capabilities, workflows, and tools Substantive Legal Expertise * Apply specialist knowledge from areas such as corporate and transactional law, litigation and dispute resolution, regulatory and compliance, intellectual property, employment and labour law, or tax * Evaluate complex legal problems using professional methodologies and applicable legal frameworks * Identify nuanced issues that may be missed by generalist reviewers * Contribute senior-level judgement grounded in substantive legal practice * Maintain high standards of analytical rigour across legal evaluation workflows AI Research Collaboration & Calibration * Collaborate with AI researchers, programme teams, and specialists across adjacent professional domains * Participate in calibration processes to maintain consistent evaluation standards * Apply hands-on experience with large language models to professional legal workflows * Distinguish genuinely well-reasoned outputs from responses that sound persuasive but are legally incorrect * Communicate complex legal concepts clearly to technical and non-legal stakeholders ## Related Videos - [Creating Industry ready solutions with LLM Models](https://www.wearedevelopers.com/videos/899-creating-industry-ready-solutions-with-llm-models) - [Coffee with Developers - Maria Apazoglou](https://www.wearedevelopers.com/videos/1209-coffee-with-developers-maria-apazoglou) - [Edit Your Future: Queerverse Radical AI](https://www.wearedevelopers.com/videos/909-edit-your-future-queerverse-radical-ai) - [Give Your LLMs a Left Brain](https://www.wearedevelopers.com/videos/1160-give-your-llms-a-left-brain) - [Event-Driven AI Agents: Orchestrating Long-Context Legal Processing at Scale](https://www.wearedevelopers.com/videos/100168-event-driven-ai-agents-orchestrating-long-context-legal-processing-at-scale) - [AI is dead, long live AK](https://www.wearedevelopers.com/videos/1093-ai-is-dead-long-live-ak) ## Related Articles - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [13 AI Tools You Have to Try](https://www.wearedevelopers.com/magazine/219-13-ai-tools-you-have-to-try) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)