A
Full Time Any

San Francisco, California · USA job

Legal Expert - AI Model Evaluation

Alpheva AI

San Francisco, California

Job description

Get paid to help build better AI.

Alpheva AI, the Silicon Valley company that is building intelligence behind frontier AI, is looking for experienced legal professionals to participate in paid, project-based work that helps train and evaluate the next generation of AI systems.

You work remotely and asynchronously on projects that fit around your existing schedule.

Your legal expertise becomes the signal that helps AI systems learn what accurate, rigorous, and professionally sound legal analysis actually looks like.

IMPORTANT: To be considered, Apply directly through: alpheva dot ai/experts/

What you'll do

Depending on the project, you may:

Analyze: Review legal questions, fact patterns, contracts, statutes, regulations, case law, and legal arguments.
Evaluate: Review AI-generated legal analysis, research, reasoning, summaries, and conclusions.
Validate: Determine whether AI-generated legal outputs are accurate, logically sound, properly supported, and consistent with applicable law.
Review: Assess contracts, legal documents, case analyses, legal research, compliance assessments, and other legal work.
Reason: Solve realistic legal problems and explain how an experienced legal professional would approach them.
Compare solutions: Assess multiple AI-generated legal solutions and identify meaningful differences in accuracy, reasoning, completeness, and professional judgment.
Create evaluations: Develop challenging legal tasks and criteria for measuring AI systems.
Provide expert judgment: Identify errors, unsupported claims, missing issues, incorrect interpretations, and weaknesses in AI-generated legal work.
Projects may involve legal research, contract analysis, corporate law, commercial law, litigation, regulatory compliance, intellectual property, employment law, privacy, tax law, real estate law, and other areas depending on your expertise.

Who we're looking for

We're looking for experienced legal professionals, not necessarily AI researchers.

You should have:

3+ years of professional experience in law, legal practice, legal research, compliance, or a related field
Strong legal reasoning and analytical skills
Experience working with real-world legal matters and documentation
Ability to evaluate legal analysis and conclusions critically
Strong attention to detail
Ability to identify errors, inconsistencies, unsupported claims, and missing legal issues
Strong professional judgment
Ability to clearly explain why a legal conclusion is correct or incorrect
Experience with any of the following is valuable:
Legal research and analysis
Contract drafting and review
Corporate and commercial law
Litigation and dispute resolution
Regulatory compliance
Intellectual property
Employment law
Privacy and data protection
Tax law
Real estate law
Legal operations or compliance
JD, LLB, LLM, bar admission, solicitor qualification, or equivalent legal qualification
You do not need prior experience working in AI.
What matters most is that you know how to do legal work well.

You might be asked to:

Review an AI-generated legal analysis and identify the issues.

Evaluate whether an AI's interpretation of a statute, regulation, or case is accurate.

Review a contract and assess whether an AI correctly identified important provisions, risks, or inconsistencies.

Compare two AI-generated legal analyses and determine which is stronger.

Evaluate whether legal reasoning is supported by the relevant facts and authorities.

Analyze a realistic legal scenario and explain your reasoning.

Identify incorrect legal conclusions, missing issues, unsupported claims, or flawed reasoning.

Create challenging legal problems that can be used to evaluate AI systems.

The goal is not simply to determine whether legal analysis looks reasonable.

The goal is to capture the judgment an experienced legal professional uses to determine whether legal work actually makes sense.

Compensation

Paid project-based work.

Rates vary based on your experience, specialization, and project requirements. Your applicable rate and project scope will be shown before you commit to a project.

Some projects are short assignments. Others may involve recurring work over a longer period.

There is no fixed schedule and no minimum commitment.

Work arrangement

Remote
Asynchronous
Project-based
Flexible hours
Work around your existing job or commitments
Paid for qualifying project work
But producing a plausible-looking legal answer is not the same as demonstrating strong legal judgment.

AI needs to learn how experienced legal professionals:

Analyze facts and legal issues
Interpret statutes, regulations, and case law
Evaluate legal arguments
Review contracts and legal documents
Identify risks and missing issues
Assess the strength of legal reasoning
Distinguish relevant from irrelevant information
Recognize important edge cases
Support conclusions with appropriate authority
Explain legal conclusions clearly
Determine when legal analysis is actually reliable
That's where you come in.

Your legal expertise helps shape how AI learns to reason about law.

How it works

Apply
Tell us about your legal background, experience, qualifications, and areas of expertise.

Get qualified
Complete a short assessment designed around the type of legal work you'll perform.

Get matched
When your experience matches an active project, we'll share the scope, requirements, and compensation.

Do the work
Complete projects remotely and asynchronously.

Get paid
Receive the agreed rate for your completed work.

Help teach AI how great legal professionals actually work.

Apply directly through: alpheva dot ai/experts/

Explore related USA jobs

Similar jobs you may like

Related roles with a similar title and location.

Same category Same postal code Same area Same location Same country

Technology Transactions Associate Attorney

EK Recruiting LLC

San Francisco, California, United States · 94199

Same category Same postal code Same area Same location Same country

Class Actions Litigation Associate Attorney (Mid-Level)

EK Recruiting LLC

San Francisco, California, United States · 94199

Same category Same location Same country

Senior EPL Claims & Litigation Manager

CrewBloom

Not Specified, California, United States

Same category Same location Same country

Litigation Case Manager/Paralegal

Lewis Search Group

Reseda, California, United States · 91335

Same category Same location Same country

IP Litigation Associate Attorney (Mid-Level)

EK Recruiting LLC

Reseda, California, United States · 91335

Same category Same location Same country

Products Liability Litigation Associate Attorney (Mid-Level)

EK Recruiting LLC

San Diego, California, United States · 92199

Same category Same location Same country

Sr. Trial Attorney Workers Compensation

Zurich Insurance Company Ltd.

Irvine, California, United States · 92602

Same category Same location Same country

Sr. Staff Legal Trial Attorney

Zurich Insurance Company Ltd.

Irvine, California, United States · 92602

Need help finding a job?

Chat with our AI assistant.