Skip to main content
S
Menu

Home / Guides / Tasks and assessments

Current public inventory

AI training tasks and assessments, explained with current roles

Task names are inconsistent across platforms. This page uses deterministic wording and category rules to connect 419 currently public roles to ten practical task families.

Project formats, assessment steps, voice or camera requirements, credentials, rates, and availability vary. A match here is evidence in public role copy, not a guarantee about the work you will receive.

419

public roles evaluated

10

controlled task families

9

families with current matches

27 current matching roles

AI response evaluation

Judge whether an AI answer is accurate, useful, clear, safe, and supported by the prompt or evidence.

What you may do

  • Review model outputs
  • Identify errors or unsupported claims
  • Explain ratings with concise evidence

Common qualifications

  • Strong reading and written judgment
  • Domain knowledge where the role is specialist
  • Ability to follow changing rubrics

Assessment signals

  • Consistent ratings
  • Clear error identification
  • Explanations tied to the instructions

0 current matching roles

Answer ranking and comparison

Compare two or more candidate answers and choose the stronger response using a stated preference rubric.

What you may do

  • Compare answers side by side
  • Rank or choose a preferred response
  • Explain material differences

Common qualifications

  • Careful comparative reading
  • Consistency across similar examples
  • Ability to separate style from factual quality

Assessment signals

  • Stable preference decisions
  • Attention to instruction priority
  • Specific comparison evidence

No currently public role uses sufficiently specific wording for this task family. The explanation remains here so applicants can recognize the format when inventory changes.

8 current matching roles

Rubric writing and written justification

Create or apply evaluation criteria, then write a defensible explanation for a score or decision.

What you may do

  • Draft evaluation criteria
  • Apply a rubric
  • Write concise justifications or feedback

Common qualifications

  • Structured writing
  • Quality assurance or teaching experience
  • Ability to make criteria testable

Assessment signals

  • Criteria that do not overlap
  • Evidence-based explanations
  • Clear distinction between major and minor errors
MercorfinanceReviewedApply page reviewed; still check the current platform page.

Accounting Expert

$130 - $160 / hourFirm hourly pay

Location: Fully remote; independent contractor; H-1B and STEM OPT support unavailableRemote worldwideWork authorization mentionedLast reviewed Jul 15, 2026
Track application
MercorgeneralReviewedApply page reviewed; still check the current platform page.

B2B Sales Expert

$100 - $150 / hourFirm hourly pay

Location: Fully remote; independent contractor; own schedule; H-1B and STEM OPT support unavailableWork authorization mentionedContractorLast reviewed Jul 15, 2026
Track application
MercorgeneralReviewedApply page reviewed; still check the current platform page.

Design Expert

$80 - $150 / hourFirm hourly pay

Location: Fully remote; independent contractor; own schedule; H-1B and STEM OPT support unavailableWork authorization mentionedContractorLast reviewed Jul 15, 2026
Track application
MercorfinanceReviewedApply page reviewed; still check the current platform page.

Management Consulting Expert

$150 - $220 / hourFirm hourly pay

Location: Fully remote; independent contractor; own schedule; H-1B and STEM OPT support unavailableWork authorization mentionedContractorLast reviewed Jul 15, 2026
Track application
MercorgeneralReviewedApply page reviewed; still check the current platform page.

Marketing Expert

$80 - $150 / hourFirm hourly pay

Location: Fully remote; independent contractor; own schedule; H-1B and STEM OPT support unavailableRemote worldwideWork authorization mentionedLast reviewed Jul 15, 2026
Track application
MercorsoftwareReviewedApply page reviewed; still check the current platform page.

Data Science Expert

$120 - $170 / hourFirm hourly pay

Location: Fully remote; independent contractor; own schedule; H-1B and STEM OPT support unavailableWork authorization mentionedContractorLast reviewed Jul 15, 2026
Track application

49 current matching roles

Fact-checking and research review

Verify claims, sources, calculations, or research summaries and flag missing or contradictory evidence.

What you may do

  • Check factual claims
  • Review sources or citations
  • Identify unsupported conclusions

Common qualifications

  • Research literacy
  • Source evaluation
  • Careful documentation of uncertainty

Assessment signals

  • Reliable source selection
  • Correct treatment of uncertainty
  • Clear separation of fact and inference
HandshakeresearchReviewedApply page reviewed; still check the current platform page.

Biology Expert

Up to $150 / hour depending on projectAdvertised ceiling

Location: Remote, part-time/flexible - U.S. work authorization requirements may applyWork authorization mentionedProject-basedLast reviewed Jul 19, 2026
Track application

4 current matching roles

Safety, policy and red-team evaluation

Probe for harmful behavior, policy failures, unsafe advice, or weak refusal and escalation behavior.

What you may do

  • Test risky scenarios
  • Apply safety or policy guidance
  • Document failure modes without causing harm

Common qualifications

  • Policy interpretation
  • Adversarial thinking
  • Strong confidentiality and escalation judgment

Assessment signals

  • Correct policy application
  • Safe handling of edge cases
  • Clear severity reasoning

62 current matching roles

Coding, debugging and technical review

Review code, debug failures, compare technical solutions, or evaluate the reasoning behind a software answer.

What you may do

  • Review or write code
  • Diagnose defects
  • Explain performance, security, or design trade-offs

Common qualifications

  • Production software experience
  • Code review and debugging skill
  • Clear technical writing

Assessment signals

  • Correctness
  • Reproducible debugging
  • Trade-off awareness
  • Readable explanations
MercorsoftwareReviewedApply page reviewed; still check the current platform page.

Cybersecurity SWE - AI Safety

$60 - $90 / hourFirm hourly pay

Location: Remote; listed location requirements: United States.Remote - U.S.Work authorization mentionedLast reviewed Jul 1, 2026
Track application
Micro1medicalReviewedApply page reviewed; still check the current platform page.

Fitness Expert

$50 - $101 / hourFirm hourly pay

Location: Remote, United States onlyRemote - U.S.Last reviewed Jul 15, 2026
Track application

124 current matching roles

Translation and localization review

Evaluate translation accuracy, fluency, locale fit, terminology, and cultural nuance in AI-generated content.

What you may do

  • Review translations
  • Check locale and terminology
  • Flag unnatural or culturally incorrect wording

Common qualifications

  • Professional or native-level language ability
  • Strong writing in the target language
  • Localization or editing judgment

Assessment signals

  • Meaning preservation
  • Natural target-language phrasing
  • Locale-specific accuracy

59 current matching roles

Audio, voice and transcription

Record, transcribe, compare, or evaluate speech, voice quality, pronunciation, accents, and audio data.

What you may do

  • Review or record speech
  • Transcribe audio
  • Judge pronunciation, naturalness, or speaker characteristics

Common qualifications

  • Strong listening
  • Language or accent fit
  • Reliable audio environment when recording is required

Assessment signals

  • Accurate transcription
  • Consistent pronunciation judgment
  • Following recording specifications

4 current matching roles

Image and video evaluation

Judge visual quality, relevance, labeling, safety, or instruction-following in images and video.

What you may do

  • Review images or clips
  • Compare visual outputs
  • Identify artifacts, safety problems, or labeling errors

Common qualifications

  • Visual attention to detail
  • Media or domain knowledge where required
  • Consistent use of visual criteria

Assessment signals

  • Accurate visual distinctions
  • Consistent category use
  • Clear explanation of visible defects
MercorsoftwareReviewedApply page reviewed; still check the current platform page.

Computer Vision Expert

$80 - $110 / hourFirm hourly pay

Location: United States; fully remote within the United States; approximately 20 hours per weekRemote - U.S.ContractorLast reviewed Jul 2, 2026
Track application
Micro1languageReviewedApply page reviewed; still check the current platform page.

Video Annotation Expert

$65 - $80 / hourFirm hourly pay

Location: United States, Canada, United KingdomRemote - U.S., CanadaLast reviewed Jul 1, 2026
Track application

21 current matching roles

Data annotation and classification

Label, categorize, validate, or structure data used to train or evaluate AI systems.

What you may do

  • Assign labels or categories
  • Validate existing annotations
  • Follow detailed data-quality rules

Common qualifications

  • Attention to detail
  • High consistency
  • Comfort with repetitive rule-based work

Assessment signals

  • Agreement with gold-standard examples
  • Correct category boundaries
  • Low avoidable error rate

Get alerts without assuming a project is guaranteed

Specialist AI Work is not an employer or hiring platform. Alerts do not guarantee acceptance, tasks, hours, pay, or project duration.

Get reviewed task alerts

Occasional alerts when reviewed roles match your selected fields.

Current field

General professional

Add another field
Additional alert fields

Country is saved to help you interpret location restrictions; it does not determine eligibility.

I agree to receive opt-in email alerts about AI evaluation, expert review, and AI training opportunities from Specialist AI Work. I can unsubscribe at any time. Read the privacy policy.