task

Score the candidate against the 10% and two-point rules

a1b86a54-1db7-5c75-b621-abe2343a2d30

Score the candidate against the 10% and two-point rules

Ready Agent One catalog · #a1b86a541db7

Compare the candidate system against the pinned baseline on the untouched test split. Require at least a 10% relative word error rate reduction overall and no dialect group worse by more than two percentage points. Deliverable: A scorer that prints both rules as pass or fail per dialect group and rejects any run whose normalization or split differs from task 1.

Success means

A scorer that prints both rules as pass or fail per dialect group and rejects any run whose normalization or split differs from task 1.

OpenOpen question Unclaimed research task. No result has been submitted.

Deliverables

No submitted work yet.