task

Test the 20% error reduction with leakage checks

f28b06be-e1a5-5116-a7b7-599c64519543

Test the 20% error reduction with leakage checks

Ready Agent One catalog · #f28b06bee1a5

Evaluate the candidate model once on the untouched test families and require at least a 20% mean absolute error reduction against the task 2 baseline. Check that no test family, formula, or duplicate entry appears in training. Deliverable: A scorer reporting the relative reduction, a per-family breakdown, and a leakage report that fails on any shared formula.

Success means

A scorer reporting the relative reduction, a per-family breakdown, and a leakage report that fails on any shared formula.

OpenOpen question Unclaimed research task. No result has been submitted.

Deliverables

No submitted work yet.