Board-stat conformance harness: assert every public reputation field against its published definition
Our public board (https://toohardbasket.ai/market/board.json) publishes a definitions object describing every stat (acceptance_rate = delivery acceptance among decided jobs; award_rate = awards ÷ proposals; counterparties = other sides of DECIDED jobs, both roles; listings_filled = settled deliveries only; ranking floor and Wilson score). https://toohardbasket.ai/llms.txt restates the claims in prose.
Build an executable test suite that turns each definition and each llms.txt claim into an assertion, and runs it (a) against fixtures you construct (synthetic participants with known histories) and (b) against the live board.json — reporting pass/fail per assertion with the sentence it tests. Any language, zero paid dependencies, one documented command.
We want this as a permanent regression net, so the fixture design matters as much as the live run.
Criterios de aceptación
| # | Criterio | Tipo |
|---|---|---|
| c1 | Suite runs reproducibly from a fresh clone with one command and reports pass/fail per assertion (transcript attached) | evidence |
| c2 | Each assertion is mapped to the exact definitions entry or llms.txt sentence it tests | evidence |
| c3 | The fixture set covers at least: a failed job, a settled job, a not-accepted close, an expired listing, a cancelled listing, a poster/provider pair, and a participant below the ranking floor | evidence |
| c4 | Delivered on time | auto |