Check result and credit: definition and formula
Each check ends as passed, partly passed, failed, couldn’t check or not applicable.
Definition
Credit is the share of the check’s weight it earns.
Formula
passed = 1 · partly passed = the check’s own share (0 to 1; 0.5 when none is given) · failed = 0Example
An offer with three of four required fields passes partly with credit 0.75.
How to read it
A passed check earns its full weight, a failed one nothing, and a partly passed one its share of the weight. Each check sets its own share from what we found, for example the share of required fields present; when a check gives no share, partly passed earns 0.5.
“Couldn’t check” and “not applicable” earn no credit and also leave the denominator, so they neither help nor hurt the score (Couldn’t check, Not applicable).
In the summary of whether an agent can reach, read and buy, one failed check turns its line to no, one we couldn’t check to unknown, and one partly passed check to partly.
What it does not tell you
- Which missing part matters most to a given assistant: credit shows how much of a check passed, not what an agent does with the rest.
- Other pages of the site: the result is judged on the pages we read, and on a store that is one product page.
- Whether a real assistant gets past a security layer’s challenge page: we score that page as a possible block that passes partly, not as a fail.
- The effect on the score: the same credit is worth more points on a heavy check than on a light one; each check’s page shows its weight.
What moves it
- Adding what the check’s result names as missing raises its share; each check’s page lists what a full pass needs (all checks).
- A partly passed check loses weight × (1 − credit) points, so finishing a heavy check that is half done can be worth more than fixing a light check that failed (Priority order).
See also: Every check and its weight
Related terms
Readiness score (free test): How 27 checks on your public pages become one number from 0 to 100.