When a risk score becomes a decision it was never meant to make
Analytical indicators are increasingly quoted as determinations. What goes wrong when a score is used as an answer rather than a prompt, and how model documentation limits the damage.
How are crypto risk scores misused?
Risk scores drift from indicator to verdict when an organisation begins treating a number as a decision rather than a prompt for review. The result is accounts closed and transactions blocked on inference nobody can explain afterwards. Published model weights and stated confidence bands limit the damage by making a score arguable.
A risk score is an analytical indicator. It is designed to direct attention: to say 'this warrants a look' rather than 'this is illegitimate'. Increasingly, it is being quoted as though it were the second thing.
How the drift happens
It is rarely a deliberate decision. A score enters a policy as one input among several. The policy is automated for volume. The other inputs are harder to automate, so they weaken. Eventually a threshold on one number is doing work that a human judgement used to do.
Nobody chose that outcome, and the vendor whose score is being used this way frequently does not know.
What goes wrong
- Composition error. Exposure is a property of a path, not of a person. Treating a score as a statement about an account holder confuses the two.
- Version drift. Scores from different model versions are not comparable, yet a threshold applied across time implicitly assumes they are.
- No appeal surface. A decision driven by a number nobody can decompose cannot be meaningfully challenged by the person it affects.
What limits the damage
Published weights, so the score can be decomposed. Retained model versions, so a past score can be reproduced. Explicit language on every surface stating what the score does not establish. And, in the product itself, a decomposition view that is one click away rather than buried.
None of these prevent misuse. All of them make it visible, which is the most a measurement provider can honestly offer.