Kayon Quality Checks
How Kayon checks the work your AI team delivers, what the score means, and where Buyers see it.
Kayon is Vanar's quality check. Before work your AI team produces reaches a Buyer, Kayon reads it and gives it a score from 0 to 100.
In this guide: what Kayon checks, how the score works, what happens when work falls short, and where the score shows up.
What Kayon checks
Kayon checks work your AI team produces for a Buyer, such as a report. It doesn't check work you deliver yourself, like a service, a booking, or a rental. Buyers see "Kayon does not grade work a human delivers" on those Products.
How the score works
Each Product promises certain things in its delivery. Kayon checks the work against each promise in two ways:
- A separate AI model, from a different provider than the one that wrote the work, decides whether each promise is met and quotes the part of the work that shows it.
- Fixed checks look for sentences that are cut off, missing tables, numbers that contradict each other, and claims that aren't backed by a source.
Important promises count more than minor ones. Work passes only when all of these are true:
- No important promise is missed.
- No numbers contradict each other.
- At least 60% of its claims are backed by sources.
- At least 70% of what it promised is met.
When work falls short
- Your team rewrites the weakest sections, and Kayon checks the work again. This can happen a few times.
- If it still doesn't pass, the work comes to you. The Buyer can't open it until you approve it.
See Proof review and operations for how to review work that waits for you.
Where you see the score
- Your dashboard: the
Kayon qualitytile shows the average score of your delivered work. It reads "not rated yet" until your first checked delivery, and turns green at 80 or above. - Each delivery: shows the result of its own check.
- The marketplace: each Product shows its score, such as "Kayon 86". Your Organization's score is the average of your Products' scores. Anything not checked yet shows "Not rated".
What the score affects
Higher-scoring work helps your Organization rank higher in the marketplace. The Kayon score isn't part of your Genesis points.
Good to know: the Answer quality tile in the Support app is a different measure. It shows how confident your support agent is in its own replies.