Persona health
Persona health is behavioral monitoring for your personas. You record answers you trust for a persona, its golden set. Drift checks ask those questions again on a schedule, score how close today's answers are, and flag a persona that has moved.
It measures consistency against a baseline you approved. It does not certify that a persona is accurate.
Turning it on
Persona health is off by default and enabled per workspace. Ask your Kumkuat contact to turn it on. Kumkuat enables it together with the persona profile page, where results appear, and sets up the workspace's scheduled check at the same time.
The golden set
In the persona editor, the Golden Response Set section holds human-verified question and answer pairs the persona should keep reproducing.
- Add entry records a question and the answer you trust, marked as user verified or as a real-world quote.
- Seed from feedback turns persona responses your team rated positively into entries.
- Entries can be edited or deleted at any time. A drift check scores up to 10 active entries per persona.
Drift checks
A drift check asks the persona each golden question again. A model acting as judge then scores how closely the new answer matches the golden answer, from 0 to 100. An entry passes at 70 or above. Scores in the uncertain middle of the range are scored again and the samples combined, so a single noisy judgment does not decide the result.
Checks run in two ways:
- On demand, with Run drift check now on the persona profile.
- On a schedule. Each persona has a check cadence of weekly, monthly, quarterly or manual only. The workspace default is monthly, and you can override it per persona on the profile. A scheduled run checks only the personas that are due.
Health status
| Status | Meaning |
|---|---|
| Healthy | No failing checks in the latest run |
| Needs attention | One or more unresolved checks failed |
| Drift detected | Two or more unresolved checks failed in this run and also failed in the previous run |
| Not yet checked | No run yet, or the persona has no golden set |
A persona reaches Drift detected only on repeated failures, so one noisy result can raise Needs attention but not more. Personas that need attention or show drift carry a Needs attention badge in the persona list.
Resolving a failing check
On the persona profile, each failing check shows the golden answer, the new answer, the score and the reason the judge gave. For each one you can:
- Confirm — response is fine, which marks the check resolved.
- Tune this persona, which opens the persona editor so you can adjust its instructions.
Self-healing auto-tune is an optional per-persona setting, off by default. When a check fails, it proposes new instructions for the persona and keeps them only if they score measurably closer to the golden set on the same checks. Otherwise the persona is left unchanged.
Good to know
- Each check makes model calls: one new answer and at least one judgment per golden entry. The cap of 10 entries per persona bounds the cost of a run.
- Persona health sends no notifications. Results appear on the persona profile and in the persona list.
- Auto-test on real events and the Validation Center appear alongside persona health and are in preview. They grade a persona's reactions to new documents from its own sources against its definition, rather than against a golden set.