4
runs scored
end-to-end agent runs
7%
avg golden match
structural accuracy vs the golden target — the eval harness working as intended on early runs
100%
traps passed
behavioural checks
133
items under management
catalogue items across engagements
100%
citation coverage
items backed by a verbatim citation
37
needs a human
open questions · approvals · high DQ
Needs a humanthe queue only a person can move
| type | item | engagement |
|---|---|---|
| open question | OQ-001 What is the authoritative business definition of like-for-like sales for the trading pack? | kingsway |
| open question | OQ-002 What exact revenue, margin, and discount definitions should be used so outputs match management accounts? | kingsway |
| open question | OQ-003 What source or business rule should be used to repair the current margin-report failure when clearance lines h | kingsway |
| open question | OQ-004 Should revenue for the pack include or exclude card fees and supplier funding, per Finance's view? | kingsway |
| open question | OQ-005 How should like-for-like treat store closures and refits in addition to the fifty-two-week rule? | kingsway |
| open question | OQ-006 Who owns the product hierarchy: trading or merchandising? | kingsway |
| open question | OQ-007 Should supplier-funded markdown be netted off margin, and what is the exact treatment Finance requires? | kingsway |
| open question | OQ-008 How should the model handle the known orphan store Croydon, which exists in StockRoom but is missing from the | kingsway |
+ 29 more
Catalogues being builtlive state per engagement
| engagement | items | draft → confirmed → approved | cited | open Qs |
|---|---|---|---|---|
| Kingsway Retail Group agent-built (run kingsway-2026-07-12-discovery-gpt54) | 109 | draft 109 · confirmed 0 · approved 0 | 100% | 12 |
| Meridian Capital reference catalogue | 24 | draft 5 · confirmed 15 · approved 2 | 100% | 3 |
Agent healthper-stage outcomes across all runs · questionnaire ≈ 84.7s · transcript ≈ 95.2s · email ≈ 96.5s
| stage | ok | failed | success | |
|---|---|---|---|---|
| catalog-maintain | 13 | 1 | 93% | |
| normalize | 14 | 0 | 100% | |
| extract | 14 | 0 | 100% | |
| contradiction-find | 14 | 0 | 100% | |
| decision-track | 13 | 0 | 100% | |
| sync-decision-index | 13 | 0 | 100% | |
| gap-analyse | 13 | 0 | 100% |
Recent runs
| run | golden match | traps | verdict |
|---|---|---|---|
| kingsway-2026-07-12-modelling-from-discovery azure_openai · 2026-07-12T22:34 | 0% | 0/0 | incomplete |
| kingsway-2026-07-12-modelling-golden azure_openai · 2026-07-12T22:33 | 29% | 0/0 | mappings rendered |
| kingsway-2026-07-12-discovery-gpt54 azure_openai · 2026-07-12T22:17 | 0% | 6/6 | diverges |
| kingsway-2026-07-10-gpt54 azure_openai · 2026-07-10T12:26 | 0% | 6/6 | diverges |