PIG/PIG-Demo
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Capture harness, fixture verification, CI, and the public README

Browse Source 
The site does no live inference. Rollouts are captured once against spark-1 and
replayed at their recorded wall-clock — a public demo with no auth cannot hold
an API key, and a recorded run can be scrubbed, permalinked, blind-compared and
verified in ways a live one cannot. What stops it being a video is that the
browser re-derives every number from the recorded moves.

verify_fixtures.py is the Python half of that: it replays every committed
fixture through the engine and reproduces its own rewards. All 16 land at
delta 0.0. A fixture that cannot be regenerated is a claim with no receipt.

First real measurement, thinking off, 8 seeds: solved 0/8. The model repeats
guesses it has already played, invents words (trape, slith, postt, boomy),
and contradicts its own feedback — consistency 0.09 to 0.17. That is the
published failure taxonomy showing up in our own data on the first run, and it
is why `consistency` is a reward component rather than a footnote.

A capture failure is recorded as a turn with a null reply, never dropped. A
capture that silently discarded failed turns would be reporting a better model
than the one that ran.

CI gates both halves and four things that fail silently in production: the word
lists must rebuild byte-identically, the prerendered routes must carry their own
baked og tags (crawlers do not run JS, so without them every shared link
previews as the homepage), no blob: URL may reach the bundle (the site's CSP has
no worker-src, so it falls back to default-src 'self' and a blob worker is
blocked with no error), and the conformance digest must match across languages.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_019mt6sHQHEnEYrJZvoMCJSB
This commit is contained in:
karti-ai
2026-08-28 15:47:31 -07:00
parent 69607fbfe9
commit 408ce4a525
43 changed files with 5279 additions and 136 deletions
Download Patch File Download Diff File Expand all files Collapse all files
public/traces/wordle/base-off-s0.json
+143
View File
@@ -0,0 +1,143 @@
{
"runId": "base-off-s0",
"seed": 0,
"model": "brain-qwen38-dspark",
"capturedAt": "2026-08-28",
"rewards": {
"solved": 0.0,
"economy": 0.0,
"consistency": 0.125
},
"metrics": {
"guesses_used": 6.0,
"rejected_replies": 2.0,
"reference_depth": 4.0,
"turns_granted": 6.0,
"inconsistent_guesses": 5.0
},
"truncated": false,
"outcome": "failed",
"answer": "wants",
"turns": [
{
"reply": "[crane]",
"reasoning": null,
"call": {
"promptTokens": 147,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 433,
"finishReason": "stop"
},
"info": {
"guess": "crane",
"observation": "C R A N E\nX X Y Y X\n\nYou have 5 guesses left."
}
},
{
"reply": "[slate]",
"reasoning": null,
"call": {
"promptTokens": 184,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 442,
"finishReason": "stop"
},
"info": {
"guess": "slate",
"observation": "S L A T E\nY X Y G X\n\nYou have 4 guesses left."
}
},
{
"reply": "[stale]",
"reasoning": null,
"call": {
"promptTokens": 221,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 496,
"finishReason": "stop"
},
"info": {
"guess": "stale",
"observation": "S T A L E\nY Y Y X X\n\nYou have 3 guesses left."
}
},
{
"reply": "[prate]",
"reasoning": null,
"call": {
"promptTokens": 258,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 488,
"finishReason": "stop"
},
"info": {
"guess": "prate",
"observation": "P R A T E\nX X Y G X\n\nYou have 2 guesses left."
}
},
{
"reply": "[prate]",
"reasoning": null,
"call": {
"promptTokens": 295,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 443,
"finishReason": "stop"
},
"info": {
"guess": "prate",
"observation": "That guess was not accepted: 'prate' has already been guessed.\nIt did not use up a turn. You have 2 guesses left."
}
},
{
"reply": "[spate]",
"reasoning": null,
"call": {
"promptTokens": 344,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 495,
"finishReason": "stop"
},
"info": {
"guess": "spate",
"observation": "S P A T E\nY X Y G X\n\nYou have 1 guess left."
}
},
{
"reply": "[prate]",
"reasoning": null,
"call": {
"promptTokens": 381,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 445,
"finishReason": "stop"
},
"info": {
"guess": "prate",
"observation": "That guess was not accepted: 'prate' has already been guessed.\nIt did not use up a turn. You have 1 guess left."
}
},
{
"reply": "[stare]",
"reasoning": null,
"call": {
"promptTokens": 430,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 502,
"finishReason": "stop"
},
"info": {
"guess": "stare",
"observation": "S T A R E\nY Y Y X X\n\nYou have 0 guesses left."
}
}
]
}
public/traces/wordle/base-off-s1.json
+113
View File
@@ -0,0 +1,113 @@
{
"runId": "base-off-s1",
"seed": 1,
"model": "brain-qwen38-dspark",
"capturedAt": "2026-08-28",
"rewards": {
"solved": 0.0,
"economy": 0.0,
"consistency": 0.16666666666666666
},
"metrics": {
"guesses_used": 6.0,
"rejected_replies": 0.0,
"reference_depth": 3.0,
"turns_granted": 6.0,
"inconsistent_guesses": 5.0
},
"truncated": false,
"outcome": "failed",
"answer": "amber",
"turns": [
{
"reply": "[crane]",
"reasoning": null,
"call": {
"promptTokens": 147,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 385,
"finishReason": "stop"
},
"info": {
"guess": "crane",
"observation": "C R A N E\nX Y Y X Y\n\nYou have 5 guesses left."
}
},
{
"reply": "[slate]",
"reasoning": null,
"call": {
"promptTokens": 184,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 443,
"finishReason": "stop"
},
"info": {
"guess": "slate",
"observation": "S L A T E\nX X Y X Y\n\nYou have 4 guesses left."
}
},
{
"reply": "[plume]",
"reasoning": null,
"call": {
"promptTokens": 221,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 499,
"finishReason": "stop"
},
"info": {
"guess": "plume",
"observation": "P L U M E\nX X X Y Y\n\nYou have 3 guesses left."
}
},
{
"reply": "[grape]",
"reasoning": null,
"call": {
"promptTokens": 258,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 488,
"finishReason": "stop"
},
"info": {
"guess": "grape",
"observation": "G R A P E\nX Y Y X Y\n\nYou have 2 guesses left."
}
},
{
"reply": "[stare]",
"reasoning": null,
"call": {
"promptTokens": 295,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 439,
"finishReason": "stop"
},
"info": {
"guess": "stare",
"observation": "S T A R E\nX X Y Y Y\n\nYou have 1 guess left."
}
},
{
"reply": "[crate]",
"reasoning": null,
"call": {
"promptTokens": 332,
"completionTokens": 4,
"reasoningTokens": null,
"durationMs": 493,
"finishReason": "stop"
},
"info": {
"guess": "crate",
"observation": "C R A T E\nX Y Y X Y\n\nYou have 0 guesses left."
}
}
]
}
public/traces/wordle/base-off-s2.json
+188
View File
@@ -0,0 +1,188 @@
{
"runId": "base-off-s2",
"seed": 2,
"model": "brain-qwen38-dspark",
"capturedAt": "2026-08-28",
"rewards": {
"solved": 0.0,
"economy": 0.0,
"consistency": 0.09090909090909091
},
"metrics": {
"guesses_used": 5.0,
"rejected_replies": 6.0,
"reference_depth": 4.0,
"turns_granted": 6.0,
"inconsistent_guesses": 5.0
},
"truncated": false,
"outcome": "failed",
"answer": "spume",
"turns": [
{
"reply": "[crane]",
"reasoning": null,
"call": {
"promptTokens": 147,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 301,
"finishReason": "stop"
},
"info": {
"guess": "crane",
"observation": "C R A N E\nX X X X G\n\nYou have 5 guesses left."
}
},
{
"reply": "[shine]",
"reasoning": null,
"call": {
"promptTokens": 184,
"completionTokens": 4,
"reasoningTokens": null,
"durationMs": 444,
"finishReason": "stop"
},
"info": {
"guess": "shine",
"observation": "S H I N E\nG X X X G\n\nYou have 4 guesses left."
}
},
{
"reply": "[shone]",
"reasoning": null,
"call": {
"promptTokens": 220,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 496,
"finishReason": "stop"
},
"info": {
"guess": "shone",
"observation": "S H O N E\nG X X X G\n\nYou have 3 guesses left."
}
},
{
"reply": "[swine]",
"reasoning": null,
"call": {
"promptTokens": 257,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 606,
"finishReason": "stop"
},
"info": {
"guess": "swine",
"observation": "S W I N E\nG X X X G\n\nYou have 2 guesses left."
}
},
{
"reply": "[shine]",
"reasoning": null,
"call": {
"promptTokens": 294,
"completionTokens": 4,
"reasoningTokens": null,
"durationMs": 439,
"finishReason": "stop"
},
"info": {
"guess": "shine",
"observation": "That guess was not accepted: 'shine' has already been guessed.\nIt did not use up a turn. You have 2 guesses left."
}
},
{
"reply": "[spine]",
"reasoning": null,
"call": {
"promptTokens": 341,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 384,
"finishReason": "stop"
},
"info": {
"guess": "spine",
"observation": "S P I N E\nG G X X G\n\nYou have 1 guess left."
}
},
{
"reply": "[spine]",
"reasoning": null,
"call": {
"promptTokens": 378,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 331,
"finishReason": "stop"
},
"info": {
"guess": "spine",
"observation": "That guess was not accepted: 'spine' has already been guessed.\nIt did not use up a turn. You have 1 guess left."
}
},
{
"reply": "[spine]",
"reasoning": null,
"call": {
"promptTokens": 427,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 389,
"finishReason": "stop"
},
"info": {
"guess": "spine",
"observation": "That guess was not accepted: 'spine' has already been guessed.\nIt did not use up a turn. You have 1 guess left."
}
},
{
"reply": "[spine]",
"reasoning": null,
"call": {
"promptTokens": 476,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 386,
"finishReason": "stop"
},
"info": {
"guess": "spine",
"observation": "That guess was not accepted: 'spine' has already been guessed.\nIt did not use up a turn. You have 1 guess left."
}
},
{
"reply": "[spine]",
"reasoning": null,
"call": {
"promptTokens": 525,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 379,
"finishReason": "stop"
},
"info": {
"guess": "spine",
"observation": "That guess was not accepted: 'spine' has already been guessed.\nIt did not use up a turn. You have 1 guess left."
}
},
{
"reply": "[spine]",
"reasoning": null,
"call": {
"promptTokens": 574,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 334,
"finishReason": "stop"
},
"info": {
"guess": "spine",
"observation": "That guess was not accepted: 'spine' has already been guessed.\nIt did not use up a turn. You have 1 guess left."
}
}
]
}
public/traces/wordle/base-off-s3.json
+188
View File
@@ -0,0 +1,188 @@
{
"runId": "base-off-s3",
"seed": 3,
"model": "brain-qwen38-dspark",
"capturedAt": "2026-08-28",
"rewards": {
"solved": 0.0,
"economy": 0.0,
"consistency": 0.09090909090909091
},
"metrics": {
"guesses_used": 5.0,
"rejected_replies": 6.0,
"reference_depth": 3.0,
"turns_granted": 6.0,
"inconsistent_guesses": 5.0
},
"truncated": false,
"outcome": "failed",
"answer": "toady",
"turns": [
{
"reply": "[crane]",
"reasoning": null,
"call": {
"promptTokens": 147,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 393,
"finishReason": "stop"
},
"info": {
"guess": "crane",
"observation": "C R A N E\nX X G X X\n\nYou have 5 guesses left."
}
},
{
"reply": "[slate]",
"reasoning": null,
"call": {
"promptTokens": 184,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 557,
"finishReason": "stop"
},
"info": {
"guess": "slate",
"observation": "S L A T E\nX X G Y X\n\nYou have 4 guesses left."
}
},
{
"reply": "[plate]",
"reasoning": null,
"call": {
"promptTokens": 221,
"completionTokens": 4,
"reasoningTokens": null,
"durationMs": 620,
"finishReason": "stop"
},
"info": {
"guess": "plate",
"observation": "P L A T E\nX X G Y X\n\nYou have 3 guesses left."
}
},
{
"reply": "[crate]",
"reasoning": null,
"call": {
"promptTokens": 257,
"completionTokens": 4,
"reasoningTokens": null,
"durationMs": 9070,
"finishReason": "stop"
},
"info": {
"guess": "crate",
"observation": "C R A T E\nX X G Y X\n\nYou have 2 guesses left."
}
},
{
"reply": "[plate]",
"reasoning": null,
"call": {
"promptTokens": 293,
"completionTokens": 4,
"reasoningTokens": null,
"durationMs": 1037,
"finishReason": "stop"
},
"info": {
"guess": "plate",
"observation": "That guess was not accepted: 'plate' has already been guessed.\nIt did not use up a turn. You have 2 guesses left."
}
},
{
"reply": "[trape]",
"reasoning": null,
"call": {
"promptTokens": 340,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 1620,
"finishReason": "stop"
},
"info": {
"guess": "trape",
"observation": "T R A P E\nG X G X X\n\nYou have 1 guess left."
}
},
{
"reply": "[trape]",
"reasoning": null,
"call": {
"promptTokens": 377,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 985,
"finishReason": "stop"
},
"info": {
"guess": "trape",
"observation": "That guess was not accepted: 'trape' has already been guessed.\nIt did not use up a turn. You have 1 guess left."
}
},
{
"reply": "[trape]",
"reasoning": null,
"call": {
"promptTokens": 426,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 1105,
"finishReason": "stop"
},
"info": {
"guess": "trape",
"observation": "That guess was not accepted: 'trape' has already been guessed.\nIt did not use up a turn. You have 1 guess left."
}
},
{
"reply": "[trape]",
"reasoning": null,
"call": {
"promptTokens": 475,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 1094,
"finishReason": "stop"
},
"info": {
"guess": "trape",
"observation": "That guess was not accepted: 'trape' has already been guessed.\nIt did not use up a turn. You have 1 guess left."
}
},
{
"reply": "[trape]",
"reasoning": null,
"call": {
"promptTokens": 524,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 1349,
"finishReason": "stop"
},
"info": {
"guess": "trape",
"observation": "That guess was not accepted: 'trape' has already been guessed.\nIt did not use up a turn. You have 1 guess left."
}
},
{
"reply": "[trape]",
"reasoning": null,
"call": {
"promptTokens": 573,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 983,
"finishReason": "stop"
},
"info": {
"guess": "trape",
"observation": "That guess was not accepted: 'trape' has already been guessed.\nIt did not use up a turn. You have 1 guess left."
}
}
]
}
public/traces/wordle/base-off-s4.json
+188
View File
@@ -0,0 +1,188 @@
{
"runId": "base-off-s4",
"seed": 4,
"model": "brain-qwen38-dspark",
"capturedAt": "2026-08-28",
"rewards": {
"solved": 0.0,
"economy": 0.0,
"consistency": 0.09090909090909091
},
"metrics": {
"guesses_used": 5.0,
"rejected_replies": 6.0,
"reference_depth": 4.0,
"turns_granted": 6.0,
"inconsistent_guesses": 5.0
},
"truncated": false,
"outcome": "failed",
"answer": "divot",
"turns": [
{
"reply": "[crane]",
"reasoning": null,
"call": {
"promptTokens": 147,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 952,
"finishReason": "stop"
},
"info": {
"guess": "crane",
"observation": "C R A N E\nX X X X X\n\nYou have 5 guesses left."
}
},
{
"reply": "[slith]",
"reasoning": null,
"call": {
"promptTokens": 184,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 1501,
"finishReason": "stop"
},
"info": {
"guess": "slith",
"observation": "That guess was not accepted: 'slith' is not in the word list.\nIt did not use up a turn. You have 5 guesses left."
}
},
{
"reply": "[slant]",
"reasoning": null,
"call": {
"promptTokens": 235,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 1363,
"finishReason": "stop"
},
"info": {
"guess": "slant",
"observation": "S L A N T\nX X X X G\n\nYou have 4 guesses left."
}
},
{
"reply": "[roast]",
"reasoning": null,
"call": {
"promptTokens": 272,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 1609,
"finishReason": "stop"
},
"info": {
"guess": "roast",
"observation": "R O A S T\nX Y X X G\n\nYou have 3 guesses left."
}
},
{
"reply": "[toast]",
"reasoning": null,
"call": {
"promptTokens": 309,
"completionTokens": 4,
"reasoningTokens": null,
"durationMs": 1240,
"finishReason": "stop"
},
"info": {
"guess": "toast",
"observation": "T O A S T\nX Y X X G\n\nYou have 2 guesses left."
}
},
{
"reply": "[plout]",
"reasoning": null,
"call": {
"promptTokens": 345,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 1613,
"finishReason": "stop"
},
"info": {
"guess": "plout",
"observation": "That guess was not accepted: 'plout' is not in the word list.\nIt did not use up a turn. You have 2 guesses left."
}
},
{
"reply": "[postt]",
"reasoning": null,
"call": {
"promptTokens": 396,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 1349,
"finishReason": "stop"
},
"info": {
"guess": "postt",
"observation": "That guess was not accepted: 'postt' is not in the word list.\nIt did not use up a turn. You have 2 guesses left."
}
},
{
"reply": "[roost]",
"reasoning": null,
"call": {
"promptTokens": 447,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 868,
"finishReason": "stop"
},
"info": {
"guess": "roost",
"observation": "R O O S T\nX Y X X G\n\nYou have 1 guess left."
}
},
{
"reply": "[plout]",
"reasoning": null,
"call": {
"promptTokens": 484,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 946,
"finishReason": "stop"
},
"info": {
"guess": "plout",
"observation": "That guess was not accepted: 'plout' is not in the word list.\nIt did not use up a turn. You have 1 guess left."
}
},
{
"reply": "[toast]",
"reasoning": null,
"call": {
"promptTokens": 535,
"completionTokens": 4,
"reasoningTokens": null,
"durationMs": 498,
"finishReason": "stop"
},
"info": {
"guess": "toast",
"observation": "That guess was not accepted: 'toast' has already been guessed.\nIt did not use up a turn. You have 1 guess left."
}
},
{
"reply": "[most]",
"reasoning": null,
"call": {
"promptTokens": 582,
"completionTokens": 4,
"reasoningTokens": null,
"durationMs": 490,
"finishReason": "stop"
},
"info": {
"guess": "most",
"observation": "That guess was not accepted: 'most' is not 5 letters.\nIt did not use up a turn. You have 1 guess left."
}
}
]
}
public/traces/wordle/base-off-s5.json
+143
View File
@@ -0,0 +1,143 @@
{
"runId": "base-off-s5",
"seed": 5,
"model": "brain-qwen38-dspark",
"capturedAt": "2026-08-28",
"rewards": {
"solved": 0.0,
"economy": 0.0,
"consistency": 0.125
},
"metrics": {
"guesses_used": 6.0,
"rejected_replies": 2.0,
"reference_depth": 4.0,
"turns_granted": 6.0,
"inconsistent_guesses": 5.0
},
"truncated": false,
"outcome": "failed",
"answer": "filly",
"turns": [
{
"reply": "[slate]",
"reasoning": null,
"call": {
"promptTokens": 147,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 392,
"finishReason": "stop"
},
"info": {
"guess": "slate",
"observation": "S L A T E\nX Y X X X\n\nYou have 5 guesses left."
}
},
{
"reply": "[crane]",
"reasoning": null,
"call": {
"promptTokens": 184,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 555,
"finishReason": "stop"
},
"info": {
"guess": "crane",
"observation": "C R A N E\nX X X X X\n\nYou have 4 guesses left."
}
},
{
"reply": "[plaid]",
"reasoning": null,
"call": {
"promptTokens": 221,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 496,
"finishReason": "stop"
},
"info": {
"guess": "plaid",
"observation": "P L A I D\nX Y X Y X\n\nYou have 3 guesses left."
}
},
{
"reply": "[blint]",
"reasoning": null,
"call": {
"promptTokens": 258,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 491,
"finishReason": "stop"
},
"info": {
"guess": "blint",
"observation": "That guess was not accepted: 'blint' is not in the word list.\nIt did not use up a turn. You have 3 guesses left."
}
},
{
"reply": "[plaid]",
"reasoning": null,
"call": {
"promptTokens": 309,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 443,
"finishReason": "stop"
},
"info": {
"guess": "plaid",
"observation": "That guess was not accepted: 'plaid' has already been guessed.\nIt did not use up a turn. You have 3 guesses left."
}
},
{
"reply": "[plume]",
"reasoning": null,
"call": {
"promptTokens": 358,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 499,
"finishReason": "stop"
},
"info": {
"guess": "plume",
"observation": "P L U M E\nX Y X X X\n\nYou have 2 guesses left."
}
},
{
"reply": "[climb]",
"reasoning": null,
"call": {
"promptTokens": 395,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 603,
"finishReason": "stop"
},
"info": {
"guess": "climb",
"observation": "C L I M B\nX Y Y X X\n\nYou have 1 guess left."
}
},
{
"reply": "[slimy]",
"reasoning": null,
"call": {
"promptTokens": 432,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 555,
"finishReason": "stop"
},
"info": {
"guess": "slimy",
"observation": "S L I M Y\nX Y Y X G\n\nYou have 0 guesses left."
}
}
]
}
public/traces/wordle/base-off-s6.json
+128
View File
@@ -0,0 +1,128 @@
{
"runId": "base-off-s6",
"seed": 6,
"model": "brain-qwen38-dspark",
"capturedAt": "2026-08-28",
"rewards": {
"solved": 0.0,
"economy": 0.0,
"consistency": 0.14285714285714285
},
"metrics": {
"guesses_used": 6.0,
"rejected_replies": 1.0,
"reference_depth": 4.0,
"turns_granted": 6.0,
"inconsistent_guesses": 5.0
},
"truncated": false,
"outcome": "failed",
"answer": "bobby",
"turns": [
{
"reply": "[crane]",
"reasoning": null,
"call": {
"promptTokens": 147,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 381,
"finishReason": "stop"
},
"info": {
"guess": "crane",
"observation": "C R A N E\nX X X X X\n\nYou have 5 guesses left."
}
},
{
"reply": "[slite]",
"reasoning": null,
"call": {
"promptTokens": 184,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 555,
"finishReason": "stop"
},
"info": {
"guess": "slite",
"observation": "That guess was not accepted: 'slite' is not in the word list.\nIt did not use up a turn. You have 5 guesses left."
}
},
{
"reply": "[slate]",
"reasoning": null,
"call": {
"promptTokens": 235,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 503,
"finishReason": "stop"
},
"info": {
"guess": "slate",
"observation": "S L A T E\nX X X X X\n\nYou have 4 guesses left."
}
},
{
"reply": "[robin]",
"reasoning": null,
"call": {
"promptTokens": 272,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 607,
"finishReason": "stop"
},
"info": {
"guess": "robin",
"observation": "R O B I N\nX G G X X\n\nYou have 3 guesses left."
}
},
{
"reply": "[boomy]",
"reasoning": null,
"call": {
"promptTokens": 309,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 555,
"finishReason": "stop"
},
"info": {
"guess": "boomy",
"observation": "B O O M Y\nG G X X G\n\nYou have 2 guesses left."
}
},
{
"reply": "[booth]",
"reasoning": null,
"call": {
"promptTokens": 346,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 385,
"finishReason": "stop"
},
"info": {
"guess": "booth",
"observation": "B O O T H\nG G X X X\n\nYou have 1 guess left."
}
},
{
"reply": "[booby]",
"reasoning": null,
"call": {
"promptTokens": 383,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 446,
"finishReason": "stop"
},
"info": {
"guess": "booby",
"observation": "B O O B Y\nG G X G G\n\nYou have 0 guesses left."
}
}
]
}
public/traces/wordle/base-off-s7.json
+128
View File
@@ -0,0 +1,128 @@
{
"runId": "base-off-s7",
"seed": 7,
"model": "brain-qwen38-dspark",
"capturedAt": "2026-08-28",
"rewards": {
"solved": 0.0,
"economy": 0.0,
"consistency": 0.14285714285714285
},
"metrics": {
"guesses_used": 6.0,
"rejected_replies": 1.0,
"reference_depth": 3.0,
"turns_granted": 6.0,
"inconsistent_guesses": 5.0
},
"truncated": false,
"outcome": "failed",
"answer": "clews",
"turns": [
{
"reply": "[crane]",
"reasoning": null,
"call": {
"promptTokens": 147,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 254,
"finishReason": "stop"
},
"info": {
"guess": "crane",
"observation": "C R A N E\nG X X X Y\n\nYou have 5 guesses left."
}
},
{
"reply": "[prize]",
"reasoning": null,
"call": {
"promptTokens": 184,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 557,
"finishReason": "stop"
},
"info": {
"guess": "prize",
"observation": "P R I Z E\nX X X X Y\n\nYou have 4 guesses left."
}
},
{
"reply": "[crepe]",
"reasoning": null,
"call": {
"promptTokens": 221,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 607,
"finishReason": "stop"
},
"info": {
"guess": "crepe",
"observation": "C R E P E\nG X G X X\n\nYou have 3 guesses left."
}
},
{
"reply": "[crave]",
"reasoning": null,
"call": {
"promptTokens": 258,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 488,
"finishReason": "stop"
},
"info": {
"guess": "crave",
"observation": "C R A V E\nG X X X Y\n\nYou have 2 guesses left."
}
},
{
"reply": "[credo]",
"reasoning": null,
"call": {
"promptTokens": 295,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 553,
"finishReason": "stop"
},
"info": {
"guess": "credo",
"observation": "C R E D O\nG X G X X\n\nYou have 1 guess left."
}
},
{
"reply": "[crepe]",
"reasoning": null,
"call": {
"promptTokens": 332,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 492,
"finishReason": "stop"
},
"info": {
"guess": "crepe",
"observation": "That guess was not accepted: 'crepe' has already been guessed.\nIt did not use up a turn. You have 1 guess left."
}
},
{
"reply": "[creed]",
"reasoning": null,
"call": {
"promptTokens": 381,
"completionTokens": 5,
"reasoningTokens": null,
"durationMs": 444,
"finishReason": "stop"
},
"info": {
"guess": "creed",
"observation": "C R E E D\nG X G X X\n\nYou have 0 guesses left."
}
}
]
}
public/traces/wordle/solver-s0.json
+83
View File
@@ -0,0 +1,83 @@
{
"runId": "solver-s0",
"seed": 0,
"model": "entropy-solver",
"capturedAt": "2026-08-28",
"rewards": {
"solved": 1.0,
"economy": 1.0,
"consistency": 0.5
},
"metrics": {
"guesses_used": 4.0,
"rejected_replies": 0.0,
"reference_depth": 4.0,
"turns_granted": 6.0,
"inconsistent_guesses": 2.0
},
"truncated": false,
"outcome": "solved",
"answer": "wants",
"turns": [
{
"reply": "[tares]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "tares",
"observation": "T A R E S\nY G X X G\n\nYou have 5 guesses left."
}
},
{
"reply": "[filch]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "filch",
"observation": "F I L C H\nX X X X X\n\nYou have 4 guesses left."
}
},
{
"reply": "[spams]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "spams",
"observation": "S P A M S\nX X Y X G\n\nYou have 3 guesses left."
}
},
{
"reply": "[wants]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "wants",
"observation": "W A N T S\nG G G G G\n\nYou have 2 guesses left."
}
}
]
}
public/traces/wordle/solver-s1.json
+68
View File
@@ -0,0 +1,68 @@
{
"runId": "solver-s1",
"seed": 1,
"model": "entropy-solver",
"capturedAt": "2026-08-28",
"rewards": {
"solved": 1.0,
"economy": 1.0,
"consistency": 0.6666666666666666
},
"metrics": {
"guesses_used": 3.0,
"rejected_replies": 0.0,
"reference_depth": 3.0,
"turns_granted": 6.0,
"inconsistent_guesses": 1.0
},
"truncated": false,
"outcome": "solved",
"answer": "amber",
"turns": [
{
"reply": "[tares]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "tares",
"observation": "T A R E S\nX Y Y G X\n\nYou have 5 guesses left."
}
},
{
"reply": "[blend]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "blend",
"observation": "B L E N D\nY X Y X X\n\nYou have 4 guesses left."
}
},
{
"reply": "[amber]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "amber",
"observation": "A M B E R\nG G G G G\n\nYou have 3 guesses left."
}
}
]
}
public/traces/wordle/solver-s2.json
+83
View File
@@ -0,0 +1,83 @@
{
"runId": "solver-s2",
"seed": 2,
"model": "entropy-solver",
"capturedAt": "2026-08-28",
"rewards": {
"solved": 1.0,
"economy": 1.0,
"consistency": 0.75
},
"metrics": {
"guesses_used": 4.0,
"rejected_replies": 0.0,
"reference_depth": 4.0,
"turns_granted": 6.0,
"inconsistent_guesses": 1.0
},
"truncated": false,
"outcome": "solved",
"answer": "spume",
"turns": [
{
"reply": "[tares]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "tares",
"observation": "T A R E S\nX X X Y Y\n\nYou have 5 guesses left."
}
},
{
"reply": "[spoil]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "spoil",
"observation": "S P O I L\nG G X X X\n\nYou have 4 guesses left."
}
},
{
"reply": "[speck]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "speck",
"observation": "S P E C K\nG G Y X X\n\nYou have 3 guesses left."
}
},
{
"reply": "[spume]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "spume",
"observation": "S P U M E\nG G G G G\n\nYou have 2 guesses left."
}
}
]
}
public/traces/wordle/solver-s3.json
+68
View File
@@ -0,0 +1,68 @@
{
"runId": "solver-s3",
"seed": 3,
"model": "entropy-solver",
"capturedAt": "2026-08-28",
"rewards": {
"solved": 1.0,
"economy": 1.0,
"consistency": 0.6666666666666666
},
"metrics": {
"guesses_used": 3.0,
"rejected_replies": 0.0,
"reference_depth": 3.0,
"turns_granted": 6.0,
"inconsistent_guesses": 1.0
},
"truncated": false,
"outcome": "solved",
"answer": "toady",
"turns": [
{
"reply": "[tares]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "tares",
"observation": "T A R E S\nG Y X X X\n\nYou have 5 guesses left."
}
},
{
"reply": "[bland]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "bland",
"observation": "B L A N D\nX X G X Y\n\nYou have 4 guesses left."
}
},
{
"reply": "[toady]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "toady",
"observation": "T O A D Y\nG G G G G\n\nYou have 3 guesses left."
}
}
]
}
public/traces/wordle/solver-s4.json
+83
View File
@@ -0,0 +1,83 @@
{
"runId": "solver-s4",
"seed": 4,
"model": "entropy-solver",
"capturedAt": "2026-08-28",
"rewards": {
"solved": 1.0,
"economy": 1.0,
"consistency": 1.0
},
"metrics": {
"guesses_used": 4.0,
"rejected_replies": 0.0,
"reference_depth": 4.0,
"turns_granted": 6.0,
"inconsistent_guesses": 0.0
},
"truncated": false,
"outcome": "solved",
"answer": "divot",
"turns": [
{
"reply": "[tares]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "tares",
"observation": "T A R E S\nY X X X X\n\nYou have 5 guesses left."
}
},
{
"reply": "[count]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "count",
"observation": "C O U N T\nX Y X X G\n\nYou have 4 guesses left."
}
},
{
"reply": "[pivot]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "pivot",
"observation": "P I V O T\nX G G G G\n\nYou have 3 guesses left."
}
},
{
"reply": "[divot]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "divot",
"observation": "D I V O T\nG G G G G\n\nYou have 2 guesses left."
}
}
]
}
public/traces/wordle/solver-s5.json
+83
View File
@@ -0,0 +1,83 @@
{
"runId": "solver-s5",
"seed": 5,
"model": "entropy-solver",
"capturedAt": "2026-08-28",
"rewards": {
"solved": 1.0,
"economy": 1.0,
"consistency": 0.75
},
"metrics": {
"guesses_used": 4.0,
"rejected_replies": 0.0,
"reference_depth": 4.0,
"turns_granted": 6.0,
"inconsistent_guesses": 1.0
},
"truncated": false,
"outcome": "solved",
"answer": "filly",
"turns": [
{
"reply": "[tares]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "tares",
"observation": "T A R E S\nX X X X X\n\nYou have 5 guesses left."
}
},
{
"reply": "[doily]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "doily",
"observation": "D O I L Y\nX X Y G G\n\nYou have 4 guesses left."
}
},
{
"reply": "[belch]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "belch",
"observation": "B E L C H\nX X G X X\n\nYou have 3 guesses left."
}
},
{
"reply": "[filly]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "filly",
"observation": "F I L L Y\nG G G G G\n\nYou have 2 guesses left."
}
}
]
}
public/traces/wordle/solver-s6.json
+83
View File
@@ -0,0 +1,83 @@
{
"runId": "solver-s6",
"seed": 6,
"model": "entropy-solver",
"capturedAt": "2026-08-28",
"rewards": {
"solved": 1.0,
"economy": 1.0,
"consistency": 0.75
},
"metrics": {
"guesses_used": 4.0,
"rejected_replies": 0.0,
"reference_depth": 4.0,
"turns_granted": 6.0,
"inconsistent_guesses": 1.0
},
"truncated": false,
"outcome": "solved",
"answer": "bobby",
"turns": [
{
"reply": "[tares]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "tares",
"observation": "T A R E S\nX X X X X\n\nYou have 5 guesses left."
}
},
{
"reply": "[doily]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "doily",
"observation": "D O I L Y\nX G X X G\n\nYou have 4 guesses left."
}
},
{
"reply": "[knobs]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "knobs",
"observation": "K N O B S\nX X Y G X\n\nYou have 3 guesses left."
}
},
{
"reply": "[bobby]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "bobby",
"observation": "B O B B Y\nG G G G G\n\nYou have 2 guesses left."
}
}
]
}
public/traces/wordle/solver-s7.json
+68
View File
@@ -0,0 +1,68 @@
{
"runId": "solver-s7",
"seed": 7,
"model": "entropy-solver",
"capturedAt": "2026-08-28",
"rewards": {
"solved": 1.0,
"economy": 1.0,
"consistency": 0.6666666666666666
},
"metrics": {
"guesses_used": 3.0,
"rejected_replies": 0.0,
"reference_depth": 3.0,
"turns_granted": 6.0,
"inconsistent_guesses": 1.0
},
"truncated": false,
"outcome": "solved",
"answer": "clews",
"turns": [
{
"reply": "[tares]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "tares",
"observation": "T A R E S\nX X X Y G\n\nYou have 5 guesses left."
}
},
{
"reply": "[wield]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "wield",
"observation": "W I E L D\nY X G Y X\n\nYou have 4 guesses left."
}
},
{
"reply": "[clews]",
"reasoning": null,
"call": {
"promptTokens": null,
"completionTokens": null,
"reasoningTokens": null,
"durationMs": null,
"finishReason": "generated"
},
"info": {
"guess": "clews",
"observation": "C L E W S\nG G G G G\n\nYou have 3 guesses left."
}
}
]
}