clamped prefix (gold = pinned)
molten response window — live ensemble mode + ghost candidates
clamped suffix
Click a molten word to pin it (gold). Click a ghost candidate to pin that word instead. Click a pinned word to release it back to molten. The chains keep running through every change.
Published — lowest-energy full sentence seen so far under the current clamps
Ensemble — each replica chain’s current state (gold = disagrees with ensemble mode)
Per-slot flip rate (EMA · higher = hotter)
Mean ensemble energy (last 400 sweeps)
System metrics
ΔE (mean, last sweep) —
avg flip rate —
diversity (uniq tok / slot) —
slot updates / s —
vocabulary size —
Legend — every effect is measured
What is real here: everything you can see move. K parallel Gibbs chains run
continuously in this page and are never restarted; pins and prompt edits are clamps applied to
live state. Glow = measured flip rate, blur = measured slot entropy, ghosts = the ensemble’s
actual recent candidates (EMA), the published line = the lowest-energy configuration actually
visited, the energy trace = the real mean NLL in nats (lower is better). β=1 samples the model’s
true conditional distribution; annealing is a real β schedule. Backward information flow is real:
a clamped ending propagates leftward through the chain factors.
What is a stand-in: the energy model. A browser cannot run LLaMA, so this page
uses a bigram chain-MRF built from the 126-sentence original corpus below (view source) — not a
transformer. The runtime semantics (energy + clamp mask + schedule, observe→constrain→relax→publish)
are identical to EXP-011 on THRML; the transformer-energy version of this exact interface is
EXP-012 on the Lightning L4, with the mechanism receipt already on file (EXP-010: clamped-Gibbs
infilling through GPT-2 attention, suffix-NLL +8.77/+11.50/+2.64 nats vs forward-only). This demo
runs exact heat-bath Gibbs, so there is no accept-rate gauge — accept/reject is a Metropolis
quantity and will appear on the LLaMA build, where it is real.
Toy vocabulary (words you can type in the chat bar)