🌊Wet‑Ink

Sliding-window frontier decoding for diffusion language models — the frontier commits one token per step; a window of W tokens behind it stays editable (the model's own trained T2T gate); at distance W the ink dries.

📄 Model card & article 💻 GitHub — code & data 🌐 Paper website (EN / RU / UZ) 🤖 Base model: LLaDA2.2‑mini

Interactive decoder the real schedule of the v5 kernel — tune W and watch revision opportunities appear and vanish

committed & dry — frozen forever wet window W — T2T gate may rewrite still masked frontier
W 16
speed 1×
step 0
NFE 0
opened 0
T2T rewrites 0

How it works every mechanism is reused verbatim from the base model — the schedule is the only new variable

➡️

One-token frontier

Each diffusion step opens exactly the leftmost remaining mask and commits it AR-style (greedy at T=0). Progress is guaranteed: one mask fewer per step — the AR end of the BD3-LM / Set Diffusion spectrum.

💧

Wet window W

Positions [f−W, f) stay revisable through LLaDA2.2's trained gate p0 > θ & old ≠ x0 — with its SPLIT/DELETE edit ops and anti-loop resampler, all verbatim (L-EBPO).

🔒

Hard dry edge

Outside the window editing_confidence = −∞: a token that leaves the window is never touched again. Ink dries with distance — exactly the owner's §2.1 idea.

Results GSM8K, first 45 tasks · greedy · gen_length 160 · 2×T4 · 4-bit NF4 · paired vs the completed v4b run

ArmnAccuracyWilson 95% CIMean NFERewrites/task
wetink_w16 (the method, W=16)4524.4%[14.2, 38.7]206.66.9
noedit_w16 (frontier only)2213.6%[4.7, 33.3]201.10
wetink_w8 (narrow window)1020.0%[5.7, 51.0]202.75.6
stock_b32 (v4b baseline)8022.5%[14.7, 32.8]42.5—
noedit_b32 (v4b, editing off)8023.8%[15.8, 34.1]50.1—
p = 1.0
paired exact McNemar
wetink_w16 vs stock (11/45 = 11/45)
×4.88
NFE cost (42 → 207 paired)
structural, no churn explosion
0 / 22
outcomes flipped by window edits
on common tasks
6.9
real rewrites per task
(churn 5.6) — the gate does fire
Honest finding: the raw +10.8 pp gap vs the frontier-only control is a task-composition artifact — the control stopped on the hard tasks 0–21 (every arm: 13.6% there; easy tasks 22–44: 34.8%). Window rewrites flipped no paired outcome. Third consecutive round where inference-time revision is quality-neutral on this family — published as a negative result.

Journey five versions, one idea — full data in the GitHub repo

VersionBaseApproachOutcome
v1Nemotron‑Diffusion‑3Bconfidence-gate re-masking each stock stepquality ↑, 13× NFE churn (broke termination)
v2Nemotron‑Diffusion‑3Bfull published cycles (RemeDi / CoDR)termination guaranteed; RemeDi harmful
v3Nemotron‑Diffusion‑3Bfull benchmark, n=200+164RemeDi −19.5..−31.5 pp (p<0.001); CoDR neutral
v4bLLaDA2.2‑ministock generate() study, 12 arms, n=403stock gate neutral; window doesn't slide
v5LLaDA2.2‑miniown wet-ink frontier decoderpaired-identical to stock (p=1.0) at ×4.88 NFE

Direction for v6: a k>1-token frontier (NFE ÷ k), rewrite-distance telemetry (a direct measurement of the ink-drying profile), n ≥ 500 per arm.