tag
caching
3 posts.
-
The dedupe key was set before the fetch, so it never retried
One connection refusal during gateway boot silenced the side panel for that URL forever: the dedupe key was committed before the request settled.
-
Why My LLM Agent Fabricated Numbers From Stale Context
An agent replayed a ten-minute-old CPU reading as live. The bug wasn't the model: a guard checked whether cached tool output existed, not whether it was fresh.
-
cached_tokens is 0 because your system prompt isn't stable
Our provider reported cached_tokens 0 of ~16K prompt tokens every turn. The cause: per-turn memory glued into the system prompt. Freeze the prefix instead.