LLMTraceFX Ships Deterministic KV-Cache Auditor, Verifying Attestations and Detecting Evictions
Summary
LLMTraceFX ships a deterministic KV-cache auditor in merged PR #74 that independently verifies cache attestations and flags evictions, confirming token-identical cached outputs across 10 synthetic tests while showing an exact duplicate reuses 8 of 9 tokens.
Key Points
- LLMTraceFX ships a deterministic KV-cache truth auditor in merged PR #74 that verifies engine cache attestations against an independent oracle, observed prompt work, output identity, evaluator results and a hash-bound evidence bundle.
- Across 10 synthetic cases, every engine attestation matches the oracle and observed work, while cached and no-cache outputs remain token-identical and evaluators pass; an exact duplicate reuses 8 of 9 tokens and processes 1.
- Controlled capacity pressure causes a later four-token revisit to receive the typed verdict "evicted," while namespace isolation forces zero reuse even for an otherwise matching request.