Benchmark artifact
KV Cache Transformer Inference
Transformer inference internals lab comparing naive decoder-only autoregressive generation with KV-cache generation, including cache-equivalence checks, decode timing, memory-growth analysis, and a static benchmark report.
Inspect KV-cache equality, decode timing, speedup, and cache-growth samples.
Python
PyTorch
Transformers
TypeScript
Page expectations
What this route loads and what you should see.
Data source
Loads the benchmark artifact served by the static report container.
Expected result
Shows token equality, seconds/token, speedup, and cache-growth samples.
KV-cache benchmark
Loads the benchmark artifact served by the static report container.
Loading KV-cache benchmark artifact.