Episode 00 · Recorded study

Warm-up

Name: Token by Token Episode 00 public aggregate data
License: https://github.com/KVSDURGASURESH/token-by-token/blob/main/LICENSE

Follow a request through prefill, decode and the KV cache. Explore the recorded vLLM and SGLang runs, their costs and the limits of the comparison.