Crate teeny_cache 

Key-value cache utilities for LLM inference in teenygrad — currently DynamicCache, tracking sequence length and per-layer sliding-window/compileability state across generation steps.

Structs

DynamicCache

Tracks per-layer KV cache state (sequence length, sliding-window/compileability) across generation steps.