Skip to main content

Crate teeny_llm

Crate teeny_llm 

Source
Expand description

teeny-llm: LLM inference server for teenygrad.

Early scaffolding โ€” planned direction is an interactive mode plus an OpenAPI-compatible HTTP server mode in this one binary. See the crate README.

Functionsยง

main ๐Ÿ”’