teeny-llm: LLM inference server for teenygrad.
teeny-llm
Early scaffolding โ planned direction is an interactive mode plus an OpenAPI-compatible HTTP server mode in this one binary. See the crate README.