Expand description
The teeny-quant binary’s command-line interface.
Modules§
- inspect
teeny-quant inspect: lists a checkpoint’s tensors (and, if present, itsquantization_config).- quantize
teeny-quant quantize: reads a.safetensorscheckpoint and writes a quantized one.- validate
teeny-quant validate: per-tensor quantization error metrics (seecrate::validate).
Structs§
- Cli
- Quantize
.safetensorsmodel checkpoints for deployment.
Enums§
- Command
teeny-quantsubcommands.