Skip to main content

Module cli

Module cli 

Source
Expand description

The teeny-quant binary’s command-line interface.

Modules§

inspect
teeny-quant inspect: lists a checkpoint’s tensors (and, if present, its quantization_config).
quantize
teeny-quant quantize: reads a .safetensors checkpoint and writes a quantized one.
validate
teeny-quant validate: per-tensor quantization error metrics (see crate::validate).

Structs§

Cli
Quantize .safetensors model checkpoints for deployment.

Enums§

Command
teeny-quant subcommands.