Module quantize 

teeny-quant quantize: reads a .safetensors checkpoint and writes a quantized one.

Structs

QuantizeArgs

teeny-quant quantize arguments.

Enums

Fp8VariantArg

--fp8-variant values.

GranularityArg

--granularity values.

SchemeArg

--scheme values.

Functions

run

Runs teeny-quant quantize.