Skip to main content

should_quantize

Function should_quantize 

Source
pub fn should_quantize(shape: &[usize], dtype: Dtype) -> bool
Expand description

Whether a tensor should be quantized: rank >= 2 (so biases/norm weights are left alone) and a dtype crate::read::read_f32 can upcast from.