Enum DotFormat 

pub enum DotFormat {
    E4M3,
    E5M2,
    E2M1x2,
    E2M1x4,
    BF16x2,
    Int8,
    UInt8,
}

Input format for scaled dot-product (dot_scaled).

Variants

E4M3

8-bit float, 4 exponent + 3 mantissa bits.

E5M2

8-bit float, 5 exponent + 2 mantissa bits.

E2M1x2

4-bit float (2 exponent + 1 mantissa bit), packed 2-per-byte.

E2M1x4

4-bit float (2 exponent + 1 mantissa bit), packed 4-per-byte.

BF16x2

bfloat16, packed 2-per-32-bits.

Int8

Signed 8-bit integer.

UInt8

Unsigned 8-bit integer.