Enum Error 

pub enum Error {
    Io(Error),
    SafeTensors(SafeTensorError),
    Read(Error),
    Json(Error),
    UnsupportedDtype {
        tensor: String,
        dtype: Dtype,
    },
    TensorNotFound(String),
    InvalidAxis {
        tensor: String,
        axis: usize,
        rank: usize,
    },
    InvalidGroupSize(String),
    ShapeMismatch {
        name: String,
        a: Vec<usize>,
        b: Vec<usize>,
    },
}

Errors produced by teeny-quant.

Variants

Io(Error)

An I/O operation (reading/writing a .safetensors file) failed.

SafeTensors(SafeTensorError)

Reading or writing the underlying .safetensors container failed.

Read(Error)

Reading the source checkpoint (via teeny-data) failed.

Json(Error)

Serializing/deserializing quantization metadata as JSON failed.

UnsupportedDtype

A tensor’s source dtype isn’t one this crate knows how to quantize/upcast.

Fields

tensor: String

The tensor’s name.

dtype: Dtype

The tensor’s on-disk dtype.

TensorNotFound(String)

A requested tensor doesn’t exist in the source checkpoint.

InvalidAxis

A quantization axis was out of range for the tensor’s rank.

Fields

tensor: String

The tensor’s name.

axis: usize

The requested axis.

rank: usize

The tensor’s rank.

InvalidGroupSize(String)

A group size of 0 was requested for group-wise quantization.

ShapeMismatch

Two tensors that should describe the same underlying weight (e.g. a weight and its dequantized reconstruction) have different shapes.

Fields

name: String

The tensor’s name.

a: Vec<usize>

The first shape.

b: Vec<usize>

The second shape.

Trait Implementations

impl Debug for Error

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for Error

fn fmt(&self, __formatter: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Error for Error

fn source(&self) -> Option<&(dyn Error + 'static)>

Returns the lower-level source of this error, if any.

fn description(&self) -> &str

👎Deprecated since 1.42.0:

use the Display impl or to_string()

fn cause(&self) -> Option<&dyn Error>

👎Deprecated since 1.33.0:

replaced by Error::source, which can support downcasting

fn provide<'a>(&'a self, request: &mut Request<'a>)

🔬This is a nightly-only experimental API. (error_generic_member_access)

Provides type-based access to context intended for error reports.

impl From<Error> for Error

fn from(source: Error) -> Self

Converts to this type from the input type.

impl From<Error> for Error

fn from(source: Error) -> Self

Converts to this type from the input type.

impl From<Error> for Error

fn from(source: Error) -> Self

Converts to this type from the input type.

impl From<SafeTensorError> for Error

fn from(source: SafeTensorError) -> Self

Converts to this type from the input type.