Struct CudaRuntime 

pub struct CudaRuntime<'a> {
    pub device: CudaDevice<'a>,
}

The CUDA Runtime implementation: executes a CudaModel on a CudaDevice.

Fields

device: CudaDevice<'a>

The device this runtime executes on.

Trait Implementations

impl<'a> Runtime<'a> for CudaRuntime<'a>

type Model = CudaModel<'a>

The model type this runtime executes.

type Input = TensorRef

This runtime’s input type.

type Output = TensorRef

This runtime’s output type.

fn forward<D: Dtype, const RANK: usize>( &self, _model: &Self::Model, _input: &Self::Input, ) -> Result<Self::Output>

Runs model on input.