Struct CudaDevice 

pub struct CudaDevice<'a> {
    pub info: CudaDeviceInfo,
    /* private fields */
}

An open CUDA device and its context. Destroys the context on drop.

Fields

info: CudaDeviceInfo

The device’s static properties.

Implementations

impl<'a> CudaDevice<'a>

pub fn try_new(id: i32) -> Result<Self>

Opens device id, creating a new CUDA context for it.

pub fn info(&self) -> &CudaDeviceInfo

This device’s static properties.

impl<'a> CudaDevice<'a>

pub fn launch_with_packer<K: Kernel>( &self, program: &CudaProgram<'_, K>, cfg: &CudaLaunchConfig, packer: &mut CudaArgPacker, ) -> Result<()>

Launch a pre-loaded kernel using a dynamically-built arg list.

Use this instead of launch when the kernel type is erased (e.g. in LoadedModel::forward) and arguments are packed by CudaArgPacker via a RuntimeOp rather than a static Kernel::Args tuple.

Trait Implementations

impl<'a> Clone for CudaDevice<'a>

fn clone(&self) -> CudaDevice<'a>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Debug for CudaDevice<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'a> Device<'a> for CudaDevice<'a>

type Buffer<N: Num> = CudaBuffer<'a, N>

This device’s buffer type for elements of dtype N.

type Program<K: Kernel> = CudaProgram<'a, K>

This device’s compiled-program type for kernel K.

type LaunchConfig = CudaLaunchConfig

This device’s launch configuration type.

fn buffer<N: Num>(&self, count: usize) -> Result<Self::Buffer<N>>

Allocates a buffer for count elements of N.

fn launch<K: Kernel>( &self, program: &Self::Program<K>, cfg: &Self::LaunchConfig, args: K::Args<'a>, ) -> Result<()>

Launches program with the given launch cfg and args.

impl<'a> Drop for CudaDevice<'a>

fn drop(&mut self)

Executes the destructor for this type.

fn pin_drop(self: Pin<&mut Self>)

🔬This is a nightly-only experimental API. (pin_ergonomics)

Execute the destructor for this type, but different to Drop::drop, it requires self to be pinned.