Module model 

Loaded-model execution.

Structs

ActivationCache

Activation buffers retained from a forward_train call.

AdamwKernel

A pre-compiled adamw_step kernel ready for use in LoadedModel::adamw_step.

CompiledNode

One PTX-compiled graph node: where its compiled kernel lives on disk, its output shape/dtype, and how to dispatch it at runtime.

CudaGraphModel

A CUDA graph compiled from a LoadedModel for fixed-batch inference.

CudaModel

A compiled model: a DAG of CompiledNodes, not yet loaded into GPU memory. Call CudaModel::load to load it and get a runnable LoadedModel.

LoadedModel

A CudaModel with all kernels loaded into GPU memory and parameter buffers allocated, ready to run inference (and, with the training feature, training steps).

TensorRef

A reference to a device-side tensor: raw device pointer + concrete shape.