Struct NadamStep 

pub struct NadamStep {
    pub name: &'static str,
    pub id: String,
    pub block_size: i32,
    pub kernel_source: String,
    pub entry_point_source: String,
    pub source: String,
}

NAdam step (Nesterov-accelerated Adam).

All bias correction terms and Nesterov coefficients are precomputed on the host and passed as scalars:

exp_avg    = beta1 * exp_avg    + (1 - beta1) * g
exp_avg_sq = beta2 * exp_avg_sq + (1 - beta2) * g²
denom      = sqrt(exp_avg_sq) / bias_corr2_sqrt + eps
p         -= lr * (coeff_g * g + coeff_m * exp_avg) / denom

Precomputed on host:

• bias_corr2_sqrt = sqrt(1 - beta2^t)
• coeff_g = (1 - mu_t) / (1 - mu_product) (grad contribution)
• coeff_m = mu_t1 / (1 - mu_product_next) (moment contribution)

Grid: [ceil(n_elements / BLOCK_SIZE), 1, 1].

Fields

name: &'static str

The kernel function’s name (e.g. "flash_attention2_forward").

id: String

Unique kernel identifier: fn_name + dtype(s) + const values joined by “__”.

block_size: i32

Compile-time kernel constant, from the annotated fn’s const generics.

kernel_source: String

The original kernel function source.

entry_point_source: String

The Rust source of the generated C-ABI entry-point wrapper function.

source: String

Combined source (kernel_source + "\n\n" + entry_point_source); used by the Kernel trait.

Implementations

impl NadamStep

pub fn new(block_size: i32) -> Self

Constructs a new kernel instance for these compile-time parameters.

Trait Implementations

impl Kernel for NadamStep

type Args<'__a> = (*mut f32, *mut f32, *mut f32, *mut f32, i32, f32, f32, f32, f32, f32, f32, f32, f32)

This kernel’s launch-argument tuple type.

fn id(&self) -> String

A content hash of this kernel’s source, used as a cache key.

fn name(&self) -> &str

This kernel’s name.

fn source(&self) -> &str

This kernel’s full source (DSL + kernel body + entry point wrapper).

fn kernel_source(&self) -> &str

This kernel’s body source, without the entry-point wrapper.

fn entry_point_source(&self) -> &str

Returns the Rust source of the generated C-ABI entry-point wrapper function.

fn entry_point_name(&self) -> String

Returns the PTX symbol name for this kernel: "{name}_entry_point".