Struct RadamAdaptiveStep 

pub struct RadamAdaptiveStep {
    pub name: &'static str,
    pub id: String,
    pub block_size: i32,
    pub kernel_source: String,
    pub entry_point_source: String,
    pub source: String,
}

RAdam step — adaptive variance phase (rho_t > 5).

exp_avg    = beta1 * exp_avg    + (1 - beta1) * g
exp_avg_sq = beta2 * exp_avg_sq + (1 - beta2) * g²
denom      = sqrt(exp_avg_sq / bias_correction2) + eps
p         -= step_size * exp_avg / denom

step_size = lr * rect / bias_correction1 is precomputed on host, where rect = sqrt((rho_t-4)(rho_t-2)*rho_inf / ((rho_inf-4)(rho_inf-2)*rho_t)).

Grid: [ceil(n_elements / BLOCK_SIZE), 1, 1].

Fields

name: &'static str

The kernel function’s name (e.g. "flash_attention2_forward").

id: String

Unique kernel identifier: fn_name + dtype(s) + const values joined by “__”.

block_size: i32

Compile-time kernel constant, from the annotated fn’s const generics.

kernel_source: String

The original kernel function source.

entry_point_source: String

The Rust source of the generated C-ABI entry-point wrapper function.

source: String

Combined source (kernel_source + "\n\n" + entry_point_source); used by the Kernel trait.

Implementations

impl RadamAdaptiveStep

pub fn new(block_size: i32) -> Self

Constructs a new kernel instance for these compile-time parameters.

Trait Implementations

impl Kernel for RadamAdaptiveStep

type Args<'__a> = (*mut f32, *mut f32, *mut f32, *mut f32, i32, f32, f32, f32, f32, f32, f32)

This kernel’s launch-argument tuple type.

fn id(&self) -> String

A content hash of this kernel’s source, used as a cache key.

fn name(&self) -> &str

This kernel’s name.

fn source(&self) -> &str

This kernel’s full source (DSL + kernel body + entry point wrapper).

fn kernel_source(&self) -> &str

This kernel’s body source, without the entry-point wrapper.

fn entry_point_source(&self) -> &str

Returns the Rust source of the generated C-ABI entry-point wrapper function.

fn entry_point_name(&self) -> String

Returns the PTX symbol name for this kernel: "{name}_entry_point".