Skip to main content

Module radam

teeny_kernels::nn::optim

Module radam 

Source

Structs§

RadamAdaptiveStep
RAdam step — adaptive variance phase (rho_t > 5).
RadamSgdStep
RAdam step — SGD fallback phase (rho_t <= 5).

Functions§

radam_adaptive_step
RAdam step — adaptive variance phase (rho_t > 5).
radam_sgd_step
RAdam step — SGD fallback phase (rho_t <= 5).