Skip to main content

GroupNorm

Struct GroupNorm 

Source
pub struct GroupNorm<D: Dtype, IT, OT, const RANK: usize> {
    pub num_groups: usize,
    pub num_channels: usize,
    pub eps: f64,
    pub affine: bool,
    /* private fields */
}
Expand description

Group normalisation over num_groups groups of channels.

Input shape: [N, C, *] — normalises over (C/num_groups, *) per sample. Output shape: same as input.

Parameters:

  • num_groups — number of groups to divide C into (must divide C evenly)
  • num_channels — number of channels C
  • eps — numerical stability constant (default 1e-5)
  • affine — if true, learns per-channel γ and β (default true)

Fields§

§num_groups: usize

Number of groups to divide the channels into.

§num_channels: usize

Number of channels.

§eps: f64

Numerical stability constant added to the variance.

§affine: bool

Whether to learn per-channel scale (gamma) and shift (beta) parameters.

Implementations§

Source§

impl<D: Dtype, IT, OT, const RANK: usize> GroupNorm<D, IT, OT, RANK>

Source

pub fn new(num_groups: usize, num_channels: usize) -> Self

Creates a new layer with default eps, affine on.

Source

pub fn with_eps(self, eps: f64) -> Self

Sets the numerical stability constant.

Source

pub fn with_affine(self, affine: bool) -> Self

Sets whether to learn per-channel scale/shift parameters.

Trait Implementations§

Source§

impl<D: Dtype, IT: Tensor<D, RANK> + EagerTensor, OT: Tensor<D, RANK>, const RANK: usize> Layer<IT> for GroupNorm<D, IT, OT, RANK>

Source§

type Output = OT

This layer’s output type.
Source§

fn call(&self, _input: IT) -> Self::Output

Applies this layer to input.
Source§

impl<D: Dtype, const RANK: usize> Layer<SymTensor> for GroupNorm<D, SymTensor, SymTensor, RANK>

Source§

type Output = SymTensor

This layer’s output type.
Source§

fn call(&self, input: SymTensor) -> SymTensor

Applies this layer to input.

Auto Trait Implementations§

§

impl<D, IT, OT, const RANK: usize> Freeze for GroupNorm<D, IT, OT, RANK>

§

impl<D, IT, OT, const RANK: usize> RefUnwindSafe for GroupNorm<D, IT, OT, RANK>

§

impl<D, IT, OT, const RANK: usize> Send for GroupNorm<D, IT, OT, RANK>
where D: Send, IT: Send, OT: Send,

§

impl<D, IT, OT, const RANK: usize> Sync for GroupNorm<D, IT, OT, RANK>
where D: Sync, IT: Sync, OT: Sync,

§

impl<D, IT, OT, const RANK: usize> Unpin for GroupNorm<D, IT, OT, RANK>
where D: Unpin, IT: Unpin, OT: Unpin,

§

impl<D, IT, OT, const RANK: usize> UnsafeUnpin for GroupNorm<D, IT, OT, RANK>

§

impl<D, IT, OT, const RANK: usize> UnwindSafe for GroupNorm<D, IT, OT, RANK>
where D: UnwindSafe, IT: UnwindSafe, OT: UnwindSafe,

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.