Skip to content

normalisation

Module: normalisation.py

This module implements normalisation layers for Neural Networks

Authors
  • Lokesh Mohanty (lokeshm@iisc.ac.in)
Version Info
  • 06/01/2025: Initial version

BatchNorm

Bases: BatchNorm

Implements a Batch Normalization layer

Source code in scirex/core/dl/nn/layers/normalisation.py 
59
60
61
62
class BatchNorm(eqx.nn.BatchNorm):
    """
    Implements a Batch Normalization layer
    """

GroupNorm

Bases: GroupNorm

Implements a Group Normalization layer

Source code in scirex/core/dl/nn/layers/normalisation.py 
53
54
55
56
class GroupNorm(eqx.nn.GroupNorm):
    """
    Implements a Group Normalization layer
    """

LayerNorm

Bases: LayerNorm

Implements a Layer Normalization layer

Source code in scirex/core/dl/nn/layers/normalisation.py 
41
42
43
44
class LayerNorm(eqx.nn.LayerNorm):
    """
    Implements a Layer Normalization layer
    """

RMSNorm

Bases: RMSNorm

Implements a RMS Normalization layer

Source code in scirex/core/dl/nn/layers/normalisation.py 
47
48
49
50
class RMSNorm(eqx.nn.RMSNorm):
    """
    Implements a RMS Normalization layer
    """

SpectralNorm

Bases: SpectralNorm

Implements a Spectral Normalization layer

Source code in scirex/core/dl/nn/layers/normalisation.py 
65
66
67
68
class SpectralNorm(eqx.nn.SpectralNorm):
    """
    Implements a Spectral Normalization layer
    """

WeightNorm

Bases: WeightNorm

Implements a Weight Normalization layer

Source code in scirex/core/dl/nn/layers/normalisation.py 
71
72
73
74
class WeightNorm(eqx.nn.WeightNorm):
    """
    Implements a Weight Normalization layer
    """