Package io.github.kirstenali.deepj.layers.transformer.norm

package io.github.kirstenali.deepj.layers.transformer.norm

Related Packages

Package	Description
io.github.kirstenali.deepj.layers.transformer
io.github.kirstenali.deepj.layers.transformer.attention
io.github.kirstenali.deepj.layers.transformer.blocks

Class	Description
LayerNorm1D	LayerNorm over feature dimension (cols) with trainable gamma/beta exposed as Parameters.
NormLayer	Marker interface for row-wise normalisation layers (LayerNorm, RMSNorm, …).
RMSNorm1D	Root-Mean-Square Layer Normalisation — the normalisation used in Llama, Mistral, Qwen, and DeepSeek.