Uses of Interface
io.github.kirstenali.deepj.layers.transformer.norm.NormLayer
Packages that use NormLayer
Package
Description
-
Uses of NormLayer in io.github.kirstenali.deepj.layers.transformer.norm
Classes in io.github.kirstenali.deepj.layers.transformer.norm that implement NormLayerModifier and TypeClassDescriptionfinal classLayerNorm over feature dimension (cols) with trainable gamma/beta exposed asParameters.final classRoot-Mean-Square Layer Normalisation — the normalisation used in Llama, Mistral, Qwen, and DeepSeek. -
Uses of NormLayer in io.github.kirstenali.deepj.models
Fields in io.github.kirstenali.deepj.models declared as NormLayerConstructors in io.github.kirstenali.deepj.models with parameters of type NormLayerModifierConstructorDescriptionprotectedDecoderOnlyModel(Embedding tokEmb, TransformerStack stack, NormLayer normF, Projection lmHead)