Interface NormLayer
- All Known Implementing Classes:
LayerNorm1D,RMSNorm1D
Marker interface for row-wise normalisation layers (LayerNorm, RMSNorm, …).
Narrows Layer to layers whose sole job is to normalise the feature
dimension of a [seqLen × dim] tensor. Used as the field type for the
final-norm slot in DecoderOnlyModel
so the constructor rejects anything that is not a normalisation layer.
-
Method Summary
Methods inherited from interface io.github.kirstenali.deepj.training.Trainable
parameters, zeroGrad