Uses of Interface
io.github.kirstenali.deepj.layers.Layer
Packages that use Layer
Package
Description
-
Uses of Layer in io.github.kirstenali.deepj.layers
Subinterfaces of Layer in io.github.kirstenali.deepj.layersModifier and TypeInterfaceDescriptioninterfaceMarker interface for linear projection layers (fully-connected, no activation).Classes in io.github.kirstenali.deepj.layers that implement Layer -
Uses of Layer in io.github.kirstenali.deepj.layers.transformer
Classes in io.github.kirstenali.deepj.layers.transformer that implement LayerModifier and TypeClassDescriptionfinal classSwiGLU feed-forward layer — the FFN used in Llama, Mistral, Qwen, and DeepSeek. -
Uses of Layer in io.github.kirstenali.deepj.layers.transformer.attention
Classes in io.github.kirstenali.deepj.layers.transformer.attention that implement LayerModifier and TypeClassDescriptionfinal classCompact Multi-Head Latent Attention (MLA) inspired by DeepSeek-V2/V3.classMulti-head causal self-attention for a single sequence (no batch dimension).final classMulti-head self-attention with Rotary Positional Embedding (RoPE). -
Uses of Layer in io.github.kirstenali.deepj.layers.transformer.blocks
Classes in io.github.kirstenali.deepj.layers.transformer.blocks that implement LayerModifier and TypeClassDescriptionfinal classPre-LN transformer block with DeepSeek-style latent attention:classPre-LN GPT-style Transformer block:final classPre-LN transformer block with Llama-style full-head attention:Methods in io.github.kirstenali.deepj.layers.transformer.blocks that return Layer -
Uses of Layer in io.github.kirstenali.deepj.layers.transformer.norm
Subinterfaces of Layer in io.github.kirstenali.deepj.layers.transformer.normModifier and TypeInterfaceDescriptioninterfaceMarker interface for row-wise normalisation layers (LayerNorm, RMSNorm, …).Classes in io.github.kirstenali.deepj.layers.transformer.norm that implement LayerModifier and TypeClassDescriptionfinal classLayerNorm over feature dimension (cols) with trainable gamma/beta exposed asParameters.final classRoot-Mean-Square Layer Normalisation — the normalisation used in Llama, Mistral, Qwen, and DeepSeek. -
Uses of Layer in io.github.kirstenali.deepj.training
Methods in io.github.kirstenali.deepj.training with parameters of type LayerModifier and TypeMethodDescriptionstatic TrainerSupervisedTraining.trainer(Layer model, LossFunction lossFn, ParameterOptimizer opt, Tensor xAll, Tensor yAll, long seed) -
Uses of Layer in io.github.kirstenali.deepj.transformer
Classes in io.github.kirstenali.deepj.transformer that implement LayerModifier and TypeClassDescriptionfinal recordA sequential stack of transformer blocks.Methods in io.github.kirstenali.deepj.transformer that return types with arguments of type LayerModifier and TypeMethodDescriptionTransformerStack.blocks()Returns the value of theblocksrecord component.Constructor parameters in io.github.kirstenali.deepj.transformer with type arguments of type LayerModifierConstructorDescriptionTransformerStack(List<Layer> blocks) Creates an instance of aTransformerStackrecord class.