Uses of Interface
io.github.kirstenali.deepj.training.Trainable
Packages that use Trainable
Package
Description
-
Uses of Trainable in io.github.kirstenali.deepj.layers
Subinterfaces of Trainable in io.github.kirstenali.deepj.layersModifier and TypeInterfaceDescriptioninterfaceDifferentiable module mapping Tensor -> Tensor.interfaceMarker interface for linear projection layers (fully-connected, no activation).Classes in io.github.kirstenali.deepj.layers that implement Trainable -
Uses of Trainable in io.github.kirstenali.deepj.layers.transformer
Classes in io.github.kirstenali.deepj.layers.transformer that implement TrainableModifier and TypeClassDescriptionfinal classSwiGLU feed-forward layer — the FFN used in Llama, Mistral, Qwen, and DeepSeek. -
Uses of Trainable in io.github.kirstenali.deepj.layers.transformer.attention
Classes in io.github.kirstenali.deepj.layers.transformer.attention that implement TrainableModifier and TypeClassDescriptionfinal classCompact Multi-Head Latent Attention (MLA) inspired by DeepSeek-V2/V3.classMulti-head causal self-attention for a single sequence (no batch dimension).final classMulti-head self-attention with Rotary Positional Embedding (RoPE). -
Uses of Trainable in io.github.kirstenali.deepj.layers.transformer.blocks
Classes in io.github.kirstenali.deepj.layers.transformer.blocks that implement TrainableModifier and TypeClassDescriptionfinal classPre-LN transformer block with DeepSeek-style latent attention:classPre-LN GPT-style Transformer block:final classPre-LN transformer block with Llama-style full-head attention: -
Uses of Trainable in io.github.kirstenali.deepj.layers.transformer.norm
Subinterfaces of Trainable in io.github.kirstenali.deepj.layers.transformer.normModifier and TypeInterfaceDescriptioninterfaceMarker interface for row-wise normalisation layers (LayerNorm, RMSNorm, …).Classes in io.github.kirstenali.deepj.layers.transformer.norm that implement TrainableModifier and TypeClassDescriptionfinal classLayerNorm over feature dimension (cols) with trainable gamma/beta exposed asParameters.final classRoot-Mean-Square Layer Normalisation — the normalisation used in Llama, Mistral, Qwen, and DeepSeek. -
Uses of Trainable in io.github.kirstenali.deepj.models
Subinterfaces of Trainable in io.github.kirstenali.deepj.modelsModifier and TypeInterfaceDescriptioninterfaceCommon contract for decoder-only causal language models (GPT, Llama, DeepSeek, …).Classes in io.github.kirstenali.deepj.models that implement TrainableModifier and TypeClassDescriptionclassShared skeleton for decoder-only transformer models: token embedding → block stack → final norm → LM-head. -
Uses of Trainable in io.github.kirstenali.deepj.models.deepseek
Classes in io.github.kirstenali.deepj.models.deepseek that implement TrainableModifier and TypeClassDescriptionfinal classDeepSeek-style decoder-only transformer. -
Uses of Trainable in io.github.kirstenali.deepj.models.gpt
Classes in io.github.kirstenali.deepj.models.gpt that implement TrainableModifier and TypeClassDescriptionfinal classMinimal GPT-style decoder-only transformer for educational/training use. -
Uses of Trainable in io.github.kirstenali.deepj.models.llama
Classes in io.github.kirstenali.deepj.models.llama that implement Trainable -
Uses of Trainable in io.github.kirstenali.deepj.transformer
Classes in io.github.kirstenali.deepj.transformer that implement TrainableModifier and TypeClassDescriptionfinal recordA sequential stack of transformer blocks. -
Uses of Trainable in io.github.kirstenali.deepj.transformer.embeddings
Classes in io.github.kirstenali.deepj.transformer.embeddings that implement TrainableModifier and TypeClassDescriptionfinal classToken embedding: ids -> vectors.final classLearnable positional embeddings added to token embeddings.