Uses of Class
io.github.kirstenali.deepj.optimisers.ParameterFactory
Packages that use ParameterFactory
Package
Description
Neural networks composed from DeepJ tensors, layers, autograd and backend operations.
-
Uses of ParameterFactory in io.github.kirstenali.deepj.layers
Constructors in io.github.kirstenali.deepj.layers with parameters of type ParameterFactoryModifierConstructorDescriptionBiasFreeLinear(int inputs, int outputs, Random random, ParameterFactory parameters) Linear(int dIn, int dOut, Random rnd, ParameterFactory parameters) -
Uses of ParameterFactory in io.github.kirstenali.deepj.layers.transformer
Constructors in io.github.kirstenali.deepj.layers.transformer with parameters of type ParameterFactoryModifierConstructorDescriptionSwiGLULayer(int dModel, int dFF, Random rnd, boolean bias, ParameterFactory parameters) -
Uses of ParameterFactory in io.github.kirstenali.deepj.layers.transformer.attention
Constructors in io.github.kirstenali.deepj.layers.transformer.attention with parameters of type ParameterFactoryModifierConstructorDescriptionGroupedQueryAttention(DeepJNovaConfig config, Random random, ParameterFactory parameters) MultiHeadLatentAttention(int dModel, int nHeads, int qRank, int kvRank, RotaryEmbedding rope, Random rnd, ParameterFactory parameters) MultiHeadSelfAttention(int dModel, int nHeads, boolean causalMask, Random rnd, ParameterFactory parameters) RoPEMultiHeadSelfAttention(int dModel, int nHeads, boolean causalMask, RotaryEmbedding rope, Random rnd, ParameterFactory parameters) -
Uses of ParameterFactory in io.github.kirstenali.deepj.layers.transformer.blocks
Constructors in io.github.kirstenali.deepj.layers.transformer.blocks with parameters of type ParameterFactoryModifierConstructorDescriptionDeepJNovaTransformerBlock(DeepJNovaConfig config, Random random, float residualScale, ParameterFactory parameters) DeepJOrbitTransformerBlock(int dModel, int nHeads, int dFF, int maxSeqLen, Random rnd, ParameterFactory parameters) DeepJOriginTransformerBlock(int dModel, int nHeads, int dFF, Supplier<ActivationFunction> ffnActivationFactory, Random rnd, ParameterFactory parameters) DeepJPrismTransformerBlock(int dModel, int nHeads, int qRank, int kvRank, int dFF, int maxSeqLen, Random rnd, ParameterFactory parameters) -
Uses of ParameterFactory in io.github.kirstenali.deepj.layers.transformer.norm
Constructors in io.github.kirstenali.deepj.layers.transformer.norm with parameters of type ParameterFactoryModifierConstructorDescriptionLayerNorm1D(int dim, ParameterFactory parameters) RMSNorm1D(int dim, ParameterFactory parameters) -
Uses of ParameterFactory in io.github.kirstenali.deepj.nn
Constructors in io.github.kirstenali.deepj.nn with parameters of type ParameterFactoryModifierConstructorDescriptionBatchNorm(int channels, float epsilon, float momentum, ParameterFactory parameters) Conv1D(int inputs, int outputs, int kernel, int stride, int padding, int dilation, boolean bias, Random random, ParameterFactory parameters) Conv2D(int inputs, int outputs, Window2D window, boolean bias, Random random, ParameterFactory parameters) EncoderAttention(int width, int heads, float dropout, Random random, ParameterFactory parameters) FNN(int inputSize, int[] hiddenSizes, int outputSize, Supplier<ActivationFunction> hiddenActivationFactory, ActivationFunction outputActivation, Random rnd, ParameterFactory parameters) GRU(int inputs, int hidden, Random random, ParameterFactory parameters) GRUCell(int inputs, int hidden, Random random, ParameterFactory parameters) LSTM(int inputs, int hidden, Random random, ParameterFactory parameters) LSTMCell(int inputs, int hidden, Random random, ParameterFactory parameters) protectedRecurrentCell(int inputs, int hidden, int gates, Random random, ParameterFactory parameters) RNN(int inputs, int hidden, Random random, ParameterFactory parameters) RNNCell(int inputs, int hidden, Random random, ParameterFactory parameters) TransformerEncoder(TransformerEncoderConfig config, Random random, ParameterFactory parameters) TransformerEncoderLayer(TransformerEncoderConfig config, Random random, ParameterFactory parameters) -
Uses of ParameterFactory in io.github.kirstenali.deepj.nn.transformer.loop
Constructors in io.github.kirstenali.deepj.nn.transformer.loop with parameters of type ParameterFactoryModifierConstructorDescriptionDeepJLoop(DeepJLoopConfig config, long seed, ParameterFactory parameters) -
Uses of ParameterFactory in io.github.kirstenali.deepj.nn.transformer.nova
Constructors in io.github.kirstenali.deepj.nn.transformer.nova with parameters of type ParameterFactoryModifierConstructorDescriptionDeepJNova(DeepJNovaConfig config, long seed, ParameterFactory parameters) -
Uses of ParameterFactory in io.github.kirstenali.deepj.nn.transformer.orbit
Constructors in io.github.kirstenali.deepj.nn.transformer.orbit with parameters of type ParameterFactoryModifierConstructorDescriptionDeepJOrbit(DeepJOrbitConfig cfg, long seed, ParameterFactory parameters) -
Uses of ParameterFactory in io.github.kirstenali.deepj.nn.transformer.origin
Constructors in io.github.kirstenali.deepj.nn.transformer.origin with parameters of type ParameterFactoryModifierConstructorDescriptionDeepJOrigin(DeepJOriginConfig cfg, long seed, ParameterFactory parameters) -
Uses of ParameterFactory in io.github.kirstenali.deepj.nn.transformer.prism
Constructors in io.github.kirstenali.deepj.nn.transformer.prism with parameters of type ParameterFactoryModifierConstructorDescriptionDeepJPrism(DeepJPrismConfig cfg, long seed, ParameterFactory parameters) -
Uses of ParameterFactory in io.github.kirstenali.deepj.optimisers
Methods in io.github.kirstenali.deepj.optimisers that return ParameterFactoryModifier and TypeMethodDescriptionstatic ParameterFactoryParameterFactory.float32()ParameterFactory.forLoading()Zero-filled random-weight slots for a complete checkpoint replacement, without device initialization. -
Uses of ParameterFactory in io.github.kirstenali.deepj.persistence
Methods in io.github.kirstenali.deepj.persistence that return ParameterFactory -
Uses of ParameterFactory in io.github.kirstenali.deepj.transformer
Methods in io.github.kirstenali.deepj.transformer with parameters of type ParameterFactoryModifier and TypeMethodDescriptionDeepJOrbitTransformerBuilder.parameters(ParameterFactory factory) DeepJOriginTransformerBuilder.parameters(ParameterFactory factory) DeepJPrismTransformerBuilder.parameters(ParameterFactory factory) Constructors in io.github.kirstenali.deepj.transformer with parameters of type ParameterFactoryModifierConstructorDescriptionLoopedTransformer(DeepJLoopConfig config, Random random, ParameterFactory parameters) -
Uses of ParameterFactory in io.github.kirstenali.deepj.transformer.embeddings
Constructors in io.github.kirstenali.deepj.transformer.embeddings with parameters of type ParameterFactoryModifierConstructorDescriptionEmbedding(int vocabSize, int dModel, Random rnd, ParameterFactory parameters) PositionalEmbedding(int maxSeq, int dModel, Random rnd, ParameterFactory parameters)