Uses of Interface
io.github.kirstenali.deepj.activations.ActivationFunction

Packages that use ActivationFunction

Package	Description
io.github.kirstenali.deepj.activations
io.github.kirstenali.deepj.layers
io.github.kirstenali.deepj.layers.transformer.blocks
io.github.kirstenali.deepj.transformer

Uses of ActivationFunction in io.github.kirstenali.deepj.activations

Classes in io.github.kirstenali.deepj.activations that implement ActivationFunction

Modifier and Type	Class	Description
final class	GELU	Gaussian Error Linear Unit (GELU), using the tanh approximation popularized by GPT-2.
class	ReLU
class	Sigmoid
final class	SiLU	Sigmoid Linear Unit (SiLU / Swish).
final class	Softmax	Row-wise softmax for 2D tensors: applies softmax independently to each row.
class	Tanh

Uses of ActivationFunction in io.github.kirstenali.deepj.layers

Constructors in io.github.kirstenali.deepj.layers with parameters of type ActivationFunction

Modifier	Constructor	Description
	FNN(int inputSize, int[] hiddenSizes, int outputSize, Supplier<ActivationFunction> hiddenActivationFactory, ActivationFunction outputActivation, Random rnd)	Build an MLP of the form: Linear -> act -> Linear -> act -> ... -> Linear -> (optional outputAct)

Constructor parameters in io.github.kirstenali.deepj.layers with type arguments of type ActivationFunction

Modifier	Constructor	Description
	FNN(int inputSize, int[] hiddenSizes, int outputSize, Supplier<ActivationFunction> hiddenActivationFactory, ActivationFunction outputActivation, Random rnd)	Build an MLP of the form: Linear -> act -> Linear -> act -> ... -> Linear -> (optional outputAct)
	FNN(int inputSize, int[] hiddenSizes, int outputSize, Supplier<ActivationFunction> hiddenActivationFactory, Random rnd)

Uses of ActivationFunction in io.github.kirstenali.deepj.layers.transformer.blocks

Constructor parameters in io.github.kirstenali.deepj.layers.transformer.blocks with type arguments of type ActivationFunction

Modifier	Constructor	Description
	GPTTransformerBlock(int dModel, int nHeads, int dFF, Supplier<ActivationFunction> ffnActivationFactory, Random rnd)	Full constructor.

Uses of ActivationFunction in io.github.kirstenali.deepj.transformer

Method parameters in io.github.kirstenali.deepj.transformer with type arguments of type ActivationFunction

Modifier and Type	Method	Description
GPTTransformerBuilder	GPTTransformerBuilder.ffnActivation(Supplier<ActivationFunction> factory)	Activation inside the FFN.