Package io.github.kirstenali.deepj.transformer

Class TransformerBuilder

java.lang.Object

io.github.kirstenali.deepj.transformer.TransformerBuilder

public final class TransformerBuilder
extends Object

Convenience builder for assembling transformer stacks.

deepj is transformer-oriented: this builder replaces generic network builders.

Constructor Summary

Constructors

Constructor	Description
TransformerBuilder()

Method Summary

Modifier and Type	Method	Description
TransformerStack	build()
TransformerBuilder	dFF(int dFF)
TransformerBuilder	dModel(int dModel)
TransformerBuilder	ffnActivation(Supplier<ActivationFunction> activationFactory)	Activation used inside the FFN.
TransformerBuilder	nHeads(int nHeads)
TransformerBuilder	nLayers(int nLayers)
TransformerBuilder	random(Random rnd)
TransformerBuilder	seed(long seed)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

TransformerBuilder

public TransformerBuilder()

Method Details

dModel

public TransformerBuilder dModel(int dModel)

nHeads

public TransformerBuilder nHeads(int nHeads)

dFF

public TransformerBuilder dFF(int dFF)

nLayers

public TransformerBuilder nLayers(int nLayers)

ffnActivation

public TransformerBuilder ffnActivation(Supplier<ActivationFunction> activationFactory)

Activation used inside the FFN. Default: GELU.

seed

public TransformerBuilder seed(long seed)

random

public TransformerBuilder random(Random rnd)

build

public TransformerStack build()