Package io.github.kirstenali.deepj.transformer.embeddings

Class Embedding

java.lang.Object

io.github.kirstenali.deepj.transformer.embeddings.Embedding

All Implemented Interfaces:

Trainable

public final class Embedding
extends Object
implements Trainable

Constructor Summary

Constructors

Constructor	Description
Embedding(int vocabSize, int dModel, Random rnd)
Embedding(int vocabSize, int dModel, Random rnd, ParameterFactory parameters)

Method Summary

Modifier and Type	Method	Description
Tensor	forward(int[] ids)
Tensor	forwardBatch(int[][] sequences)
List<Parameter>	parameters()
Parameter	weight()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.github.kirstenali.deepj.training.Trainable

zeroGrad

Constructor Details

Embedding

public Embedding(int vocabSize,
 int dModel,
 Random rnd)

Embedding

public Embedding(int vocabSize,
 int dModel,
 Random rnd,
 ParameterFactory parameters)

Method Details

forward

public Tensor forward(int[] ids)

forwardBatch

public Tensor forwardBatch(int[][] sequences)

weight

public Parameter weight()

parameters

public List<Parameter> parameters()

Specified by:

parameters in interface Trainable