Package io.github.kirstenali.deepj.transformer.embeddings

Class PositionalEmbedding

java.lang.Object

io.github.kirstenali.deepj.transformer.embeddings.PositionalEmbedding

All Implemented Interfaces:

Trainable

public final class PositionalEmbedding
extends Object
implements Trainable

Constructor Summary

Constructors

Constructor	Description
PositionalEmbedding(int maxSeq, int dModel, Random rnd)
PositionalEmbedding(int maxSeq, int dModel, Random rnd, ParameterFactory parameters)

Method Summary

Modifier and Type	Method	Description
Tensor	forward(int seqLen)
Tensor	forward(int seqLen, int offset)
List<Parameter>	parameters()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.github.kirstenali.deepj.training.Trainable

zeroGrad

Constructor Details

PositionalEmbedding

public PositionalEmbedding(int maxSeq,
 int dModel,
 Random rnd)

PositionalEmbedding

public PositionalEmbedding(int maxSeq,
 int dModel,
 Random rnd,
 ParameterFactory parameters)

Method Details

forward

public Tensor forward(int seqLen)

forward

public Tensor forward(int seqLen,
 int offset)

parameters

public List<Parameter> parameters()

Specified by:

parameters in interface Trainable