Uses of Class
io.github.kirstenali.deepj.transformer.embeddings.RotaryEmbedding

Packages that use RotaryEmbedding

Package	Description
io.github.kirstenali.deepj.inference
io.github.kirstenali.deepj.layers.transformer.attention

Uses of RotaryEmbedding in io.github.kirstenali.deepj.inference

Methods in io.github.kirstenali.deepj.inference with parameters of type RotaryEmbedding

Modifier and Type	Method	Description
Tensor	InferenceContext.rotate(RotaryEmbedding rotary, Tensor input, int length, int heads)

Uses of RotaryEmbedding in io.github.kirstenali.deepj.layers.transformer.attention

Constructors in io.github.kirstenali.deepj.layers.transformer.attention with parameters of type RotaryEmbedding

Modifier	Constructor	Description
	MultiHeadLatentAttention(int dModel, int nHeads, int qRank, int kvRank, RotaryEmbedding rope, Random rnd)
	MultiHeadLatentAttention(int dModel, int nHeads, int qRank, int kvRank, RotaryEmbedding rope, Random rnd, ParameterFactory parameters)
	RoPEMultiHeadSelfAttention(int dModel, int nHeads, boolean causalMask, RotaryEmbedding rope, Random rnd)
	RoPEMultiHeadSelfAttention(int dModel, int nHeads, boolean causalMask, RotaryEmbedding rope, Random rnd, ParameterFactory parameters)