Uses of Class
io.github.kirstenali.deepj.inference.InferenceContext

Packages that use InferenceContext

Package	Description
io.github.kirstenali.deepj.layers
io.github.kirstenali.deepj.layers.transformer.attention
io.github.kirstenali.deepj.transformer

Uses of InferenceContext in io.github.kirstenali.deepj.layers

Methods in io.github.kirstenali.deepj.layers with parameters of type InferenceContext

Modifier and Type	Method	Description
default Tensor	Layer.forward(Tensor input, InferenceContext context)

Uses of InferenceContext in io.github.kirstenali.deepj.layers.transformer.attention

Methods in io.github.kirstenali.deepj.layers.transformer.attention with parameters of type InferenceContext

Modifier and Type	Method	Description
Tensor	GroupedQueryAttention.forward(Tensor input, InferenceContext context)
Tensor	MultiHeadLatentAttention.forward(Tensor input, InferenceContext context)
Tensor	MultiHeadSelfAttention.forward(Tensor input, InferenceContext context)
protected Tensor	MultiHeadSelfAttention.transformQueryKey(Tensor heads, int length, InferenceContext context)
protected Tensor	RoPEMultiHeadSelfAttention.transformQueryKey(Tensor heads, int length, InferenceContext context)

Uses of InferenceContext in io.github.kirstenali.deepj.transformer

Methods in io.github.kirstenali.deepj.transformer with parameters of type InferenceContext

Modifier and Type	Method	Description
Tensor	LoopedTransformer.forward(Tensor input, InferenceContext inference)
Tensor	TransformerStack.forward(Tensor input, InferenceContext context)