Package io.github.kirstenali.deepj.autograd

Class AttentionOps

java.lang.Object

io.github.kirstenali.deepj.autograd.AttentionOps

public final class AttentionOps
extends Object

Method Summary

Modifier and Type	Method	Description
static Tensor	causal(Tensor query, Tensor key, Tensor value, int heads, float scale)
static Tensor	causal(Tensor query, Tensor key, Tensor value, int queryHeads, int keyValueHeads, float scale)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

causal

public static Tensor causal(Tensor query,
 Tensor key,
 Tensor value,
 int heads,
 float scale)

causal

public static Tensor causal(Tensor query,
 Tensor key,
 Tensor value,
 int queryHeads,
 int keyValueHeads,
 float scale)