Package io.github.kirstenali.deepj.tensor

Class HeadCacheOps

java.lang.Object

io.github.kirstenali.deepj.tensor.HeadCacheOps

public final class HeadCacheOps
extends Object

Inference-only storage operations for head-major key/value caches.

Method Summary

Modifier and Type	Method	Description
static Tensor	prefix(TensorBackend backend, Tensor cache, int heads, int length)
static void	requirePrefix(Tensor cache, int heads, int length)
static void	requireWrite(Tensor cache, Tensor update, int heads, int offset)
static void	writeLayouts(TensorBackend backend, Tensor cache, Tensor update, int heads, int offset)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

requireWrite

public static void requireWrite(Tensor cache,
 Tensor update,
 int heads,
 int offset)

requirePrefix

public static void requirePrefix(Tensor cache,
 int heads,
 int length)

writeLayouts

public static void writeLayouts(TensorBackend backend,
 Tensor cache,
 Tensor update,
 int heads,
 int offset)

prefix

public static Tensor prefix(TensorBackend backend,
 Tensor cache,
 int heads,
 int length)