Package io.github.kirstenali.deepj.tensor

Class CpuNdSwiGlu

java.lang.Object

io.github.kirstenali.deepj.tensor.CpuNdSwiGlu

public final class CpuNdSwiGlu
extends Object

Equal-shaped SwiGLU operands decode to FLOAT32 and only round the completed output.

Method Summary

Modifier and Type	Method	Description
static Tensor	apply(Tensor gate, Tensor up)
static SwiGluBackwardResult	backward(Tensor gradient, Tensor gate, Tensor up)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

apply

public static Tensor apply(Tensor gate,
 Tensor up)

backward

public static SwiGluBackwardResult backward(Tensor gradient,
 Tensor gate,
 Tensor up)