Package io.github.kirstenali.deepj.autograd

Class ActivationOps

java.lang.Object

io.github.kirstenali.deepj.autograd.ActivationOps

public final class ActivationOps
extends Object

Method Summary

Modifier and Type	Method	Description
static Tensor	causalSoftmax(Tensor input, int length, float scale)
static Tensor	gelu(Tensor input)
static Tensor	relu(Tensor input)
static Tensor	sigmoid(Tensor input)
static Tensor	softmax(Tensor input)
static Tensor	swiGlu(Tensor gate, Tensor up)
static Tensor	tanh(Tensor input)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

tanh

public static Tensor tanh(Tensor input)

sigmoid

public static Tensor sigmoid(Tensor input)

relu

public static Tensor relu(Tensor input)

gelu

public static Tensor gelu(Tensor input)

softmax

public static Tensor softmax(Tensor input)

causalSoftmax

public static Tensor causalSoftmax(Tensor input,
 int length,
 float scale)

swiGlu

public static Tensor swiGlu(Tensor gate,
 Tensor up)