Package io.github.kirstenali.deepj.autograd

Class NormalizationOps

java.lang.Object

io.github.kirstenali.deepj.autograd.NormalizationOps

public final class NormalizationOps
extends Object

Method Summary

Modifier and Type	Method	Description
static Tensor	layerNorm(Tensor input, Tensor gamma, Tensor beta, float epsilon)
static Tensor	rmsNorm(Tensor input, Tensor gamma, float epsilon)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

rmsNorm

public static Tensor rmsNorm(Tensor input,
 Tensor gamma,
 float epsilon)

layerNorm

public static Tensor layerNorm(Tensor input,
 Tensor gamma,
 Tensor beta,
 float epsilon)