Package io.github.kirstenali.deepj.activations

Class Softmax

java.lang.Object

io.github.kirstenali.deepj.activations.Softmax

All Implemented Interfaces:

ActivationFunction

public final class Softmax
extends Object
implements ActivationFunction

Constructor Summary

Constructors

Constructor	Description
Softmax()

Method Summary

Modifier and Type	Method	Description
Tensor	forward(Tensor input)
Tensor	forwardCausal(Tensor logits, int sequenceLength, float scale)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

Softmax

public Softmax()

Method Details

forward

public Tensor forward(Tensor input)

Specified by:

forward in interface ActivationFunction

forwardCausal

public Tensor forwardCausal(Tensor logits,
 int sequenceLength,
 float scale)