Package io.github.kirstenali.deepj.activations


package io.github.kirstenali.deepj.activations
  • Class
    Description
     
    Gaussian Error Linear Unit (GELU), using the tanh approximation popularized by GPT-2.
     
     
    Sigmoid Linear Unit (SiLU / Swish).
    Row-wise softmax for 2D tensors: applies softmax independently to each row.