Package io.github.kirstenali.deepj.layers.transformer

package io.github.kirstenali.deepj.layers.transformer

Related Packages

Package	Description
io.github.kirstenali.deepj.layers
io.github.kirstenali.deepj.layers.transformer.attention
io.github.kirstenali.deepj.layers.transformer.blocks
io.github.kirstenali.deepj.layers.transformer.norm

Classes

Class	Description
SwiGLULayer	SwiGLU feed-forward layer — the FFN used in Llama, Mistral, Qwen, and DeepSeek.