Package io.github.kirstenali.deepj.layers.transformer.blocks

package io.github.kirstenali.deepj.layers.transformer.blocks

Related Packages

Package	Description
io.github.kirstenali.deepj.layers.transformer
io.github.kirstenali.deepj.layers.transformer.attention
io.github.kirstenali.deepj.layers.transformer.norm

Classes

Class	Description
DeepSeekTransformerBlock	Pre-LN transformer block with DeepSeek-style latent attention:
GPTTransformerBlock	Pre-LN GPT-style Transformer block:
LlamaTransformerBlock	Pre-LN transformer block with Llama-style full-head attention: