Package io.github.kirstenali.deepj.transformer

Class DeepSeekTransformerBuilder

java.lang.Object

io.github.kirstenali.deepj.transformer.DeepSeekTransformerBuilder

public final class DeepSeekTransformerBuilder
extends Object

Builder for DeepSeek-style transformer stacks.

Assembles a TransformerStack of DeepSeekTransformerBlocks (RMSNorm + Multi-Head Latent Attention + SwiGLU).

See Also:

• GPTTransformerBuilder
• LlamaTransformerBuilder

Constructor Summary

Constructors

Constructor	Description
DeepSeekTransformerBuilder()

Method Summary

Modifier and Type	Method	Description
TransformerStack	build()
DeepSeekTransformerBuilder	dFF(int dFF)
DeepSeekTransformerBuilder	dModel(int dModel)
DeepSeekTransformerBuilder	kvRank(int kvRank)	KV latent dimension for MLA.
DeepSeekTransformerBuilder	maxSeqLen(int maxSeqLen)	Maximum sequence length for the RoPE table.
DeepSeekTransformerBuilder	nHeads(int nHeads)
DeepSeekTransformerBuilder	nLayers(int nLayers)
DeepSeekTransformerBuilder	qRank(int qRank)	Q latent dimension for MLA.
DeepSeekTransformerBuilder	random(Random rnd)
DeepSeekTransformerBuilder	seed(long seed)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

DeepSeekTransformerBuilder

public DeepSeekTransformerBuilder()

Method Details

dModel

public DeepSeekTransformerBuilder dModel(int dModel)

nHeads

public DeepSeekTransformerBuilder nHeads(int nHeads)

dFF

public DeepSeekTransformerBuilder dFF(int dFF)

nLayers

public DeepSeekTransformerBuilder nLayers(int nLayers)

maxSeqLen

public DeepSeekTransformerBuilder maxSeqLen(int maxSeqLen)

Maximum sequence length for the RoPE table. Required.

qRank

public DeepSeekTransformerBuilder qRank(int qRank)

Q latent dimension for MLA. Required. Typical value: dModel / 2.

kvRank

public DeepSeekTransformerBuilder kvRank(int kvRank)

KV latent dimension for MLA. Required. Typical value: dModel / 4. An incremental decoder may use this latent for a compressed cache.

seed

public DeepSeekTransformerBuilder seed(long seed)

random

public DeepSeekTransformerBuilder random(Random rnd)

build

public TransformerStack build()