Uses of Record Class
io.github.kirstenali.deepj.tokenizers.bpe.BPEModel

Packages that use BPEModel

Package	Description
io.github.kirstenali.deepj.publishing
io.github.kirstenali.deepj.tokenizers.bpe

Uses of BPEModel in io.github.kirstenali.deepj.publishing

Methods in io.github.kirstenali.deepj.publishing with parameters of type BPEModel

Modifier and Type	Method	Description
static Path	DeepJModelBundle.export(Path directory, DeepSeekModel model, BPEModel tokenizer, ModelCard card)
static Path	DeepJModelBundle.export(Path directory, GPTModel model, BPEModel tokenizer, ModelCard card)

Uses of BPEModel in io.github.kirstenali.deepj.tokenizers.bpe

Methods in io.github.kirstenali.deepj.tokenizers.bpe that return BPEModel

Modifier and Type	Method	Description
static BPEModel	BPEModelIO.load(Path path)
BPEModel	BPETokenizer.model()
BPEModel	BPETrainer.train(String text, int targetVocabSize)
BPEModel	BPETrainer.train(String text, int targetVocabSize, List<String> specialTokens)
BPEModel	BPETrainer.trainFromFile(Path path, int targetVocabSize, List<String> specialTokens)
BPEModel	BPETrainer.trainFromFile(Path path, int targetVocabSize, List<String> specialTokens, int sampleChars)

Methods in io.github.kirstenali.deepj.tokenizers.bpe with parameters of type BPEModel

Modifier and Type	Method	Description
static void	BPEModelIO.save(Path path, BPEModel model)

Constructors in io.github.kirstenali.deepj.tokenizers.bpe with parameters of type BPEModel

Modifier	Constructor	Description
	BPETokenizer(BPEModel model)