Uses of Interface
io.github.kirstenali.deepj.data.BatchSource
Packages that use BatchSource
-
Uses of BatchSource in io.github.kirstenali.deepj.data
Classes in io.github.kirstenali.deepj.data that implement BatchSourceModifier and TypeClassDescriptionfinal classRandom, bounded-memory batches sampled directly from a UTF-8 text file.final classDataset that samples random contiguous chunks from token ids. -
Uses of BatchSource in io.github.kirstenali.deepj.training
Methods in io.github.kirstenali.deepj.training with parameters of type BatchSourceModifier and TypeMethodDescriptionstatic EvaluationResultCausalLMEvaluation.evaluate(CausalLM model, BatchSource source, int batches, int batchSize) static TrainerCausalLMTraining.trainer(CausalLM model, BatchSource dataset, float lr) static TrainerCausalLMTraining.trainer(CausalLM model, BatchSource dataset, ParameterOptimizer optimizer)