Package io.github.kirstenali.deepj.data

package io.github.kirstenali.deepj.data

Class	Description
Batch	One language-modeling batch: x are input token ids, y are targets (next-token ids).
BatchSource	Supplies token batches to a causal language-model trainer.
RandomAccessTextDataset	Random, bounded-memory batches sampled directly from a UTF-8 text file.
TextDataset	Dataset that samples random contiguous chunks from token ids.