Package io.github.kirstenali.deepj.data

Class TextDataset

java.lang.Object

io.github.kirstenali.deepj.data.TextDataset

All Implemented Interfaces:

BatchSource

public final class TextDataset
extends Object
implements BatchSource

Method Summary

Modifier and Type	Method	Description
static TextDataset	fromFile(Path path, Tokenizer tok, int seqLen, long seed)
Batch	nextBatch(int batchSize)
int	seqLen()
long	size()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

fromFile

public static TextDataset fromFile(Path path,
 Tokenizer tok,
 int seqLen,
 long seed)
                            throws IOException

Throws:

IOException

nextBatch

public Batch nextBatch(int batchSize)

Specified by:

nextBatch in interface BatchSource

seqLen

public int seqLen()

size

public long size()