Package io.github.kirstenali.deepj.data

Class IndexedResponseTextDataset

java.lang.Object

io.github.kirstenali.deepj.data.IndexedResponseTextDataset

All Implemented Interfaces:

BatchSource, StatefulBatchSource, AutoCloseable

public final class IndexedResponseTextDataset
extends Object
implements AutoCloseable

Constructor Summary

Constructors

Constructor	Description
IndexedResponseTextDataset(List<ResponseOnlyTextDataset.Source> sources, Tokenizer tokenizer, int maxSequenceLength, long seed)

Method Summary

Modifier and Type	Method	Description
void	close()
final Batch	nextBatch(int batchSize)
final long	randomState()
long	recordCount()
final void	restoreRandomState(long state)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

IndexedResponseTextDataset

public IndexedResponseTextDataset(List<ResponseOnlyTextDataset.Source> sources,
 Tokenizer tokenizer,
 int maxSequenceLength,
 long seed)
                           throws IOException

Throws:

IOException

Method Details

recordCount

public long recordCount()

close

public void close()
           throws IOException

Specified by:

close in interface AutoCloseable

Throws:

IOException

nextBatch

public final Batch nextBatch(int batchSize)

Specified by:

nextBatch in interface BatchSource

randomState

public final long randomState()

Specified by:

randomState in interface StatefulBatchSource

restoreRandomState

public final void restoreRandomState(long state)

Specified by:

restoreRandomState in interface StatefulBatchSource