Package io.github.kirstenali.deepj.nn.transformer

Class DeepJChat

java.lang.Object

io.github.kirstenali.deepj.nn.transformer.DeepJChat

public final class DeepJChat
extends Object

Method Summary

Modifier and Type	Method	Description
String	generate(String prompt)
String	generate(String prompt, int maxTokens, float temperature, int topK, long seed)
String	generate(String prompt, int maxTokens, float temperature, int topK, long seed, float repetitionPenalty)
static DeepJChat	load(Path path)
String	stream(String prompt, int maxTokens, float temperature, int topK, long seed, float repetitionPenalty, Consumer<String> listener)
String	stream(String prompt, int maxTokens, float temperature, int topK, long seed, Consumer<String> listener)
String	stream(String prompt, Consumer<String> listener)
DeepJChat	withContextWindow(ContextWindowMode mode)	Returns a view sharing this model and tokenizer, with independent request-scoped caches.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

withContextWindow

public DeepJChat withContextWindow(ContextWindowMode mode)

Returns a view sharing this model and tokenizer, with independent request-scoped caches.

load

public static DeepJChat load(Path path)
                      throws IOException

Throws:

IOException

generate

public String generate(String prompt)

generate

public String generate(String prompt,
 int maxTokens,
 float temperature,
 int topK,
 long seed)

generate

public String generate(String prompt,
 int maxTokens,
 float temperature,
 int topK,
 long seed,
 float repetitionPenalty)

stream

public String stream(String prompt,
 Consumer<String> listener)

stream

public String stream(String prompt,
 int maxTokens,
 float temperature,
 int topK,
 long seed,
 Consumer<String> listener)

stream

public String stream(String prompt,
 int maxTokens,
 float temperature,
 int topK,
 long seed,
 float repetitionPenalty,
 Consumer<String> listener)