Package io.github.kirstenali.deepj.nn.transformer

Interface GenerationSession

All Superinterfaces:
AutoCloseable, Function<int[],Tensor>
Functional Interface:
This is a functional interface and can therefore be used as the assignment target for a lambda expression or method reference.
@FunctionalInterface public interface GenerationSession extends Function<int[],Tensor>, AutoCloseable
One generation request. Cached sessions return only the last logit row. Close to release caches.

  • Method Summary

    Modifier and Type
    Method
    Description
    default void
    close()
     

    Methods inherited from interface java.util.function.Function

    andThen, apply, compose

  • Method Details