Package io.github.kirstenali.deepj.optimisers

Class AdamW

java.lang.Object

io.github.kirstenali.deepj.optimisers.AdamW

All Implemented Interfaces:

ParameterOptimizer

public final class AdamW
extends Object
implements ParameterOptimizer

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static final record	AdamW.State

Constructor Summary

Constructors

Constructor	Description
AdamW(float lr, float beta1, float beta2, float eps, float weightDecay)

Method Summary

Modifier and Type	Method	Description
static AdamW	defaultAdamW(float lr)
float	lr()
void	restoreState(List<Parameter> params, AdamW.State state)
void	setLr(float lr)
AdamW.State	state(List<Parameter> params)
void	step(List<Parameter> params)
long	stepCount()
void	validateState(List<Parameter> params, AdamW.State state)	Checks a prospective checkpoint without changing parameters, counters or optimizer buffers.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

AdamW

public AdamW(float lr,
 float beta1,
 float beta2,
 float eps,
 float weightDecay)

Method Details

defaultAdamW

public static AdamW defaultAdamW(float lr)

lr

public float lr()

setLr

public void setLr(float lr)

stepCount

public long stepCount()

state

public AdamW.State state(List<Parameter> params)

restoreState

public void restoreState(List<Parameter> params,
 AdamW.State state)

validateState

public void validateState(List<Parameter> params,
 AdamW.State state)

Checks a prospective checkpoint without changing parameters, counters or optimizer buffers.

step

public void step(List<Parameter> params)

Specified by:

step in interface ParameterOptimizer