Package io.github.kirstenali.deepj.optimisers

Class AdamW

java.lang.Object

io.github.kirstenali.deepj.optimisers.AdamW

All Implemented Interfaces:

ParameterOptimizer

public final class AdamW
extends Object
implements ParameterOptimizer

AdamW optimizer with per-parameter state.

State is keyed by Parameter identity, and updates are applied in-place.

Constructor Summary

Constructors

Constructor	Description
AdamW(double lr, double beta1, double beta2, double eps, double weightDecay)

Method Summary

Modifier and Type	Method	Description
static AdamW	defaultAdamW(double lr)
void	step(List<Parameter> params)	Update the provided parameters (one optimizer step).

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

AdamW

public AdamW(double lr,
 double beta1,
 double beta2,
 double eps,
 double weightDecay)

Method Details

defaultAdamW

public static AdamW defaultAdamW(double lr)

step

public void step(List<Parameter> params)

Description copied from interface: ParameterOptimizer

Update the provided parameters (one optimizer step).

Specified by:

step in interface ParameterOptimizer