Optimizers

Base class for Optimizer and a couple hand designed optimizer.

API

learned_optimization.optimizers.base.Optimizer()

Baseclass for the Optimizer interface.

learned_optimization.optimizers.base.SGD(learning_rate=0.01)

Stochastic gradient descent.

learned_optimization.optimizers.base.SGDM(*args, **kwargs)

learned_optimization.optimizers.base.Adam(learning_rate=0.01, beta1=0.9, beta2=0.999, epsilon=1e-08, epsilon_root=1e-08)

Adam optimizer.