Learned Optimizers

Base class for learned optimizers plus learnable hparam variants.

API

learned_optimization.learned_optimizers.base.LearnedOptimizer()[source]

Base class for learned optimizers.

learned_optimization.learned_optimizers.base.LearnableSGD(initial_lr=0.01)[source]

SGD with learnable hparams.

learned_optimization.learned_optimizers.base.LearnableSGDM(initial_lr=0.01, initial_momentum=0.9)[source]

SGDM with learnable hparams.

learned_optimization.learned_optimizers.base.LearnableAdam(initial_lr=0.001, initial_beta1=0.9, initial_beta2=0.999, initial_epsilon=1e-08, use_summary=True)[source]

Adam with learnable hparams.