Getting Started

  • Part 1: Introduction
  • Part 2: Custom Tasks, Task Families, and Performance Improvements
  • Part 3: Truncation and TruncatedStep
  • Part 4: GradientEstimators
  • Part 5: Meta-training with GradientLearner
  • Part 6: Custom learned optimizer architectures

Tutorials

  • No dependency introduction to learned optimizers in JAX
  • Summary tutorial: Getting metrics out of your models

Modules

  • Tasks
  • Optimizers
  • Learned Optimizers
  • Outer Trainers
  • Continuous Eval
  • Population: Online hparam adjustment for multiple workers
  • Optimizer Baselines
learned_optimization
  • Overview: module code

All modules for which code is available

  • learned_optimization.optimizers.base
  • learned_optimization.optimizers.optax_opts

© Copyright 2021, Google LLC..

Built with Sphinx using a theme provided by Read the Docs.