Welcome to PyTorch Warmup’s documentation!

This library contains PyTorch implementations of the warmup schedules described in On the adequacy of untuned warmup for adaptive optimization.

Contents:

• Manual Warmup
• Untuned Warmup
• RAdam Warmup

Indices and tables

• Index

• Module Index

• Search Page