Feat outer lr scheduler - #20

Draft

samsja wants to merge 15 commits into

mainfrom

feat-outer-lr-scheduler

Commits on Aug 22, 2024

fix torch compile log act (#23)
samsja
committed
f6748dd
add warmup steps
samsja
committed
9d03959
do not update lr scheduler during warmup
samsja
committed
ac54218
do not update lr scheduler during warmup
samsja
committed
ce6f82b
add outer lr scheduler
samsja
committed
e91cbda
add div by 4
samsja
committed
d0dc44c
support none outer lr
samsja
committed
532af19
fix outer lr schedulng
samsja
committed
da41f5b
fix outer lr schedulng
samsja
committed
16357ca
update divide
samsja
committed
4ea2735
add ckpt for outer schedler
samsja
committed
1e43b47
add ckpt for outer schedler
samsja
committed
7328d7d
change div
samsja
committed
392a015
remove min olr
samsja
committed
b2b3119
remove divi
samsja
committed
bf21c13