tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Feat(doc): Add lr_quadratic_warmup to readme (#412)

Browse Source
This commit is contained in:
NanoCode012
2023-08-16 02:55:48 +09:00
committed by GitHub
parent c01015f33f
commit 2b990eb628
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
README.md
View File

@@ -434,6 +434,7 @@ eval_batch_size: 2
num_epochs: 3 num_epochs: 3
warmup_steps: 100 warmup_steps: 100
learning_rate: 0.00003 learning_rate: 0.00003
lr_quadratic_warmup:
logging_steps: logging_steps:
save_steps: # leave empty to save at each epoch save_steps: # leave empty to save at each epoch
eval_steps: eval_steps: