tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

Merge branch 'main' into 775-option-to-drop-vs-truncate-on-rows-longer-than-context-length

Browse Source
This commit is contained in:
mhenrichsen
2025-05-27 12:31:31 +02:00
committed by GitHub
parent 5d7a61576d 5eb01f3df1
commit 618b008e36
75 changed files with 2850 additions and 2821 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/config.qmd
View File

@@ -635,7 +635,9 @@ weight_decay:
# adamw hyperparams
adam_beta1:
adam_beta2:
adam_beta3: # only used for CAME Optimizer
adam_epsilon:
adam_epsilon2: # only used for CAME Optimizer
# Gradient clipping max norm
max_grad_norm: