add 120b and deepspeed zero3 examples (#3035) [skip ci]

* add 120b and deepspeed zero3 examples * add a bit of flavor and cleanup gpt oss readme * fix: remove expert vram usage * fix: remove redundant EOS token from eot_tokens * feat: add 120B to docs --------- Co-authored-by: NanoCode012 <nano@axolotl.ai>
2025-08-08 08:04:56 -04:00
parent eb2c87b525
commit 50f2b94d50
6 changed files with 141 additions and 10 deletions
--- a/examples/gpt-oss/gpt-oss-20b-sft-lora-singlegpu.yaml
+++ b/examples/gpt-oss/gpt-oss-20b-sft-lora-singlegpu.yaml
@@ -65,4 +65,3 @@ warmup_ratio: 0.1
 special_tokens:
 eot_tokens:
  - "<|end|>"
-  - "<|return|>"