tocmo0nlord
0 Followers · 0 Following
  • Joined on 2026-02-11
Repositories
11
 Projects Packages Public Activity Starred Repositories
tocmo0nlord created branch phi-moe in tocmo0nlord/axolotl 2026-04-26 15:07:45 +00:00
tocmo0nlord pushed to phi-moe at tocmo0nlord/axolotl 2026-04-26 15:07:45 +00:00
cb8bfab9cc multipack support for phi moe
tocmo0nlord created branch pixtral_integration in tocmo0nlord/axolotl 2026-04-26 15:07:45 +00:00
tocmo0nlord created branch patch_lora_post_model_load in tocmo0nlord/axolotl 2026-04-26 15:07:44 +00:00
tocmo0nlord pushed to patch_lora_post_model_load at tocmo0nlord/axolotl 2026-04-26 15:07:44 +00:00
822a8a6931 pylint
1a51180637 removing unused function
7562aadf89 fix
479f5e18dd Small updates
945dcc5020 move patching to post-model load to improve applicability
Compare 5 commits »
tocmo0nlord created branch peft-update in tocmo0nlord/axolotl 2026-04-26 15:07:44 +00:00
tocmo0nlord pushed to peft-update at tocmo0nlord/axolotl 2026-04-26 15:07:44 +00:00
320553850a update peft to 0.15.1
tocmo0nlord created branch optimizer-compile in tocmo0nlord/axolotl 2026-04-26 15:07:43 +00:00
tocmo0nlord pushed to optimizer-compile at tocmo0nlord/axolotl 2026-04-26 15:07:43 +00:00
a6056e35de enable torch compile on the optimizer step
tocmo0nlord created branch optimizers-refactor in tocmo0nlord/axolotl 2026-04-26 15:07:43 +00:00
tocmo0nlord pushed to optimizers-refactor at tocmo0nlord/axolotl 2026-04-26 15:07:43 +00:00
76bb09784d fix import
0542c7dd56 add muon optimizer
Compare 2 commits »
tocmo0nlord created branch packing-attn-limit-fa2-rebased in tocmo0nlord/axolotl 2026-04-26 15:07:43 +00:00
tocmo0nlord pushed to packing-attn-limit-fa2-rebased at tocmo0nlord/axolotl 2026-04-26 15:07:43 +00:00
64af21bcb2 set env vars trainer needs for FSDP
6b5cf8b5ea optimize length reducer from 9m -> <5sec
79500f358a need to pass total num tokens to trainer too
7e977a9b68 optimization if total_num_tokens is already known
ac4b700daa optimization if total_num_tokens is already known
Compare 10 commits »
tocmo0nlord created branch openorca-v2 in tocmo0nlord/axolotl 2026-04-26 15:07:42 +00:00
tocmo0nlord pushed to openorca-v2 at tocmo0nlord/axolotl 2026-04-26 15:07:42 +00:00
tocmo0nlord created branch optimizer-checkpoint in tocmo0nlord/axolotl 2026-04-26 15:07:42 +00:00
tocmo0nlord pushed to optimizer-checkpoint at tocmo0nlord/axolotl 2026-04-26 15:07:42 +00:00
c7b095d77f resume from optimizer checkpoint only
tocmo0nlord pushed to openorca at tocmo0nlord/axolotl 2026-04-26 15:07:41 +00:00
tocmo0nlord created branch openorca-fix-mask in tocmo0nlord/axolotl 2026-04-26 15:07:41 +00:00
tocmo0nlord pushed to openorca-fix-mask at tocmo0nlord/axolotl 2026-04-26 15:07:41 +00:00
8028652b8f fix attetion mask with packing