tocmo0nlord

0 Followers · 0 Following

• Joined on 2026-02-11

Repositories

11

Projects Packages Public Activity Starred Repositories

tocmo0nlord pushed to release-v0.11.x at tocmo0nlord/axolotl 2026-04-26 15:07:51 +00:00

c620a218b8 tiled_mlp supports single gpu (#2891)

tocmo0nlord created branch release-v0.12.x in tocmo0nlord/axolotl 2026-04-26 15:07:51 +00:00

tocmo0nlord pushed to release-v0.12.x at tocmo0nlord/axolotl 2026-04-26 15:07:51 +00:00

3cf22ae23b tag v0.12.2

tocmo0nlord created branch release-v0.13.x in tocmo0nlord/axolotl 2026-04-26 15:07:51 +00:00

tocmo0nlord created branch relaxed-recursive-transformers in tocmo0nlord/axolotl 2026-04-26 15:07:50 +00:00

tocmo0nlord pushed to relaxed-recursive-transformers at tocmo0nlord/axolotl 2026-04-26 15:07:50 +00:00

791c38dcc3 chore: lint

0af78a9882 rescale the norm for lora

fa5efbf235 don't scale delta before decomposing

59a7ac427d make sure to scale too

e3393042e5 hopefully fix the lora/dora logic

Compare 10 commits »

tocmo0nlord created branch release-0.10.x in tocmo0nlord/axolotl 2026-04-26 15:07:50 +00:00

tocmo0nlord pushed to release-0.10.x at tocmo0nlord/axolotl 2026-04-26 15:07:50 +00:00

0b61cd445a v0.10.1 release

tocmo0nlord created branch release-0.8.x in tocmo0nlord/axolotl 2026-04-26 15:07:50 +00:00

tocmo0nlord pushed to release-0.8.x at tocmo0nlord/axolotl 2026-04-26 15:07:50 +00:00

ebe5abad53 0.8.1 version

tocmo0nlord created branch release-v0.11.x in tocmo0nlord/axolotl 2026-04-26 15:07:50 +00:00

tocmo0nlord created branch rala-v2 in tocmo0nlord/axolotl 2026-04-26 15:07:49 +00:00

tocmo0nlord pushed to rala-v2 at tocmo0nlord/axolotl 2026-04-26 15:07:49 +00:00

8c4f89745a fix softmax class check

36b71f34d7 register rala

d28fee7609 use autoconfig w rala

c196776996 option to not concatenate during pretraining

79ae776102 fixup logging layer

Compare 6 commits »

tocmo0nlord created branch reentrant-w-offloading in tocmo0nlord/axolotl 2026-04-26 15:07:49 +00:00

tocmo0nlord pushed to reentrant-w-offloading at tocmo0nlord/axolotl 2026-04-26 15:07:49 +00:00

e1c7a61243 fix reentrant when using offloading

tocmo0nlord created branch refactor-flash-attention in tocmo0nlord/axolotl 2026-04-26 15:07:49 +00:00

tocmo0nlord pushed to refactor-flash-attention at tocmo0nlord/axolotl 2026-04-26 15:07:49 +00:00

e12133613b Remove another unused import

d9d97e3896 Remove unused imports

1cb7977026 Implement Mistral SwiGLU

dfd06a0f88 Fix naming of rms_norm for Llama

40d231a91b Enable replacing xentropy, rmsnorm for Mistral

Compare 8 commits »

tocmo0nlord pushed to quartodoc-fix at tocmo0nlord/axolotl 2026-04-26 15:07:48 +00:00

c649d569b4 simplify by installing no deps

b88b389b17 installing axolotl prior to quartodoc build

Compare 2 commits »

tocmo0nlord created branch rala in tocmo0nlord/axolotl 2026-04-26 15:07:48 +00:00

tocmo0nlord pushed to rala at tocmo0nlord/axolotl 2026-04-26 15:07:48 +00:00

6d3f4b9ab5 keep some softmax layers

12aade921a various fixes

198f01f902 remove bias term in phi and add custom modeling code

2e6265090f remove lr_groups from other branch

1c5b78621c fix forward sig

Compare 10 commits »