tocmo0nlord
0 Followers · 0 Following
  • Joined on 2026-02-11
Repositories
11
 Projects Packages Public Activity Starred Repositories
tocmo0nlord created branch mixtral_swiglu in tocmo0nlord/axolotl 2026-04-26 15:07:34 +00:00
tocmo0nlord pushed to mixtral_swiglu at tocmo0nlord/axolotl 2026-04-26 15:07:34 +00:00
a58a9e5f6c Only fuse if flash_attn_fuse_mlp is True
279a1401b5 Formatting again
083beb6425 Fix import
2ac1a72e4b Formatting
23103ac5ac Mixtral: Replace FeedForward with SwiGLU
Compare 5 commits »
tocmo0nlord created branch mm2 in tocmo0nlord/axolotl 2026-04-26 15:07:34 +00:00
tocmo0nlord pushed to mm2 at tocmo0nlord/axolotl 2026-04-26 15:07:34 +00:00
a02af506ed pixtral example
431a0b0f9d added pixtral example
Compare 2 commits »
tocmo0nlord created branch mm3 in tocmo0nlord/axolotl 2026-04-26 15:07:34 +00:00
tocmo0nlord created branch merge-lora-tests in tocmo0nlord/axolotl 2026-04-26 15:07:33 +00:00
tocmo0nlord pushed to merge-lora-tests at tocmo0nlord/axolotl 2026-04-26 15:07:33 +00:00
4c92b51cd5 fix the torch dtype check
5767eea874 add tests for merging lora and validating the dtype
Compare 2 commits »
tocmo0nlord created branch merged-2554 in tocmo0nlord/axolotl 2026-04-26 15:07:33 +00:00
tocmo0nlord pushed to merged-2554 at tocmo0nlord/axolotl 2026-04-26 15:07:33 +00:00
tocmo0nlord created branch mistral-support in tocmo0nlord/axolotl 2026-04-26 15:07:33 +00:00
tocmo0nlord pushed to mistral-support at tocmo0nlord/axolotl 2026-04-26 15:07:33 +00:00
4f39aeefb9 debug
8f75136ad3 debug
70e9cb545d update mistral dep version
aa236a4669 use from_hf_hub
65f8988efd small changes
Compare 9 commits »
tocmo0nlord created branch mixtral_optimized in tocmo0nlord/axolotl 2026-04-26 15:07:33 +00:00
tocmo0nlord pushed to mixtral_optimized at tocmo0nlord/axolotl 2026-04-26 15:07:33 +00:00
tocmo0nlord pushed to maverick-example at tocmo0nlord/axolotl 2026-04-26 15:07:32 +00:00
747dafe5b2 Add Llama4 maverick examples
tocmo0nlord created branch merge-lora-on-complete in tocmo0nlord/axolotl 2026-04-26 15:07:32 +00:00
tocmo0nlord pushed to merge-lora-on-complete at tocmo0nlord/axolotl 2026-04-26 15:07:32 +00:00
9aaa4b8ced set model merge dtype based on cfg
8be7da8999 push merged lora to hf
53e739f11e deduplicate code
f20c8deff1 merge lora on train completion
Compare 4 commits »
tocmo0nlord pushed to main-base at tocmo0nlord/axolotl 2026-04-26 15:07:31 +00:00
tocmo0nlord created branch map-dataset-fetcher-fix in tocmo0nlord/axolotl 2026-04-26 15:07:31 +00:00
tocmo0nlord pushed to map-dataset-fetcher-fix at tocmo0nlord/axolotl 2026-04-26 15:07:31 +00:00
c4f4f81bed Merge branch 'main' into map-dataset-fetcher-fix
4ebd4aae3d handle possibly empty batch
Compare 2 commits »
tocmo0nlord created branch maverick-example in tocmo0nlord/axolotl 2026-04-26 15:07:31 +00:00