tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
2,721 Commits 319 Branches 32 Tags
798c8fba897ceb2e238dfaac9bb1731d2f1cacab
Commit Graph

11 Commits

Author SHA1 Message Date
NanoCode012
7daf7d96f1 fix: regex for unfrozen language tower (#3586) [skip ci] 
* fix: regex for unfrozen language tower

* fix: other leftover regex
 2026-04-08 08:18:11 -07:00
VED
b3823cc6b0 fix: gemma3 configs (#3500) [skip ci] 
* gemma fft , text fix

* good lint
 2026-03-20 16:14:06 +07:00
NanoCode012
359b7ad85e fix: gemma3_text model loading vision config (#3354) 
* fix: gemma3-text mode loading vision config

* fix: improve defaults to use lora kernels
 2026-01-13 09:49:23 -05:00
NanoCode012
26f05b6008 fix(example): set model_type to load for gemma3 text (#3242) 
* fix: set model_type to load for gemma3 text

* chore: simplify

* chore: unify
 2025-11-04 07:35:07 +07:00
Wing Lian
af8d257aa2 make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci] 
* make pad_to_sequence_len default to the same value as sample_packing

* remove duplicate validation

* fix test

* update description meta

Co-authored-by: NanoCode012 <nano@axolotl.ai>

---------

Co-authored-by: NanoCode012 <nano@axolotl.ai>
 2025-07-21 11:40:56 -04:00
Dan Saunders
10ba1622f7 checkpoint model on first step callback (#2906) 
* checkpoint model on first step callback

* remove debug

* add test cases; update existing tests not to save on first step

* move test out of solo

* delete

* default to False

* typo
 2025-07-15 15:00:48 -04:00
NanoCode012
bb1109b81d feat: update CCE to use axolotl's fork (#2813) [skip ci] 
* feat: update CCE to use axolotl's fork

* chore: improve error message

* feat: add eot token for gemma3 configs

* fix: only warn on more than 1 image

* fix: re-add gemma3 patch

* Revert "fix: re-add gemma3 patch"

This reverts commit f04db5e873.

* feat: add qwen25 vl example

* feat: point to upstream fork cce package

* feat: update cce commit
 2025-06-25 09:49:22 -04:00
Wing Lian
dd8bad06d0 remove strict=false from example yamls [skip ci] (#2523) [skip ci] 2025-04-12 07:25:11 -07:00
Wing Lian
9f824ef76a simplify the example configs to be more minimal and less daunting (#2486) [skip ci] 
* simplify the example configs to be more minimal and less daunting

* drop empty s2_attention from example yamls
 2025-04-04 13:47:26 -04:00
Wing Lian
328d598114 gemma3 packing fixes (#2449) 
* make gemma3 work with packing

* multi-gpu e2e for ci

* update gemma3 model namespace to use mirror

* add gradient checkpointing to multigpu e2e ci

* update gemma3 examples for use_reentrant and fix ddp find unused params

* fix tests for gemma3

* fix import for test utils

* set correct train loss for gemma3 e2e
 2025-03-31 17:15:23 -04:00
NanoCode012
cf0c79d52e fix: minor patches for multimodal (#2441) 
* fix: update chat_template

* fix: handle gemma3 showing a lot of no content for turn 0

* fix: remove unknown config from examples

* fix: test

* fix: temporary disable gemma2 test

* fix: stop overwriting config.text_config unnecessarily

* fix: handling of set cache to the text_config section

* feat: add liger gemma support and bump liger to 0.5.5

* fix: add double use_cache setting

* fix: add support for final_logit_softcap in CCE for gemma2/3

* fix: set use_cache before model load

* feat: add missing layernorm override

* fix: handle gemma3 rmsnorm

* fix: use wrapper to pass dim as hidden_size

* fix: change dim to positional

* fix: patch with wrong mlp

* chore: refactor use_cache handling

* fix import issues

* fix tests.e2e.utils import

---------

Co-authored-by: Wing Lian <wing@axolotl.ai>
 2025-03-31 13:40:12 +07:00