Dan Saunders
10ba1622f7
checkpoint model on first step callback ( #2906 )
...
* checkpoint model on first step callback
* remove debug
* add test cases; update existing tests not to save on first step
* move test out of solo
* delete
* default to False
* typo
2025-07-15 15:00:48 -04:00
Dan Saunders
00cda8cc70
Data loader refactor ( #2707 )
...
* data loading refactor (wip)
* updates
* progress
* pytest
* pytest fix
* lint
* zero_first -> filelock, more simplifications
* small simplification
* import change
* nit
* lint
* simplify dedup
* couldnt resist
* review comments WIP
* continued wip
* minor changes
* fix; remove contrived test
* further refactor
* set default seed in pydantic config
* lint
* continued simplication
* lint
* renaming and nits
* filelock tests
* fix
* fix
* lint
* remove nullable arg
* remove unnecessary code
* moving dataset save fn to shared module
* remove debug print
* matching var naming
* fn name change
* coderabbit comments
* naming nit
* fix test
2025-06-10 19:53:07 -04:00
Wing Lian
cd84325253
allow plugins to return their own dataset ( #2617 ) [skip ci]
...
* allow plugins to return their own dataset
* add post_trainer_create and wire up
* add hook check
* address PR feedback:
* remove annotation causing circular import
2025-05-06 20:05:51 -04:00
Aleksandr Dremov
41a1ec0c95
Plugins create_lr_scheduler support ( #2584 )
...
* lr_scheduler support
* fix
* Update scheduler.py
* Update scheduler.py
* cfg handling
* black
* remove debug
* remove adding the axolotl cfg to the scheduler mixin
---------
Co-authored-by: Wing Lian <wing@axolotl.ai >
2025-04-29 17:08:30 -04:00
divyanshuaggarwal
170cdb5be9
Add Post_model_load, post_lora_load, post_train, post_train_unload function calls ( #2539 )
...
* Update train.py
add post_model_load and post_lora_load model calss.
* Update train.py
add post_train and post_train_unload function calls
* Update train.py
* Update base.py
* Update train.py
* chore: lint
* clarify plugin hooks
* Update src/axolotl/integrations/base.py
Co-authored-by: Dan Saunders <danjsaund@gmail.com >
* Update src/axolotl/utils/models.py
Co-authored-by: Dan Saunders <danjsaund@gmail.com >
* Update src/axolotl/utils/models.py
Co-authored-by: Dan Saunders <danjsaund@gmail.com >
* Update src/axolotl/integrations/base.py
Co-authored-by: Dan Saunders <danjsaund@gmail.com >
* Update models.py
* Update models.py
* remove extra call to post_model_load
* chore: lint
* add test for hooks and gc trainer
* disable duplicated code check for test
* fix the path and add better handling
---------
Co-authored-by: Wing Lian <wing@axolotl.ai >
Co-authored-by: Dan Saunders <danjsaund@gmail.com >
2025-04-28 10:10:28 -04:00
