madScientist10 8f54b4eb25 fix: pass revision parameter to tokenizer and processor loaders (#3388) [skip ci] ...

* fix: pass revision parameter to tokenizer and processor loaders

* fix: address revision=None passed to .from_pretrained

* add tests and address review feedback for revision parameter

- Reformat modify_tokenizer_files signature and from_pretrained call
- Use kwargs pattern for modify_tokenizer_files call to avoid passing None revision
- Add 6 unit tests for revision parameter in tokenizer/processor loaders

---------

Co-authored-by: NanoCode012 <nano@axolotl.ai>

2026-02-25 11:11:20 +07:00

4.9 KiB

Raw Blame History

View Raw