madScientist10
|
8f54b4eb25
|
fix: pass revision parameter to tokenizer and processor loaders (#3388) [skip ci]
* fix: pass revision parameter to tokenizer and processor loaders
* fix: address revision=None passed to .from_pretrained
* add tests and address review feedback for revision parameter
- Reformat modify_tokenizer_files signature and from_pretrained call
- Use kwargs pattern for modify_tokenizer_files call to avoid passing None revision
- Add 6 unit tests for revision parameter in tokenizer/processor loaders
---------
Co-authored-by: NanoCode012 <nano@axolotl.ai>
|
2026-02-25 11:11:20 +07:00 |
|