NanoCode012 ff939d8a64 fix(dataset): normalize tokenizer config and change hash from tokenizer class to tokenizer path (#1298) ...

* fix(dataset): normalize tokenizer config and change hash from tokenizer class to tokenizer path

* fix: normalize config

2024-03-25 15:34:54 +09:00

..

test_trainer_builder.py

fix(dataset): normalize tokenizer config and change hash from tokenizer class to tokenizer path (#1298)

2024-03-25 15:34:54 +09:00