JohanWork
|
5439707489
|
Feat(test): Add tests for alpaca chatml prompt tokenizer (#1088)
* draft for adding test for tokenizer
* clean up
* clean up
* fix pre commit
* fix pylint
* Revert "fix pylint"
This reverts commit cd2cda3cda.
* add pylint exception for pytest fixture
* update comments
* Apply suggestions from code review
Co-authored-by: NanoCode012 <kevinvong@rocketmail.com>
* update spelling and import promptstyle
* reaname, restrucure
* clean up
* add fmt:on
---------
Co-authored-by: NanoCode012 <kevinvong@rocketmail.com>
|
2024-01-23 13:30:26 +09:00 |
|