tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

Add seq2seq eval benchmark callback (#1274)

Browse Source 
* Add CausalLMBenchEvalCallback for measuring seq2seq performance

* Fix code for pre-commit

* Fix typing and improve logging

* eval_sample_packing must be false with CausalLMBenchEvalCallback
This commit is contained in:
Leonardo Emili
2024-02-13 17:24:30 +01:00
committed by GitHub
parent 8430db22e2
commit 5a5d47458d
15 changed files with 228 additions and 14 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/yi-34B-chat/qlora.yml
View File

@@ -29,7 +29,7 @@ num_epochs: 1
val_set_size: 0.1
evals_per_epoch: 5
eval_table_size:
eval_table_max_new_tokens: 128
eval_max_new_tokens: 128
eval_sample_packing: false
eval_batch_size: 1