tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Add seq2seq eval benchmark callback (#1274)

Browse Source 
* Add CausalLMBenchEvalCallback for measuring seq2seq performance

* Fix code for pre-commit

* Fix typing and improve logging

* eval_sample_packing must be false with CausalLMBenchEvalCallback
This commit is contained in:
Leonardo Emili
2024-02-13 17:24:30 +01:00
committed by GitHub
parent 8430db22e2
commit 5a5d47458d
15 changed files with 228 additions and 14 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/mamba/config.yml
View File

@@ -49,7 +49,7 @@ flash_attention:
warmup_steps: 10
evals_per_epoch: 4
eval_table_size:
eval_table_max_new_tokens: 128
eval_max_new_tokens: 128
saves_per_epoch: 1
debug:
deepspeed: