tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

fix the context manager call
Some checks failed
pre-commit / pre-commit (push) Has been cancelled
Details
PyTest / test (3.10) (push) Has been cancelled
Details
PyTest / test (3.9) (push) Has been cancelled
Details

Browse Source
This commit is contained in:
Wing Lian
2023-09-03 22:49:28 -04:00
parent 5e4a760ad8
commit 83d904a27d
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
src/axolotl/utils/callbacks.py
View File

@@ -210,7 +210,7 @@ def bench_eval_callback_factory(trainer, tokenizer):
"subject": example["subject"], "subject": example["subject"],
} }
with dist_state.main_process_first: with dist_state.main_process_first():
bench_dataset = bench_dataset.map(tokenize_evals) bench_dataset = bench_dataset.map(tokenize_evals)
bench_dataset = bench_dataset.filter(lambda x: x["labels"][-2] in abcd_idx) bench_dataset = bench_dataset.filter(lambda x: x["labels"][-2] in abcd_idx)