Fix: Cannot tokenize with bf16 and on cpu (#766)
This commit is contained in:
@@ -819,7 +819,7 @@ accelerate launch -m axolotl.cli.train your_config.yml
|
|||||||
|
|
||||||
You can optionally pre-tokenize dataset with the following before finetuning:
|
You can optionally pre-tokenize dataset with the following before finetuning:
|
||||||
```bash
|
```bash
|
||||||
CUDA_VISIBLE_DEVICES="" accelerate launch -m axolotl.cli.train your_config.yml --prepare_ds_only
|
CUDA_VISIBLE_DEVICES=0 accelerate launch -m axolotl.cli.train your_config.yml --prepare_ds_only
|
||||||
```
|
```
|
||||||
|
|
||||||
##### Config
|
##### Config
|
||||||
|
|||||||
Reference in New Issue
Block a user