6 Commits

Author	SHA1	Message	Date
Wing Lian	0f985e12fe	more fixes 20240228 (#1342) [skip ci] ... * add missing evals_per_epoch setting * more pydantic fixes * more fixes * move test from normalization to validation * increase eval size for sample packing tests	2024-02-28 12:57:45 -05:00
Wing Lian	782b6a4216	set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci] ... * set fp16 to false if bf16, update bf16: auto in example YAMLs * unset fp16 so that it fallsback properly if bf16 isn't available * Update README.md [skip-ci] Co-authored-by: NanoCode012 <kevinvong@rocketmail.com> * test that bf16 disables fp16 --------- Co-authored-by: NanoCode012 <kevinvong@rocketmail.com>	2024-01-22 18:44:01 -05:00
Simon Hällqvist	086561326f	Enable or disable bf16 support based on availability (#1116)	2024-01-14 12:06:56 -05:00
Wing Lian	0ce1a6594e	update sharegpt conversations when chatml chat template is set (#1075) [skip ci] ... * update sharegpt conversations when chatml chat template is set * add info log when updating sharegpt/chatml conversation	2024-01-10 00:49:07 -05:00
Wing Lian	2d8def68dc	simplify by removing duplicate base_model_config (#772)	2023-10-23 01:42:38 -04:00
Wing Lian	ca84cca2c0	convert exponential notation lr to floats (#771)	2023-10-22 15:37:03 -04:00