7 Commits

Author	SHA1	Message	Date
Wing Lian	3ebf22464b	qlora-fsdp ram efficient loading with hf trainer (#1791) ... * fix 405b with lower cpu ram requirements * make sure to use doouble quant and only skip output embeddings * set model attributes * more fixes for sharded fsdp loading * update the base model in example to use pre-quantized nf4-bf16 weights * upstream fixes for qlora+fsdp	2024-07-30 19:21:38 -04:00
Wing Lian	e6937e884b	fix symlinks for axolotl outputs (#1625)	2024-05-15 19:41:45 -04:00
Wing Lian	4fde300e5f	update outputs path so that we can mount workspace to /workspace/data (#1623) ... * update outputs path so that we can mount workspace to /workspace/data * fix ln order	2024-05-15 12:44:13 -04:00
Wing Lian	d113331e9a	add a helpful motd for cloud image (#1235) [skip ci]	2024-01-31 10:26:02 -05:00
Wing Lian	eaaeefce55	jupyter lab fixes (#1139) [skip ci] ... * add a basic notebook for lab users in the root * update notebook and fix cors for jupyter * cell is code * fix eval batch size check * remove intro notebook	2024-01-22 18:42:40 -05:00
Wing Lian	729740df81	Dockerfile cloud ports (#1148) ... * explicitly expose ports 8888 and 22 * support for SSH_KEY from latitude	2024-01-18 22:04:25 -05:00
Wing Lian	ece0211996	Agnostic cloud gpu docker image and Jupyter lab (#1097)	2024-01-15 22:37:54 -05:00