tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
2,564 Commits 319 Branches 32 Tags
accelerator-args-builder
Commit Graph

14 Commits

Author SHA1 Message Date
Wing Lian
cda3c82351 move ib/rdma libs into base image (#3002) 
* move ib/rdma libs into base image

* use  --no-install-recommends
 2025-08-01 16:10:37 -04:00
Wing Lian
8e5f146701 Fix cloud docker image build and remove apt files for optim (#2961) 
* make sure to apt update to install sudo and tmux

* remove apt archives too
 2025-07-21 11:05:00 -04:00
Wing Lian
31a15a49b6 add additional packages via apt for better multi-node support (#2949) 
* cleanup in Dockerfile and add infiniband packages

* fixes for ci

* fix nightly too
 2025-07-20 21:19:23 -04:00
Wing Lian
5d0f110a3b include iproute2 and nvtop in cloud image (#2393) 2025-03-10 15:13:38 -04:00
Adithya Kamath
bb9d4102c4 Add 5000 line history limit to tmux for docker cloud (#2268) 2025-01-21 15:39:17 -05:00
Wing Lian
743ba62bd5 Transformers 4.47.0 (#2138) 
* bump transformers and trl

* fix: update trainer.log signature

* fix trl trainer.log interfaces

* broken 🦥 with latest transformers

* skip parent, call grandparent - yeah, super janky

* update HF HUB env var and fix reward trainer log since it doesn't directly override log

* also bump accelerate

* patches for llama ga

* detab the code to check

* fix whitespace for patch check

* play nicely with CI tests since we patch everytime

* fix pop default in case it doesn't exist

* more tweaks to make patches nicer in CI

* fix detab for when there are possibly multiple patches

---------

Co-authored-by: NanoCode012 <nano@axolotl.ai>
 2024-12-07 05:03:01 -05:00
Wing Lian
234e94e9dd replace references to personal docker hub to org docker hub (#2036) [skip ci] 2024-11-11 15:09:29 -05:00
Wing Lian
3ebf22464b qlora-fsdp ram efficient loading with hf trainer (#1791) 
* fix 405b with lower cpu ram requirements

* make sure to use doouble quant and only skip output embeddings

* set model attributes

* more fixes for sharded fsdp loading

* update the base model in example to use pre-quantized nf4-bf16 weights

* upstream fixes  for qlora+fsdp
 2024-07-30 19:21:38 -04:00
Wing Lian
e6937e884b fix symlinks for axolotl outputs (#1625) 2024-05-15 19:41:45 -04:00
Wing Lian
4fde300e5f update outputs path so that we can mount workspace to /workspace/data (#1623) 
* update outputs path so that we can mount workspace to /workspace/data

* fix ln order
 2024-05-15 12:44:13 -04:00
Wing Lian
d113331e9a add a helpful motd for cloud image (#1235) [skip ci] 2024-01-31 10:26:02 -05:00
Wing Lian
eaaeefce55 jupyter lab fixes (#1139) [skip ci] 
* add a basic notebook for lab users in the root

* update notebook and fix cors for jupyter

* cell is code

* fix eval batch size check

* remove intro notebook
 2024-01-22 18:42:40 -05:00
Wing Lian
729740df81 Dockerfile cloud ports (#1148) 
* explicitly expose ports 8888 and 22

* support for SSH_KEY from latitude
 2024-01-18 22:04:25 -05:00
Wing Lian
ece0211996 Agnostic cloud gpu docker image and Jupyter lab (#1097) 2024-01-15 22:37:54 -05:00