3 Commits

Author	SHA1	Message	Date
Wing Lian	cb811f8bf1	upgrade to flash-attn 2.8.0.post2 (#2828) ... * upgrade to flash-attn 2.8.0.post2 * use cu126 with torch 2.6 * seems vllm 0.8.5.post1 not compatible with cuda12.6.3 and torch 2.6 * cu126 + torch 2.6 as the default * use cu126 for multigpu w torch 2.6 too * drop vllm for now from ci for now	2025-06-29 22:11:16 -04:00
Wing Lian	581dd324cc	build base images for torch 2.7.1 (#2764) ... * build base images for torch 2.7.1 * fix: update base docker to use torch 2.7.1 * fix: update doc for main base to use 2.7.1 * make sure to install fa2 in base uv too * use no build isolation for uv+flashattn * install psutil also for fa2 * longer timeout for flash attn build --------- Co-authored-by: NanoCode012 <nano@axolotl.ai>	2025-06-11 17:11:06 -04:00
Wing Lian	ecc719f5c7	add support for base image with uv (#2691)	2025-06-02 12:48:55 -07:00