Aman Gupta Karmani
e356b297cb
remove --force-reinstall from Dockerfile to ensure correct pytorch version ( #492 )
2023-08-29 06:17:51 -07:00
mhenrichsen
cf6654769a
flash attn pip install ( #426 )
...
* flash attn pip
* add packaging
* add packaging to apt get
* install flash attn in dockerfile
* remove unused whls
* add wheel
* clean up pr
fix packaging requirement for ci
upgrade pip for ci
skip build isolation for requiremnents to get flash-attn working
install flash-attn seperately
* install wheel for ci
* no flash-attn for basic cicd
* install flash-attn as pip extras
---------
Co-authored-by: Ubuntu <mgh@mgh-vm.wsyvwcia0jxedeyrchqg425tpb.ax.internal.cloudapp.net >
Co-authored-by: mhenrichsen <some_email@hey.com >
Co-authored-by: Mads Henrichsen <mads@BrbartiendeMads.lan >
Co-authored-by: Wing Lian <wing.lian@gmail.com >
2023-08-18 19:00:27 -04:00
Wing Lian
db2a3586f3
add peft install back since it doesn't get installed by setup.py ( #331 )
2023-07-31 16:31:53 -04:00
Wing Lian
6c9a87c8ee
pin accelerate so it works with llama2 ( #330 )
2023-07-30 22:20:06 -04:00
Wing Lian
cf62cfd661
add runpod envs to .bashrc, fix bnb env ( #316 )
...
* hopper support for base dockerfile, add runpod envs to .bashrc
* set BNB_CUDA_VERSION env for latest bnb
* don't support hopper yet w 118
2023-07-22 10:09:38 -04:00
Wing Lian
d75adb9835
misc fixes
2023-07-17 03:00:27 -04:00
Wing Lian
eca3531329
git fetch fix for docker
2023-07-16 22:25:05 -04:00
Wing Lian
5cd2126439
shallow clone
2023-06-02 14:54:28 -04:00
Wing Lian
12620f3089
clone in docker
2023-06-02 14:52:50 -04:00
Wing Lian
48612f8376
cleanup from pr feedback
2023-05-30 09:56:30 -04:00
Wing Lian
6ef96f569b
default to qlora support, make gptq specific image
2023-05-29 20:34:41 -04:00
Wing Lian
807cca81c0
fix path name to sorkspace
2023-05-08 11:20:03 -04:00
Wing Lian
79deb35c68
setup runpod images
...
use github.ref_name
2023-05-08 10:48:32 -04:00
Wing Lian
7576d85c73
fix to cd to path in docker
2023-05-08 03:43:46 -04:00
Wing Lian
3b4b476828
use existing state of repo to build, not the checkout
2023-05-08 03:29:48 -04:00
Wing Lian
b5fe063687
fix base for dockerfile
2023-05-08 03:27:10 -04:00
Wing Lian
a31746baa2
whoops, build from base image
2023-05-07 17:47:54 -04:00
Wing Lian
17345c8a4b
hanging slash typo
2023-05-07 17:38:56 -04:00
Wing Lian
990bec63e6
docker layer caching, build w axolotl from base build
2023-05-07 17:16:05 -04:00
Wing Lian
92d800a394
build dependencies and aws-cli
2023-05-07 11:02:26 -04:00
Wing Lian
14ebd2e007
build base too
2023-05-07 09:48:41 -04:00
