Wing Lian
772cd870d4
fix the sed command to replace the version w the tag
pre-commit / pre-commit (push) Has been cancelled
publish pypi / Upload release to PyPI (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled
2023-09-11 13:44:19 -04:00
Wing Lian
bcbc9597e9
replace tags, build dist for pypi publish ( #553 )
...
* replace tags, build dist for pypi publish
* missing trailing comma
2023-09-11 13:25:41 -04:00
Wing Lian
20ed4c1f9e
pypi on tag push ( #552 )
2023-09-11 10:33:42 -04:00
Wing Lian
c5dedb17ad
remove with section, doesn't seem to work ( #551 )
2023-09-11 10:27:17 -04:00
Wing Lian
b56503d423
publish to pypi workflow on tagged release ( #549 )
2023-09-11 09:44:47 -04:00
Wing Lian
34c0a86a11
update readme to point to direct link to runpod template, cleanup install instrucitons ( #532 )
...
* update readme to point to direct link to runpod template, cleanup install instrucitons
* default install flash-attn and auto-gptq now too
* update readme w flash-attn extra
* fix version in setup
2023-09-08 11:58:54 -04:00
Wing Lian
3355706e22
Add support for GPTQ using native transformers/peft ( #468 )
...
* auto gptq support
* more tweaks and add yml
* remove old gptq docker
* don't need explicit peft install for tests
* fix setup.py to use extra index url
install torch for tests
fix cuda version for autogptq index
set torch in requirements so that it installs properly
move gptq install around to work with github cicd
* gptq doesn't play well with sample packing
* address pr feedback
* remove torch install for now
* set quantization_config from model config
* Fix the implementation for getting quant config from model config
2023-09-05 12:43:22 -04:00
Wing Lian
96deb6bd67
recast loralayer, norm, lmhead + embed token weights per original qlora ( #393 )
...
* recast loralayer, norm, lmhead + embed token weights per original qlora
* try again for the fix
* refactor torch dtype picking
* linter fixes
* missing import for LoraLayer
* fix install for tests now that peft is involved
2023-08-21 18:41:12 -04:00
mhenrichsen
cf6654769a
flash attn pip install ( #426 )
...
* flash attn pip
* add packaging
* add packaging to apt get
* install flash attn in dockerfile
* remove unused whls
* add wheel
* clean up pr
fix packaging requirement for ci
upgrade pip for ci
skip build isolation for requiremnents to get flash-attn working
install flash-attn seperately
* install wheel for ci
* no flash-attn for basic cicd
* install flash-attn as pip extras
---------
Co-authored-by: Ubuntu <mgh@mgh-vm.wsyvwcia0jxedeyrchqg425tpb.ax.internal.cloudapp.net >
Co-authored-by: mhenrichsen <some_email@hey.com >
Co-authored-by: Mads Henrichsen <mads@BrbartiendeMads.lan >
Co-authored-by: Wing Lian <wing.lian@gmail.com >
2023-08-18 19:00:27 -04:00
Wing Lian
d3d6fd6ae6
just resort to tags ans use main-latest ( #424 )
2023-08-16 00:39:57 -04:00
NanoCode012
b7449a997f
Fix(template): Inform to place stack trace to Issue ( #417 )
...
* Fix(template): Inform to place stack trace to Issue
* Update following suggestions
Co-authored-by: Wing Lian <wing.lian@gmail.com >
---------
Co-authored-by: Wing Lian <wing.lian@gmail.com >
2023-08-16 11:55:48 +09:00
Wing Lian
5f80b3560b
use inputs for image rather than outputs for docker metadata ( #420 )
2023-08-15 18:26:59 -04:00
Wing Lian
7af816699e
tag with latest as well for axolotl-runpod ( #418 )
...
* tag with latest as well for axolotl-runpod
* no dev branch for now
2023-08-15 15:30:41 -04:00
NanoCode012
7ad37cb6d7
Fix(template): Remove iPhone/android from Issue template ( #407 )
2023-08-15 22:32:51 +09:00
lightningRalf
31db0ecce4
add templates, CoC and contributing guide ( #126 )
...
* add templates, CoC and contributing guide
* Update .github/SECURITY.md
correct responsible person
Co-authored-by: Wing Lian <wing.lian@gmail.com >
* Update bug-report.yaml
axolotl version switch with axolotl branch-commit
* update CONTRIBUTING doc
* update reporting link
* linter fixes
* chore: fix linter
---------
Co-authored-by: Wing Lian <wing.lian@gmail.com >
Co-authored-by: NanoCode012 <kevinvong@rocketmail.com >
2023-08-15 07:41:05 -04:00
Wing Lian
2dafa730ef
Create FUNDING.yml
2023-08-13 00:30:34 -04:00
Wing Lian
918f1b0dfb
revert previous change and build ax images w docker on gpu ( #371 )
2023-08-12 20:23:00 -04:00
Wing Lian
c3fde36ada
attempt to run non-base docker builds on regular cpu hosts ( #369 )
2023-08-12 19:07:38 -04:00
Wing Lian
2c37bf6c21
Prune cuda117 ( #327 )
...
* drop cuda117/torch 1.13.1 from support, pin flash attention to v2.0.1, rm torchvision/torchaudio install
* gptq base build not needed. add sm 9.0 support
2023-07-26 16:27:49 -04:00
Wing Lian
ff7f18d1ed
disable gh cache for first step of docker builds too
2023-07-22 11:46:37 -04:00
Wing Lian
cf62cfd661
add runpod envs to .bashrc, fix bnb env ( #316 )
...
* hopper support for base dockerfile, add runpod envs to .bashrc
* set BNB_CUDA_VERSION env for latest bnb
* don't support hopper yet w 118
2023-07-22 10:09:38 -04:00
Wing Lian
c5df969262
don't use the gha cache w docker
2023-07-22 08:46:21 -04:00
Wing Lian
c58034d48c
use pytorch 2.0.1
2023-07-20 00:47:13 -04:00
Wing Lian
a10da1caff
11.7.0 nvidia/cuda docker images are deprecated, move to 11.7.1
ci-cd-base / build-base (<nil>, 117, 11.7.1, 3.9, 1.13.1) (push) Has been cancelled
ci-cd-base / build-base (<nil>, 118, 11.8.0, 3.10, 2.0.0) (push) Has been cancelled
ci-cd-base / build-base (<nil>, 118, 11.8.0, 3.9, 2.0.0) (push) Has been cancelled
ci-cd-base / build-base (gptq, 118, 11.8.0, 3.9, 2.0.0) (push) Has been cancelled
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled
2023-07-01 00:29:07 -04:00
Wing Lian
d35278aaf1
don't fail fast
2023-06-15 16:01:27 -04:00
Wing Lian
e0011fdf55
Fix base builder, missing tags
2023-05-31 09:52:03 -04:00
Wing Lian
e3d03745ba
add py310 support from base image
2023-05-31 09:07:28 -04:00
Wing Lian
c5b0af1a7e
define python version (3.10) explicitly as string in yaml
2023-05-30 22:23:35 -04:00
Wing Lian
c43c5c84ff
py310, fix cuda arg in deepspeed
2023-05-30 18:02:34 -04:00
Wing Lian
13b80937f9
add release draft template for gh
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled
2023-05-30 15:10:19 -04:00
Wing Lian
bbc5bc5791
Merge pull request #108 from OpenAccess-AI-Collective/docker-gptq
...
default to qlora support, make gptq specific image
2023-05-30 15:07:04 -04:00
NanoCode012
36596adaf7
Add pre-commit: black+flake8+pylint
2023-05-31 02:53:22 +09:00
Wing Lian
48612f8376
cleanup from pr feedback
2023-05-30 09:56:30 -04:00
Wing Lian
6ef96f569b
default to qlora support, make gptq specific image
2023-05-29 20:34:41 -04:00
Wing Lian
e43bcc6c4f
move CUDA_VERSION_BNB arg inside of stage build scope
2023-05-29 13:30:15 -04:00
Wing Lian
21f17cca69
bnb fixes
2023-05-29 00:06:35 -04:00
Wing Lian
658ed86cb5
add py310 to the test matrix
2023-05-28 14:25:57 -04:00
NanoCode012
dd83a20c27
Update test to run on PR
2023-05-28 23:30:17 +09:00
Wing Lian
af3aacbe16
Merge pull request #93 from OpenAccess-AI-Collective/dev-base
...
cuda properly compiled bitsandbytes for qlora support
2023-05-27 19:40:29 -04:00
NanoCode012
2b8c28bab8
Update actions version
2023-05-28 01:51:10 +09:00
Wing Lian
312b8d51d6
update docker to compile latest bnb to properly support qlora
2023-05-27 12:36:53 -04:00
Wing Lian
a653392287
use requirements file for tests
2023-05-27 12:17:46 -04:00
Wing Lian
72b6ca0d9f
cache pip
2023-05-27 12:16:54 -04:00
Wing Lian
7f53fd2ab6
alright, just local install it
2023-05-27 12:16:06 -04:00
Wing Lian
c29d33352c
move python path to same step as tests
2023-05-27 12:06:23 -04:00
Wing Lian
403af0b1d7
fix path and streamline pip installs
2023-05-27 11:58:37 -04:00
Wing Lian
d199d6c261
automated testing in github actions
2023-05-27 11:51:01 -04:00
Wing Lian
e3df3a9f5d
cuda/pytorch matrix builds
2023-05-22 12:14:21 -04:00
Wing Lian
f950a881e1
cuda, pytorch matrix for base builds
2023-05-22 12:12:08 -04:00
Wing Lian
79deb35c68
setup runpod images
...
use github.ref_name
2023-05-08 10:48:32 -04:00
