jphillips
|
6cee881d64
|
Update examples/qlora-openllama-3b/README.md
Co-authored-by: Wing Lian <wing.lian@gmail.com>
|
2023-05-30 09:33:33 -05:00 |
|
Wing Lian
|
e6fdeb087f
|
add unit test for sharegpt tokenization
|
2023-05-30 10:28:17 -04:00 |
|
Wing Lian
|
48612f8376
|
cleanup from pr feedback
|
2023-05-30 09:56:30 -04:00 |
|
Wing Lian
|
d91a769b88
|
update docs
|
2023-05-29 20:37:32 -04:00 |
|
Wing Lian
|
6ef96f569b
|
default to qlora support, make gptq specific image
|
2023-05-29 20:34:41 -04:00 |
|
jphillips
|
ac85c0ed36
|
Add Readme, Clean up comments
|
2023-05-29 14:35:58 -05:00 |
|
Wing Lian
|
e43bcc6c4f
|
move CUDA_VERSION_BNB arg inside of stage build scope
|
2023-05-29 13:30:15 -04:00 |
|
jphillips
|
f1fbf666f7
|
Merge branch 'main' of https://github.com/OpenAccess-AI-Collective/axolotl into qlora-openllama-3b-example
|
2023-05-29 09:09:43 -05:00 |
|
jphillips
|
370d057096
|
Add qlora-openllama-3b example
|
2023-05-29 09:07:46 -05:00 |
|
Wing Lian
|
00323f0a6f
|
fix CUDA_VERSION_BNB env var
|
2023-05-29 08:06:22 -04:00 |
|
Viktorius Suwandi
|
e0ccaccce2
|
Update wandb_log_model on vicuna_13B_4bit_reflect.yml
|
2023-05-29 16:34:13 +07:00 |
|
Viktorius Suwandi
|
15e57ba6ee
|
Update wandb_log_model on config.yml
|
2023-05-29 16:33:20 +07:00 |
|
Viktorius Suwandi
|
4eb68ac3f7
|
Update wandb_log_model on config-3b.yml
|
2023-05-29 16:32:49 +07:00 |
|
Viktorius Suwandi
|
b6a539b53c
|
Update wandb_log_model on cerebras_1_3B_alpaca.yml
|
2023-05-29 16:32:20 +07:00 |
|
Viktorius Suwandi
|
abddcf4dfe
|
Update wandb_log_model on pythia_1_2B_alpaca.yml
|
2023-05-29 16:31:53 +07:00 |
|
Viktorius Suwandi
|
15aabd2903
|
Update wandb_log_model on llama_7B_jeopardy.yml
|
2023-05-29 15:44:01 +07:00 |
|
Viktorius Suwandi
|
232b931081
|
Update wandb_log_model on llama_65B_alpaca.yml
|
2023-05-29 15:43:43 +07:00 |
|
Viktorius Suwandi
|
0736f4f9c1
|
Update wandb_log_model on llama_13B_alpaca.yml
|
2023-05-29 15:43:20 +07:00 |
|
Viktorius Suwandi
|
d77d736631
|
Update wandb_log_model on llama_7B_alpaca.yml
|
2023-05-29 15:43:01 +07:00 |
|
Viktorius Suwandi
|
fad06befee
|
Update wandb_log_model on config.yml
|
2023-05-29 15:42:38 +07:00 |
|
Viktorius Suwandi
|
2aacf75ee1
|
Update wandb_log_model on galactica_1_3B.yml
|
2023-05-29 15:42:19 +07:00 |
|
Viktorius Suwandi
|
71871345a6
|
Update wandb_log_model on llama_7B_4bit.yml
|
2023-05-29 15:41:59 +07:00 |
|
Viktorius Suwandi
|
0d14e951a8
|
Update wandb_log_model on stability_3b.yml
|
2023-05-29 15:41:42 +07:00 |
|
Viktorius Suwandi
|
84fc217f79
|
Update wandb_log_model on gpt_neox_20b.yml
|
2023-05-29 15:41:24 +07:00 |
|
Viktorius Suwandi
|
f317296259
|
Update wandb_log_model on quickstart.yml
|
2023-05-29 15:40:58 +07:00 |
|
Viktorius Suwandi
|
42a971df32
|
Update wandb_log_model on sample.yml
|
2023-05-29 15:39:42 +07:00 |
|
Wing Lian
|
7f7fd68e8e
|
Merge pull request #104 from OpenAccess-AI-Collective/training-fixes-20230529
bnb fix, trainer debug fix
|
2023-05-29 02:19:03 -04:00 |
|
Wing Lian
|
21f17cca69
|
bnb fixes
|
2023-05-29 00:06:35 -04:00 |
|
Wing Lian
|
319e34bfb5
|
Merge pull request #101 from OpenAccess-AI-Collective/sharegpt-conv
refactor conversation plucking in sharegpt
|
2023-05-28 19:43:54 -04:00 |
|
Wing Lian
|
809ccebb38
|
use python setup install, bdist wheel is unreliable in installing extension
|
2023-05-28 15:49:13 -04:00 |
|
Wing Lian
|
21c8e2deab
|
refactor conversation plucking in sharegpt
|
2023-05-28 14:36:33 -04:00 |
|
Wing Lian
|
8fe12e3bc1
|
Merge pull request #100 from OpenAccess-AI-Collective/py310-tests
add py310 to the test matrix
|
2023-05-28 14:31:07 -04:00 |
|
Wing Lian
|
37fc85ac52
|
Merge pull request #99 from OpenAccess-AI-Collective/hf_use_auth_token
new hf_use_auth_token setting so login to hf isn't required
|
2023-05-28 14:30:04 -04:00 |
|
Wing Lian
|
658ed86cb5
|
add py310 to the test matrix
|
2023-05-28 14:25:57 -04:00 |
|
Wing Lian
|
fd5f9656a2
|
update for pr feedback
|
2023-05-28 14:23:27 -04:00 |
|
Wing Lian
|
1c33eb88a7
|
new hf_use_auth_token setting so login to hf isn't required
|
2023-05-28 13:08:49 -04:00 |
|
Wing Lian
|
a798ba1659
|
ensure libbitsandbytes*.so gets included with wheel
|
2023-05-28 12:28:37 -04:00 |
|
NanoCode012
|
666febcfb5
|
Merge pull request #97 from NanoCode012/feat/test-validation
Feat: Update validate_config and add tests
|
2023-05-29 00:38:22 +09:00 |
|
NanoCode012
|
52dd92a0cd
|
Feat: Update validate_config and add tests
|
2023-05-29 00:25:54 +09:00 |
|
Wing Lian
|
88889590ec
|
Merge pull request #90 from NanoCode012/feat/addict
Feat: Convert attrdict to addict
|
2023-05-28 10:43:07 -04:00 |
|
NanoCode012
|
f87bd20555
|
Fix incorrect syntax in test
|
2023-05-28 23:35:29 +09:00 |
|
NanoCode012
|
dd83a20c27
|
Update test to run on PR
|
2023-05-28 23:30:17 +09:00 |
|
NanoCode012
|
7bf2069afd
|
Apply black formatter
|
2023-05-28 23:14:04 +09:00 |
|
NanoCode012
|
923151ffab
|
Add test for DictDefault
|
2023-05-28 23:06:10 +09:00 |
|
NanoCode012
|
56f9ca5709
|
refactor: fix previous refactors
|
2023-05-28 23:06:10 +09:00 |
|
NanoCode012
|
8bd7a49cd7
|
Refactor to use DictDefault instead
|
2023-05-28 23:06:10 +09:00 |
|
NanoCode012
|
18d41cee4a
|
Add DictDefault
|
2023-05-28 23:06:10 +09:00 |
|
NanoCode012
|
93acb648bd
|
Fix load error
|
2023-05-28 23:06:10 +09:00 |
|
NanoCode012
|
bdfe7c9201
|
Convert attrdict to addict
|
2023-05-28 23:06:10 +09:00 |
|
Wing Lian
|
0d4a7f4c04
|
Merge pull request #67 from OpenAccess-AI-Collective/refactor-tokenizer-load
load the tokenizer seperately from the model
|
2023-05-28 08:49:34 -04:00 |
|