Wing Lian
|
147241ca66
|
Merge branch 'main' into refactor/rename-4b-to-gptq
|
2023-05-27 09:37:52 -04:00 |
|
Wing Lian
|
d5f944ce2a
|
add example for falcoln support
|
2023-05-27 09:16:43 -04:00 |
|
Thytu
|
dd0065773a
|
refactor(param): rename load_4bit config param by gptq
Signed-off-by: Thytu <vdmatos@gladia.io>
|
2023-05-27 12:36:03 +00:00 |
|
NanoCode012
|
919623793a
|
Add cfg.lora_target_linear
|
2023-05-26 14:32:30 +09:00 |
|
Wing Lian
|
bbfc333a01
|
Merge pull request #62 from OpenAccess-AI-Collective/qlora-fixes
Qlora fixes
|
2023-05-26 00:28:16 -04:00 |
|
Wing Lian
|
a4f12415a0
|
update readme and add typehints
|
2023-05-25 23:10:11 -04:00 |
|
Wing Lian
|
e7e1a777bd
|
fix bool args according to python fire docs
|
2023-05-25 22:45:41 -04:00 |
|
Wing Lian
|
3f6017db9e
|
qlora merge and load requires that base model isn't loaded in 4 or 8 bit
|
2023-05-25 22:39:13 -04:00 |
|
NanoCode012
|
85326bfbf3
|
Update quickstart config
|
2023-05-26 11:15:57 +09:00 |
|
NanoCode012
|
e689069afd
|
Add xformers error
|
2023-05-26 11:12:03 +09:00 |
|
NanoCode012
|
d7d8bc739e
|
Add strict yml
|
2023-05-26 11:10:59 +09:00 |
|
NanoCode012
|
60e32ff457
|
Fix shard config
|
2023-05-26 11:09:28 +09:00 |
|
Wing Lian
|
71d600fc43
|
Merge branch 'main' into winglian-patch-1
|
2023-05-25 12:45:13 -04:00 |
|
NanoCode012
|
a9e502ef45
|
Update 4bit notes
|
2023-05-25 23:48:18 +09:00 |
|
NanoCode012
|
f92245dbd6
|
Fix missing closing code block
|
2023-05-25 23:06:33 +09:00 |
|
NanoCode012
|
e65c203e9e
|
Add more detail on minimum GPU
|
2023-05-25 23:06:33 +09:00 |
|
NanoCode012
|
1377400c33
|
Add info on Runtime Error
|
2023-05-25 23:06:33 +09:00 |
|
NanoCode012
|
2c34f8d0c7
|
Update dataset type
|
2023-05-25 23:06:33 +09:00 |
|
NanoCode012
|
7bc28eb8a8
|
Add more data formats
|
2023-05-25 23:06:33 +09:00 |
|
NanoCode012
|
29273b5a5b
|
Add other minor configs
|
2023-05-25 23:06:33 +09:00 |
|
NanoCode012
|
05c18340d6
|
Update scheduler configs
|
2023-05-25 23:06:33 +09:00 |
|
NanoCode012
|
5b712afbe4
|
Update bf16 options
|
2023-05-25 23:06:33 +09:00 |
|
NanoCode012
|
9083910036
|
Update lora config
|
2023-05-25 23:06:33 +09:00 |
|
NanoCode012
|
8552218491
|
Improve Inference instruction
|
2023-05-25 23:06:33 +09:00 |
|
Wing Lian
|
e07bd8a441
|
add discord link to #axolotl-help channel
|
2023-05-25 09:45:45 -04:00 |
|
Wing Lian
|
bc97f9c584
|
remove dev specific remark
|
2023-05-24 23:00:53 -04:00 |
|
NanoCode012
|
362821ce84
|
Add trust_remote_code config
|
2023-05-25 09:53:49 +09:00 |
|
NanoCode012
|
224d186ec9
|
Simplify docker instruction
|
2023-05-25 09:51:22 +09:00 |
|
NanoCode012
|
5417824b31
|
Add seq length
|
2023-05-25 09:50:43 +09:00 |
|
NanoCode012
|
e1a91b0918
|
Remove redundant formats
|
2023-05-25 09:48:18 +09:00 |
|
NanoCode012
|
2a1b5728e6
|
Add line break
|
2023-05-25 09:37:18 +09:00 |
|
NanoCode012
|
702f2eee4b
|
Fix inference command
|
2023-05-25 09:36:33 +09:00 |
|
NanoCode012
|
ba9ac723f1
|
Update quickstart. Add common error and contribution section.
|
2023-05-25 09:32:04 +09:00 |
|
NanoCode012
|
db73b94a58
|
Add image. Add quickstart. Simplify dataset.
|
2023-05-25 09:32:04 +09:00 |
|
NanoCode012
|
9aab0b8cfe
|
Update Docker instructions
|
2023-05-25 09:32:04 +09:00 |
|
NanoCode012
|
857a80b70e
|
Format dataset types
|
2023-05-25 09:32:04 +09:00 |
|
NanoCode012
|
cba0048067
|
Update typo
|
2023-05-25 09:32:04 +09:00 |
|
NanoCode012
|
c22df8db9b
|
Add all dataset types
|
2023-05-25 09:32:04 +09:00 |
|
NanoCode012
|
68237ea90a
|
Add extra note to Readme
|
2023-05-25 09:32:04 +09:00 |
|
NanoCode012
|
4ee79f2641
|
Fix typo
|
2023-05-25 09:32:04 +09:00 |
|
NanoCode012
|
2b436680a0
|
Add new config options to Readme
|
2023-05-25 09:32:04 +09:00 |
|
NanoCode012
|
04d281312c
|
Feat: Rewrite Readme
|
2023-05-25 09:32:04 +09:00 |
|
Wing Lian
|
0d28df0fd2
|
move filter to before saving so it doesn't happen everytime, update runpod manual script
|
2023-05-13 21:51:41 -04:00 |
|
NanoCode012
|
0e74b6402e
|
Add eval_batch_size for evaluation
|
2023-05-06 22:21:24 +09:00 |
|
Eric Hartford
|
2624bc2f11
|
ignore config, add python 3.9 (#8)
|
2023-04-24 07:23:19 -04:00 |
|
Wing Lian
|
7753cdee57
|
cleanup empty lines, tweak env for runpod setup
|
2023-04-19 08:24:58 -04:00 |
|
Wing Lian
|
0a472e1e08
|
quickstart instructions for starting from runpod (#5)
|
2023-04-18 19:22:25 -04:00 |
|
Wing Lian
|
5cb7ea49a6
|
update readme w compat matrix
|
2023-04-18 14:42:37 -04:00 |
|
Wing Lian
|
34af1b465f
|
update readme
|
2023-04-18 01:58:32 -04:00 |
|
Wing Lian
|
3f3f561c06
|
update readme
|
2023-04-18 00:45:25 -04:00 |
|