NanoCode012
|
545cfeb5c7
|
Refactor error code to use full error message
|
2023-05-31 02:53:23 +09:00 |
|
NanoCode012
|
69722aeef4
|
Remove fixme disable
|
2023-05-31 02:53:23 +09:00 |
|
NanoCode012
|
5658717dbd
|
Remove disable too many arg
|
2023-05-31 02:53:23 +09:00 |
|
NanoCode012
|
e8717d3bef
|
Remove disable
|
2023-05-31 02:53:23 +09:00 |
|
NanoCode012
|
54c3b5b25f
|
Ignore too-many-arguments
|
2023-05-31 02:53:23 +09:00 |
|
NanoCode012
|
5062eca069
|
Lint callbacks.py
|
2023-05-31 02:53:23 +09:00 |
|
NanoCode012
|
cb4f0e9342
|
Lint prompters.py
|
2023-05-31 02:53:23 +09:00 |
|
NanoCode012
|
4c0eddb3f8
|
Refactor
|
2023-05-31 02:53:23 +09:00 |
|
NanoCode012
|
1c60c10e00
|
Lint flash_attn.py
|
2023-05-31 02:53:23 +09:00 |
|
NanoCode012
|
903ea3080d
|
Fix lint
|
2023-05-31 02:53:23 +09:00 |
|
NanoCode012
|
cb7cd3429f
|
Fix data.py lint
|
2023-05-31 02:53:23 +09:00 |
|
NanoCode012
|
d57ba56746
|
Ignore import and too many * pylint errors
|
2023-05-31 02:53:23 +09:00 |
|
NanoCode012
|
c3a4697016
|
Update ignores
|
2023-05-31 02:53:22 +09:00 |
|
NanoCode012
|
392dfd9b07
|
Lint and format
|
2023-05-31 02:53:22 +09:00 |
|
NanoCode012
|
a98deb31a6
|
Add config files
|
2023-05-31 02:53:22 +09:00 |
|
NanoCode012
|
36596adaf7
|
Add pre-commit: black+flake8+pylint
|
2023-05-31 02:53:22 +09:00 |
|
Wing Lian
|
a924a33b45
|
Merge pull request #111 from OpenAccess-AI-Collective/sharegpt-token-tests
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled
add unit test for sharegpt tokenization
v0.1.0
|
2023-05-30 11:18:31 -04:00 |
|
Wing Lian
|
e65aeedce7
|
fix relative path for fixtures
|
2023-05-30 10:38:20 -04:00 |
|
Wing Lian
|
e6fdeb087f
|
add unit test for sharegpt tokenization
|
2023-05-30 10:28:17 -04:00 |
|
Wing Lian
|
e43bcc6c4f
|
move CUDA_VERSION_BNB arg inside of stage build scope
|
2023-05-29 13:30:15 -04:00 |
|
Wing Lian
|
00323f0a6f
|
fix CUDA_VERSION_BNB env var
|
2023-05-29 08:06:22 -04:00 |
|
Wing Lian
|
7f7fd68e8e
|
Merge pull request #104 from OpenAccess-AI-Collective/training-fixes-20230529
bnb fix, trainer debug fix
|
2023-05-29 02:19:03 -04:00 |
|
Wing Lian
|
21f17cca69
|
bnb fixes
|
2023-05-29 00:06:35 -04:00 |
|
Wing Lian
|
319e34bfb5
|
Merge pull request #101 from OpenAccess-AI-Collective/sharegpt-conv
refactor conversation plucking in sharegpt
|
2023-05-28 19:43:54 -04:00 |
|
Wing Lian
|
809ccebb38
|
use python setup install, bdist wheel is unreliable in installing extension
|
2023-05-28 15:49:13 -04:00 |
|
Wing Lian
|
21c8e2deab
|
refactor conversation plucking in sharegpt
|
2023-05-28 14:36:33 -04:00 |
|
Wing Lian
|
8fe12e3bc1
|
Merge pull request #100 from OpenAccess-AI-Collective/py310-tests
add py310 to the test matrix
|
2023-05-28 14:31:07 -04:00 |
|
Wing Lian
|
37fc85ac52
|
Merge pull request #99 from OpenAccess-AI-Collective/hf_use_auth_token
new hf_use_auth_token setting so login to hf isn't required
|
2023-05-28 14:30:04 -04:00 |
|
Wing Lian
|
658ed86cb5
|
add py310 to the test matrix
|
2023-05-28 14:25:57 -04:00 |
|
Wing Lian
|
fd5f9656a2
|
update for pr feedback
|
2023-05-28 14:23:27 -04:00 |
|
Wing Lian
|
1c33eb88a7
|
new hf_use_auth_token setting so login to hf isn't required
|
2023-05-28 13:08:49 -04:00 |
|
Wing Lian
|
a798ba1659
|
ensure libbitsandbytes*.so gets included with wheel
|
2023-05-28 12:28:37 -04:00 |
|
NanoCode012
|
666febcfb5
|
Merge pull request #97 from NanoCode012/feat/test-validation
Feat: Update validate_config and add tests
|
2023-05-29 00:38:22 +09:00 |
|
NanoCode012
|
52dd92a0cd
|
Feat: Update validate_config and add tests
|
2023-05-29 00:25:54 +09:00 |
|
Wing Lian
|
88889590ec
|
Merge pull request #90 from NanoCode012/feat/addict
Feat: Convert attrdict to addict
|
2023-05-28 10:43:07 -04:00 |
|
NanoCode012
|
f87bd20555
|
Fix incorrect syntax in test
|
2023-05-28 23:35:29 +09:00 |
|
NanoCode012
|
dd83a20c27
|
Update test to run on PR
|
2023-05-28 23:30:17 +09:00 |
|
NanoCode012
|
7bf2069afd
|
Apply black formatter
|
2023-05-28 23:14:04 +09:00 |
|
NanoCode012
|
923151ffab
|
Add test for DictDefault
|
2023-05-28 23:06:10 +09:00 |
|
NanoCode012
|
56f9ca5709
|
refactor: fix previous refactors
|
2023-05-28 23:06:10 +09:00 |
|
NanoCode012
|
8bd7a49cd7
|
Refactor to use DictDefault instead
|
2023-05-28 23:06:10 +09:00 |
|
NanoCode012
|
18d41cee4a
|
Add DictDefault
|
2023-05-28 23:06:10 +09:00 |
|
NanoCode012
|
93acb648bd
|
Fix load error
|
2023-05-28 23:06:10 +09:00 |
|
NanoCode012
|
bdfe7c9201
|
Convert attrdict to addict
|
2023-05-28 23:06:10 +09:00 |
|
Wing Lian
|
0d4a7f4c04
|
Merge pull request #67 from OpenAccess-AI-Collective/refactor-tokenizer-load
load the tokenizer seperately from the model
|
2023-05-28 08:49:34 -04:00 |
|
Wing Lian
|
af3aacbe16
|
Merge pull request #93 from OpenAccess-AI-Collective/dev-base
cuda properly compiled bitsandbytes for qlora support
|
2023-05-27 19:40:29 -04:00 |
|
Wing Lian
|
cc67862dd3
|
move list not in list logic to fn
|
2023-05-27 16:42:05 -04:00 |
|
Wing Lian
|
cf37980395
|
fix missing run coninuation
|
2023-05-27 15:28:54 -04:00 |
|
NanoCode012
|
ed2dd77e35
|
Merge pull request #89 from OpenAccess-AI-Collective/NanoCode012-update-action-version
Feat: Update actions version
|
2023-05-28 02:12:26 +09:00 |
|
NanoCode012
|
2b8c28bab8
|
Update actions version
|
2023-05-28 01:51:10 +09:00 |
|