cc3cebfa70
* WIP conversion to use pydantic for config validation * wip, more fields, add capabilities * wip * update pydantic validation to match existing tests * tweak requirements * setup deprecated paams pydantic model * more validations * wrap up rest of the validations * flesh out the rest of the options from the readme into pydantic * fix model validators as class methods remember to return in validator missing return add missing relora attributes fix test for DictDefault change fix sys template for mistral from fastchat change in PR 2872 fix test for batch size warning * more missing attributes for cfg * updates from PR feedback * fix validation for datasets and pretrain datasets * fix test for lora check
43 lines
692 B
Plaintext
43 lines
692 B
Plaintext
--extra-index-url https://huggingface.github.io/autogptq-index/whl/cu118/
|
|
packaging==23.2
|
|
peft @ git+https://github.com/huggingface/peft.git
|
|
transformers @ git+https://github.com/huggingface/transformers.git@ae49b218c3d718df90d8e4a109016450fb8f0632
|
|
tokenizers==0.15.0
|
|
bitsandbytes>=0.41.1
|
|
accelerate==0.26.1
|
|
deepspeed>=0.13.1
|
|
pydantic>=2.5.3
|
|
addict
|
|
fire
|
|
PyYAML>=6.0
|
|
requests
|
|
datasets>=2.15.0
|
|
flash-attn==2.3.3
|
|
sentencepiece
|
|
wandb
|
|
einops
|
|
xformers==0.0.22
|
|
optimum==1.16.2
|
|
hf_transfer
|
|
colorama
|
|
numba
|
|
numpy>=1.24.4
|
|
# qlora things
|
|
evaluate==0.4.1
|
|
scipy
|
|
scikit-learn==1.2.2
|
|
pynvml
|
|
art
|
|
fschat==0.2.36
|
|
gradio==3.50.2
|
|
tensorboard
|
|
|
|
mamba-ssm==1.1.1
|
|
|
|
# remote filesystems
|
|
s3fs
|
|
gcsfs
|
|
# adlfs
|
|
|
|
trl>=0.7.9
|