kallewoof ef24342538 fix: switch to using the HuggingFace Transformers NEFT implementation (#941) ...

* fix: switch to using the HuggingFace Transformers NEFT implementation

* linter

* add support for noisy_embedding_alpha with a warning about it being renamed

* restore pre/posttrain_hooks

* move validation of NEFT noise alpha into validate_config()

* linter

2023-12-13 17:15:34 -05:00

..

cli

Fix Deepspeed loading (#950)

2023-12-13 16:03:23 -05:00

common

Create preprocess CLI (#785)

2023-10-26 09:35:42 -04:00

core

fix: switch to using the HuggingFace Transformers NEFT implementation (#941)

2023-12-13 17:15:34 -05:00

models

Mixtral official (#942)

2023-12-11 23:44:33 -05:00

monkeypatch

fix: switch to using the HuggingFace Transformers NEFT implementation (#941)

2023-12-13 17:15:34 -05:00

prompt_strategies

Respect sequence_len in config for type: llama2_chat (#926)

2023-12-12 09:39:22 -08:00

utils

fix: switch to using the HuggingFace Transformers NEFT implementation (#941)

2023-12-13 17:15:34 -05:00

__init__.py

WIP for axolotl trainer

2023-04-14 00:20:05 -04:00

convert.py

Lint convert.py

2023-05-31 02:53:53 +09:00

datasets.py

update table for rwkv4 support, fix process count for dataset (#822)

2023-11-04 23:45:44 -04:00

logging_config.py

log rank too (#527)

2023-09-06 08:37:51 -04:00

prompt_tokenizers.py

Create preprocess CLI (#785)

2023-10-26 09:35:42 -04:00

prompters.py

fix: remove excessive newlines in system prompt(s) for alpaca (#936)

2023-12-13 16:40:02 +09:00

train.py

fix: switch to using the HuggingFace Transformers NEFT implementation (#941)

2023-12-13 17:15:34 -05:00