Wing Lian 6319da1f9b Unsloth gradient checkpointing offload (#1528) ...

* unsloth gradient checkpointing

* fix validation too

* fixes to make it work with mistral

* monkeypatch the checkpoint fn earlier

2024-04-16 14:53:57 -04:00

..

cli

Print versions (#1496)

2024-04-09 11:05:15 -04:00

common

support for true batches with multipack (#1230)

2024-02-01 10:18:42 -05:00

core

DBRX Model Support (#1462)

2024-04-12 09:02:36 -04:00

models

Phi2 multipack (#1173)

2024-01-23 12:54:36 -05:00

monkeypatch

Unsloth gradient checkpointing offload (#1528)

2024-04-16 14:53:57 -04:00

prompt_strategies

fix pretraining_ on odd datasets (#1463)

2024-04-01 20:48:59 -07:00

utils

Unsloth gradient checkpointing offload (#1528)

2024-04-16 14:53:57 -04:00

__init__.py

WIP for axolotl trainer

2023-04-14 00:20:05 -04:00

convert.py

Lint convert.py

2023-05-31 02:53:53 +09:00

datasets.py

Pretrain transforms (#1261)

2024-02-06 00:37:03 -05:00

logging_config.py

Don't disable existing loggers when configuring axolotl logging (#1395)

2024-03-14 11:05:21 -04:00

loraplus.py

lora+ support (#1352)

2024-03-05 07:29:23 -05:00

prompt_tokenizers.py

Feat: Add sharegpt multirole (#1137)

2024-03-19 20:51:49 +09:00

prompters.py

Feat: Add sharegpt multirole (#1137)

2024-03-19 20:51:49 +09:00

train.py

DBRX Model Support (#1462)

2024-04-12 09:02:36 -04:00