Default Branch

activeblue/main
Some checks failed
Tests Nightly against upstream main / pre-commit (push) Has been cancelled
Tests Nightly against upstream main / Prefetch S3 once to prime the CDN cache (push) Has been cancelled
Tests Nightly against upstream main / PyTest (3.12, 2.10.0) (push) Has been cancelled
Tests Nightly against upstream main / PyTest (3.12, 2.9.1) (push) Has been cancelled
Tests Nightly against upstream main / docker-e2e-tests (<nil>, 128, 12.8.1, 1, 3.11, 2.10.0) (push) Has been cancelled
Tests Nightly against upstream main / docker-e2e-tests (<nil>, 128, 12.8.1, true, 1, 3.11, 2.9.1) (push) Has been cancelled
Tests Nightly against upstream main / docker-e2e-tests (<nil>, 130, 13.0.0, true, 1, 3.12, 2.9.1) (push) Has been cancelled
Tests Nightly against upstream main / docker-e2e-multigpu-tests (<nil>, 128, 12.8.1, true, 2, 3.11, 2.9.1) (push) Has been cancelled
docker-nightlies / build-axolotl (<nil>, 128, 12.8.1, 3.11, 2.9.1) (push) Has been cancelled
docker-nightlies / build-axolotl-cloud (<nil>, 128, 12.8.1, 3.11, 2.9.1) (push) Has been cancelled
docker-multigpu-tests-biweekly / test-axolotl-multigpu (<nil>, 130, 13.0.0, 2, 3.11, 2.9.1) (push) Has been cancelled
docker-multigpu-tests-biweekly / test-axolotl-multigpu (fbgemm-gpu, 128, 12.8.1, 2, 3.11, 2.10.0) (push) Has been cancelled

c6da9b9e92 · Update SETUP_MIAAI.md: add bare Ubuntu rebuild section (driver, packages, Ollama) · Updated 2026-05-13 21:33:02 +00:00

Branches

e12133613b · Remove another unused import · Updated 2023-12-07 20:58:29 +00:00    tocmo0nlord

1660
8

4f9b172c47 · Remove FP32 cast · Updated 2023-12-07 15:28:25 +00:00    tocmo0nlord

1655
4

effb281b24 · wip for multipack pretraining · Updated 2023-11-25 22:12:20 +00:00    tocmo0nlord

1664
1

da154e6d56 · support for json data as completion · Updated 2023-11-25 21:05:04 +00:00    tocmo0nlord

1665
1

9084879861 · tinyllama · Updated 2023-11-16 13:36:01 +00:00    tocmo0nlord

1674
1
fp8

8836986a92 · support for fp8 · Updated 2023-11-10 07:35:19 +00:00    tocmo0nlord

1688
1

87e8f13056 · repalce linear layers for qlora as well as add peft · Updated 2023-11-02 02:31:02 +00:00    tocmo0nlord

1702
10

b52e61a574 · pretrain fixes for mm · Updated 2023-10-30 15:03:55 +00:00    tocmo0nlord

1715
10

db86e32cf4 · enable hf trasfer and add unzip to image · Updated 2023-10-29 08:53:14 +00:00    tocmo0nlord

1705
1

b885169229 · handle load_model splat · Updated 2023-10-24 01:55:05 +00:00    tocmo0nlord

1715
3

d0b534292f · Add e2e test for ia3 ft · Updated 2023-10-19 13:27:55 +00:00    tocmo0nlord

1730
10

080612219b · use even if not using sample packing · Updated 2023-10-13 21:54:35 +00:00    tocmo0nlord

1736
2

b4d84d56d5 · support for batched sharegpt tokenization to skip bad data · Updated 2023-10-06 19:03:07 +00:00    tocmo0nlord

1756
1

7771498eae · add guassian dropout support · Updated 2023-09-25 18:50:39 +00:00    tocmo0nlord

1791
1

ca476d7f8e · don't load the actual model when pre-loading to load modeling code · Updated 2023-09-20 17:37:32 +00:00    tocmo0nlord

1810
1
datasets-refactor
Some checks failed
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled

881d333b84 · wip for new datasets abstractions · Updated 2023-09-05 20:37:48 +00:00    tocmo0nlord

1870
1
multi-gpu-state
Some checks failed
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled

83d904a27d · fix the context manager call · Updated 2023-09-04 02:49:28 +00:00    tocmo0nlord

1878
2
autogptq-tests
Some checks failed
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled

0026fcc3df · remove torch install for now · Updated 2023-09-01 15:15:22 +00:00    tocmo0nlord

1888
8
fsdp-defaults
Some checks failed
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled

53ce90d21e · add sync_model_states parameter to fix resume from checkpoint with fsdp · Updated 2023-08-31 04:15:50 +00:00    tocmo0nlord

1887
1
benchmark-callbacks-next
Some checks failed
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled

c3de28942c · fix for gather across multiple gpus · Updated 2023-08-29 13:57:28 +00:00    tocmo0nlord

1897
23