Default Branch

eadd15c960 · note MAX_JOBS for flash-attn compile speed · Updated 2026-05-13 04:45:21 +00:00

Branches

merge-lora-on-complete
Some checks failed
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled

9aaa4b8ced · set model merge dtype based on cfg · Updated 2023-08-23 08:07:44 +00:00    tocmo0nlord

1914
4
latent-space
Some checks failed
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled

cf00e20270 · experiment w latent space · Updated 2023-08-18 09:47:26 +00:00    tocmo0nlord

1937
1
attn-patches
Some checks failed
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled

587dbbfc02 · fix the patch to work properly and work with FSDP · Updated 2023-08-18 00:33:56 +00:00    tocmo0nlord

1937
9
embeddings-resize
Some checks failed
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled

31079cd5fd · smart resize embeddings · Updated 2023-08-15 03:44:15 +00:00    tocmo0nlord

1960
1
feature/attn-patches
Some checks failed
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled

956a177678 · speed up flash-attn inference · Updated 2023-08-13 18:03:38 +00:00    tocmo0nlord

1969
4
feature/relora-rebased
Some checks failed
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled

1afbd8af2d · Fix logic errors · Updated 2023-08-13 00:31:59 +00:00    tocmo0nlord

1980
6
packing-attn-limit-fa2-rebased
Some checks failed
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled

64af21bcb2 · set env vars trainer needs for FSDP · Updated 2023-08-11 12:46:26 +00:00    tocmo0nlord

2002
56
ssmi-main
Some checks failed
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled

9793faf6dc · pre-commit formatting fixes · Updated 2023-08-06 02:46:02 +00:00    tocmo0nlord

2007
4
openorca-fix-mask
Some checks failed
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled

8028652b8f · fix attetion mask with packing · Updated 2023-07-15 14:38:01 +00:00    tocmo0nlord

2097
3
multipack
Some checks failed
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled

81d60e96f0 · multipack sampler support from openchat · Updated 2023-07-15 12:01:33 +00:00    tocmo0nlord

2072
1
openorca
Some checks failed
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled

f6721baf10 · tweak to make it work when we have no explicit test split · Updated 2023-07-12 02:40:21 +00:00    tocmo0nlord

2097
3
openorca-v2
Some checks failed
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled

f6721baf10 · tweak to make it work when we have no explicit test split · Updated 2023-07-12 02:40:21 +00:00    tocmo0nlord

2097
3
compute-perplexity-metrics
Some checks failed
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled

0f2a16aa33 · use different perplexity calc · Updated 2023-07-10 17:43:50 +00:00    tocmo0nlord

2080
3
dev-base
Some checks failed
ci-cd-base / build-base (<nil>, 117, 11.7.1, 3.9, 1.13.1) (push) Has been cancelled
ci-cd-base / build-base (<nil>, 118, 11.8.0, 3.10, 2.0.0) (push) Has been cancelled
ci-cd-base / build-base (<nil>, 118, 11.8.0, 3.9, 2.0.0) (push) Has been cancelled
ci-cd-base / build-base (gptq, 118, 11.8.0, 3.9, 2.0.0) (push) Has been cancelled
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled

a10da1caff · 11.7.0 nvidia/cuda docker images are deprecated, move to 11.7.1 · Updated 2023-07-01 04:29:07 +00:00    tocmo0nlord

2106
0
Included
flan-no-bos
Some checks failed
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled

e91fed495a · better handling for tokenizers like flan that don't have a bos token · Updated 2023-06-23 19:47:40 +00:00    tocmo0nlord

2120
1
no-bos-tokens-packing
Some checks failed
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled

05d19d2037 · remove debugging, use gpt2 since starcoder requires consent · Updated 2023-06-14 01:32:47 +00:00    tocmo0nlord

2158
2
exp-expand-len
Some checks failed
pre-commit / pre-commit (push) Has been cancelled
PyTest / test (3.10) (push) Has been cancelled
PyTest / test (3.9) (push) Has been cancelled

6fcb73faaa · more gpt-neox long ctx fixes · Updated 2023-06-01 12:20:08 +00:00    tocmo0nlord

2286
8

81de0efc18 · add support for alpaca reflect training (#2) · Updated 2023-04-18 12:34:05 +00:00    tocmo0nlord

2700
0
Included