Wing Lian 9bf854e59c Phi update 202311 (#876) ...

* add phi modeling from hf

* update for packing and use new modeling class for phi

* update e2e tests for phi to use new model name

* update example phi to also use new phi model name

* use AutoModelForCausalLM for phi lora since sample packing isn't supported

2023-11-17 12:47:17 -05:00

..

e2e

Phi update 202311 (#876)

2023-11-17 12:47:17 -05:00

fixtures

misc sharegpt fixes (#723)

2023-10-13 11:04:39 -04:00

monkeypatch

Attention mask and position id fixes for packing (#285)

2023-08-12 15:14:56 -04:00

test_data.py

Fix pretraining with iterable/streaming Dataset (#556)

2023-09-13 00:16:40 -04:00

test_dict.py

fix DefaultDict.__or__

2023-08-13 01:15:50 +00:00

test_expand_mask.py

Attention mask and position id fixes for packing (#285)

2023-08-12 15:14:56 -04:00

test_normalize_config.py

simplify by removing duplicate base_model_config (#772)

2023-10-23 01:42:38 -04:00

test_packed_dataset.py

Attention mask and position id fixes for packing (#285)

2023-08-12 15:14:56 -04:00

test_prompt_tokenizers.py

misc sharegpt fixes (#723)

2023-10-13 11:04:39 -04:00

test_prompters.py

Attention mask and position id fixes for packing (#285)

2023-08-12 15:14:56 -04:00

test_tokenizers.py

simplify load_tokenizer

2023-08-12 18:55:06 -07:00

test_validation.py

Fix: Warn when fullfinetune without adapter (#770)

2023-10-22 15:41:43 -04:00