Attempt to run multigpu in PR CI for now to ensure it works (#1815) [skip ci]

Browse Source

* Attempt to run multigpu in PR CI for now to ensure it works

* fix yaml file

* forgot to include multigpu tests

* fix call to cicd.multigpu

* dump dictdefault to dict for yaml conversion

* use to_dict instead of casting

* 16bit-lora w flash attention, 8bit lora seems problematic

* add llama fsdp test

* more tests

* Add test for qlora + fsdp with prequant

* limit accelerate to 2 processes and disable broken qlora+fsdp+bnb test

* move multigpu tests to biweekly

...

This commit is contained in:

Wing Lian

2024-08-09 11:50:13 -04:00

committed by GitHub

parent 3e2b269d06

commit 54392ac8a6

7 changed files with 473 additions and 4 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

0

tests/e2e/multigpu/__init__.py Normal file