Dan Saunders fc973f4322 CLI Implementation with Click (#2107) ...

* Initial CLI implementation with click package

* Adding fetch command for pulling examples and deepspeed configs

* Automating default options for CliArgs classes

* Mimicking existing no config behavior

* bugfix in choose_config

* Updating fetch to sync instead of re-download

* bugfix

* isort fix

* fixing yaml isort order

* pre-commit fixes

* simplifying argument parsing -- pass through kwargs to do_cli

* make accelerate launch default for non-preprocess commands

* fixing arg handling

* testing None placeholder approach

* removing hacky --use-gpu argument to preprocess command

* Adding brief README documentation for CLI

* remove (New)

* Initial CLI pytest tests

* progress on CLI pytest

* adding inference CLI tests; cleanup

* Refactor train CLI tests to remove various mocking

* Major CLI test refator; adding remaining CLI codepath test coverage

* pytest fixes

* remove integration markers

* parallelizing examples, deepspeed config downloads; rename test to match other CLI test naming

* moving cli pytest due to isolation issues; cleanup

* testing fixes; various minor improvements

* fix

* tests fix

* Update tests/cli/conftest.py

Co-authored-by: Wing Lian <wing.lian@gmail.com>

---------

Co-authored-by: Dan Saunders <dan@axolotl.ai>
Co-authored-by: Wing Lian <wing.lian@gmail.com>

2024-12-05 22:11:48 -05:00

..

cicd.sh

CLI Implementation with Click (#2107)

2024-12-05 22:11:48 -05:00

Dockerfile.jinja

drop unnecessary BNB_CUDA_VERSION env var from docker as it just results in warnings (#2121) [skip ci]

2024-12-04 12:25:47 -05:00

multigpu.py

change deprecated modal Stub to App (#2038)

2024-11-11 15:10:34 -05:00

multigpu.sh

gradient accumulation tests, embeddings w pad_token fix, smaller models (#2059)

2024-11-14 12:59:00 -05:00

tests.py

feat: add cut_cross_entropy (#2091)

2024-12-03 08:22:22 -05:00