8779997ba5
* native support for modal cloud from CLI * do lm_eval in cloud too * Fix the sub call to lm-eval * lm_eval option to not post eval, and append not extend * cache bust when using branch, grab sha of latest image tag, update lm-eval dep * allow minimal yaml for lm eval * include modal in requirements * update link in README to include utm * pr feedback * use chat template * revision support * apply chat template as arg * add wandb name support, allow explicit a100-40gb * cloud is optional * handle accidental setting of tasks with a single task str * document the modal cloud yaml for clarity [skip ci] * cli docs * support spawn vs remote for lm-eval * Add support for additional docker commands in modal image build * cloud config shouldn't be a dir * Update README.md Co-authored-by: Charles Frye <cfrye59@gmail.com> * fix annotation args --------- Co-authored-by: Charles Frye <cfrye59@gmail.com>
29 lines
523 B
YAML
29 lines
523 B
YAML
project_name:
|
|
volumes:
|
|
- name: axolotl-data
|
|
mount: /workspace/data
|
|
- name: axolotl-artifacts
|
|
mount: /workspace/artifacts
|
|
|
|
# environment variables from local to set as secrets
|
|
secrets:
|
|
- HF_TOKEN
|
|
- WANDB_API_KEY
|
|
|
|
# Which branch of axolotl to use remotely
|
|
branch:
|
|
|
|
# additional custom commands when building the image
|
|
dockerfile_commands:
|
|
|
|
gpu: h100
|
|
gpu_count: 1
|
|
|
|
# Train specific configurations
|
|
memory: 128
|
|
timeout: 86400
|
|
|
|
# Preprocess specific configurations
|
|
memory_preprocess: 32
|
|
timeout_preprocess: 14400
|