tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

run PR e2e docker CI tests in Modal (#1217) [skip ci]

Browse Source 
* wip modal for ci

* handle falcon layernorms better

* update

* rebuild the template each time with the pseudo-ARGS

* fix ref

* update tests to use modal

* cleanup ci script

* make sure to install jinja2 also

* kickoff the gh action on gh hosted runners and specify num gpus
This commit is contained in:
Wing Lian
2024-01-26 16:13:27 -05:00
committed by GitHub
parent af29d81f80
commit 36d053f6f0
6 changed files with 141 additions and 42 deletions
Download Patch File Download Diff File Expand all files Collapse all files

17
docker/Dockerfile-tests → docker/Dockerfile-modal
View File

@@ -1,14 +1,11 @@
ARG BASE_TAG=main-base
FROM winglian/axolotl-base:$BASE_TAG
FROM winglian/axolotl-base:main-base
ARG TORCH_CUDA_ARCH_LIST="7.0 7.5 8.0 8.6+PTX"
ARG AXOLOTL_EXTRAS=""
ARG CUDA="118"
ENV BNB_CUDA_VERSION=$CUDA
ARG PYTORCH_VERSION="2.0.1"
ARG GITHUB_REF="main"
ENV PYTORCH_VERSION=$PYTORCH_VERSION
ENV TORCH_CUDA_ARCH_LIST="7.0 7.5 8.0 8.6+PTX"
ENV AXOLOTL_EXTRAS=""
ENV CUDA="118"
ENV BNB_CUDA_VERSION="118"
ENV PYTORCH_VERSION="2.0.1"
ENV GITHUB_REF="main"
RUN apt-get update && \
apt-get install -y --allow-change-held-packages vim curl nano libnccl2 libnccl-dev