cf6654769a
* flash attn pip * add packaging * add packaging to apt get * install flash attn in dockerfile * remove unused whls * add wheel * clean up pr fix packaging requirement for ci upgrade pip for ci skip build isolation for requiremnents to get flash-attn working install flash-attn seperately * install wheel for ci * no flash-attn for basic cicd * install flash-attn as pip extras --------- Co-authored-by: Ubuntu <mgh@mgh-vm.wsyvwcia0jxedeyrchqg425tpb.ax.internal.cloudapp.net> Co-authored-by: mhenrichsen <some_email@hey.com> Co-authored-by: Mads Henrichsen <mads@BrbartiendeMads.lan> Co-authored-by: Wing Lian <wing.lian@gmail.com>
31 lines
922 B
Docker
31 lines
922 B
Docker
ARG BASE_TAG=main-base
|
|
FROM winglian/axolotl-base:$BASE_TAG
|
|
|
|
ARG TORCH_CUDA_ARCH_LIST="7.0 7.5 8.0 8.6+PTX"
|
|
ARG AXOLOTL_EXTRAS=""
|
|
ARG CUDA="118"
|
|
ENV BNB_CUDA_VERSION=$CUDA
|
|
|
|
RUN apt-get update && \
|
|
apt-get install -y vim curl
|
|
|
|
WORKDIR /workspace
|
|
|
|
RUN pip3 install --force-reinstall "peft @ git+https://github.com/huggingface/peft.git@main"
|
|
RUN git clone --depth=1 https://github.com/OpenAccess-AI-Collective/axolotl.git
|
|
# If AXOLOTL_EXTRAS is set, append it in brackets
|
|
RUN cd axolotl && \
|
|
if [ "$AXOLOTL_EXTRAS" != "" ] ; then \
|
|
pip install -e .[flash-attn,$AXOLOTL_EXTRAS]; \
|
|
else \
|
|
pip install -e .[flash-attn]; \
|
|
fi
|
|
|
|
# fix so that git fetch/pull from remote works
|
|
RUN cd axolotl && \
|
|
git config remote.origin.fetch "+refs/heads/*:refs/remotes/origin/*" && \
|
|
git config --get remote.origin.fetch
|
|
|
|
# helper for huggingface-login cli
|
|
RUN git config --global credential.helper store
|