c50c4acbf4
* EBFT wip * fixes * more fixeS * add missing strided module * ebft fixes for multi-turn * make ebft work with async * add example for ebft w qwen3.5 * fix for split thinking and update yaml for lora over linear attention only * enforce_eager for vllm arg in schema * fix sync weights * fix multi-gpu * handle updated sig for mm * ddp fixes * improve multi-gpu handling, don't calculate logits, adaptive completion length * chore: lint * chore: lint * support completion_mean * Address corereview feedback * clamp min IS ratio * Address PR code review * more fixes identified * address code review * Fix property from rebase conflict
32 lines
1.2 KiB
Plaintext
32 lines
1.2 KiB
Plaintext
ARG BASE_TAG=main
|
|
FROM axolotlai/axolotl-uv:$BASE_TAG
|
|
|
|
ENV HF_DATASETS_CACHE="/workspace/data/huggingface-cache/datasets"
|
|
ENV HF_HUB_CACHE="/workspace/data/huggingface-cache/hub"
|
|
ENV HF_HOME="/workspace/data/huggingface-cache/hub"
|
|
ENV HF_HUB_ENABLE_HF_TRANSFER="1"
|
|
|
|
EXPOSE 8888
|
|
EXPOSE 22
|
|
|
|
COPY scripts/cloud-entrypoint.sh /root/cloud-entrypoint.sh
|
|
COPY scripts/motd /etc/motd
|
|
|
|
RUN uv pip install jupyterlab notebook ipywidgets && \
|
|
jupyter lab clean
|
|
RUN apt update && \
|
|
apt install --yes --no-install-recommends openssh-server tmux iproute2 nvtop && \
|
|
rm -rf /var/cache/apt/archives && \
|
|
rm -rf /var/lib/apt/lists/* && \
|
|
mkdir -p ~/.ssh && \
|
|
chmod 700 ~/.ssh && \
|
|
printf "\n[[ -z \"\$TMUX\" ]] && { tmux attach-session -t ssh_tmux || tmux new-session -s ssh_tmux; exit; }\n" >> ~/.bashrc && \
|
|
printf "[ ! -z \"\$TERM\" -a -r /etc/motd ] && cat /etc/motd\n" >> ~/.bashrc && \
|
|
printf "source /workspace/axolotl-venv/bin/activate\n" >> ~/.bashrc && \
|
|
chmod +x /workspace/axolotl/scripts/cloud-entrypoint.sh && \
|
|
chmod +x /root/cloud-entrypoint.sh && \
|
|
echo 'set-option -g history-limit 5000' >> ~/.tmux.conf
|
|
|
|
ENTRYPOINT ["/root/cloud-entrypoint.sh"]
|
|
CMD ["sleep", "infinity"]
|