268543a3be
* current not clean working version move torch trainer to do_cli update code with config changes and clean up edit config cleanup add run name to trainer * address comments * use axolotl train in multigpu tests and add ray tests for multi-gpu * accelerate uses underscores for main_process_port arg * chore: lint * fix order of accelerate args * include ray train in docker images * current not clean working version move torch trainer to do_cli update code with config changes and clean up edit config cleanup add run name to trainer * address comments * use axolotl train in multigpu tests and add ray tests for multi-gpu * accelerate uses underscores for main_process_port arg * chore: lint * fix order of accelerate args * include ray train in docker images * fix bf16 resolution behavior * move dtype logic * x Signed-off-by: SumanthRH <sumanthrh@anyscale.com> * rename Signed-off-by: SumanthRH <sumanthrh@anyscale.com> * add to sidebar Signed-off-by: SumanthRH <sumanthrh@anyscale.com> * Apply suggestions from code review Co-authored-by: Eric Tang <46737979+erictang000@users.noreply.github.com> * Update docs/ray-integration.qmd Co-authored-by: Eric Tang <46737979+erictang000@users.noreply.github.com> * pre-commit fixes Signed-off-by: SumanthRH <sumanthrh@anyscale.com> * use output_dir instead of hardcoded saves path Co-authored-by: NanoCode012 <kevinvong@rocketmail.com> * bugfix storage dir * change type\ for resources_per_worker --------- Signed-off-by: SumanthRH <sumanthrh@anyscale.com> Co-authored-by: Wing Lian <wing@axolotl.ai> Co-authored-by: SumanthRH <sumanthrh@anyscale.com> Co-authored-by: Sumanth R Hegde <39546518+SumanthRH@users.noreply.github.com> Co-authored-by: Wing Lian <wing.lian@gmail.com> Co-authored-by: NanoCode012 <kevinvong@rocketmail.com>
55 lines
1.2 KiB
YAML
55 lines
1.2 KiB
YAML
project:
|
|
type: website
|
|
|
|
website:
|
|
title: "Axolotl"
|
|
description: "Fine-tuning"
|
|
favicon: favicon.jpg
|
|
navbar:
|
|
title: Axolotl
|
|
background: dark
|
|
pinned: false
|
|
collapse: false
|
|
tools:
|
|
- icon: twitter
|
|
href: https://twitter.com/axolotl_ai
|
|
- icon: github
|
|
href: https://github.com/axolotl-ai-cloud/axolotl/
|
|
- icon: discord
|
|
href: https://discord.gg/7m9sfhzaf3
|
|
|
|
sidebar:
|
|
pinned: true
|
|
collapse-level: 2
|
|
style: docked
|
|
contents:
|
|
- text: Home
|
|
href: index.qmd
|
|
- section: "How-To Guides"
|
|
contents:
|
|
# TODO Edit folder structure after we have more docs.
|
|
- docs/debugging.qmd
|
|
- docs/multipack.qmd
|
|
- docs/fsdp_qlora.qmd
|
|
- docs/input_output.qmd
|
|
- docs/rlhf.qmd
|
|
- docs/nccl.qmd
|
|
- docs/mac.qmd
|
|
- docs/multi-node.qmd
|
|
- docs/unsloth.qmd
|
|
- docs/amd_hpc.qmd
|
|
- docs/ray-integration.qmd
|
|
- section: "Dataset Formats"
|
|
contents: docs/dataset-formats/*
|
|
- section: "Reference"
|
|
contents:
|
|
- docs/config.qmd
|
|
- docs/faq.qmd
|
|
|
|
|
|
format:
|
|
html:
|
|
theme: materia
|
|
css: styles.css
|
|
toc: true
|