tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

add a latest tag for regular axolotl image, cleanup extraneous print statement (#746)

Browse Source
This commit is contained in:
Wing Lian
2023-10-19 12:28:29 -04:00
committed by GitHub
parent 3a99495b05
commit 70157ccb8f
2 changed files with 4 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
.github/workflows/main.yml vendored
View File

@@ -23,6 +23,7 @@ jobs:
python_version: "3.10" python_version: "3.10"
pytorch: 2.0.1 pytorch: 2.0.1
axolotl_extras: axolotl_extras:
is_latest: true
- cuda: 118 - cuda: 118
cuda_version: 11.8.0 cuda_version: 11.8.0
python_version: "3.10" python_version: "3.10"
@@ -54,7 +55,9 @@ jobs:
PYTORCH_VERSION=${{ matrix.pytorch }} PYTORCH_VERSION=${{ matrix.pytorch }}
file: ./docker/Dockerfile file: ./docker/Dockerfile
push: ${{ github.event_name != 'pull_request' }} push: ${{ github.event_name != 'pull_request' }}
tags: ${{ steps.metadata.outputs.tags }}-py${{ matrix.python_version }}-cu${{ matrix.cuda }}-${{ matrix.pytorch }}${{ matrix.axolotl_extras != '' && '-' || '' }}${{ matrix.axolotl_extras }} tags: |
${{ steps.metadata.outputs.tags }}-py${{ matrix.python_version }}-cu${{ matrix.cuda }}-${{ matrix.pytorch }}${{ matrix.axolotl_extras != '' && '-' || '' }}${{ matrix.axolotl_extras }}
${{ (matrix.is_latest) && format('{0}-latest', steps.metadata.outputs.tags) || '' }}
labels: ${{ steps.metadata.outputs.labels }} labels: ${{ steps.metadata.outputs.labels }}
build-axolotl-runpod: build-axolotl-runpod:
needs: build-axolotl needs: build-axolotl

1
src/axolotl/utils/tokenization.py
View File

@@ -34,6 +34,5 @@ def check_example_labels(example, tokenizer, text_only=False):
delimiter = "" if text_only else " " delimiter = "" if text_only else " "
LOG.info(delimiter.join(colored_tokens)) LOG.info(delimiter.join(colored_tokens))
LOG.info("\n\n\n") LOG.info("\n\n\n")
print(" ".join(colored_tokens))
return " ".join(colored_tokens) return " ".join(colored_tokens)