core.trainers.mixins.sequence_parallel
core.trainers.mixins.sequence_parallel
Module for Axolotl trainer sequence parallelism mixin
Classes
| Name | Description |
|---|---|
| SequenceParallelMixin | Mixin class for sequence parallelism support in trainers. |
SequenceParallelMixin
core.trainers.mixins.sequence_parallel.SequenceParallelMixin()Mixin class for sequence parallelism support in trainers.
This mixin provides functionality for handling sequence parallelism, specifically for creating appropriate data samplers.