# core.trainers.trl

`core.trainers.trl`

Module for TRL PPO trainer

## Classes

Name | Description
--- | ---
AxolotlCPOTrainer | Extend the base CPOTrainer for axolotl helpers
AxolotlKTOTrainer | Extend the base KTOTrainer for axolotl helpers
AxolotlORPOTrainer | Extend the base ORPOTrainer for axolotl helpers
AxolotlPRMTrainer | Extend the base trl.PRMTrainer for axolotl helpers
AxolotlRewardTrainer | Extend the base RewardTrainer for axolotl helpers
TRLPPOTrainer | Wrapper for TRL PPO trainer to handle customizations

### AxolotlCPOTrainer

    core.trainers.trl.AxolotlCPOTrainer(*args, **kwargs)

Extend the base CPOTrainer for axolotl helpers

### AxolotlKTOTrainer

    core.trainers.trl.AxolotlKTOTrainer(*args, **kwargs)

Extend the base KTOTrainer for axolotl helpers

### AxolotlORPOTrainer

    core.trainers.trl.AxolotlORPOTrainer(*args, **kwargs)

Extend the base ORPOTrainer for axolotl helpers

### AxolotlPRMTrainer

    core.trainers.trl.AxolotlPRMTrainer(*args, **kwargs)

Extend the base trl.PRMTrainer for axolotl helpers

### AxolotlRewardTrainer

    core.trainers.trl.AxolotlRewardTrainer(*args, **kwargs)

Extend the base RewardTrainer for axolotl helpers

### TRLPPOTrainer

    core.trainers.trl.TRLPPOTrainer()

Wrapper for TRL PPO trainer to handle customizations