# core.trainers.trl

`core.trainers.trl`

Module for TRL PPO trainer

## Classes

Name | Description
--- | ---
AxolotlCPOTrainer | Extend the base CPOTrainer for axolotl helpers
AxolotlKTOTrainer | Extend the base KTOTrainer for axolotl helpers
AxolotlORPOTrainer | Extend the base ORPOTrainer for axolotl helpers
AxolotlPRMTrainer | Extend the base trl.PRMTrainer for axolotl helpers
AxolotlRewardTrainer | Extend the base RewardTrainer for axolotl helpers
TRLPPOTrainer | Wrapper for TRL PPO trainer to handle customizations

### AxolotlCPOTrainer

    core.trainers.trl.AxolotlCPOTrainer()

Extend the base CPOTrainer for axolotl helpers

#### Methods

Name | Description
--- | ---
get_batch_loss_metrics | Compute the CPO loss and other metrics for the given batch of inputs for train or test.

##### get_batch_loss_metrics

    core.trainers.trl.AxolotlCPOTrainer.get_batch_loss_metrics(
        model,
        batch,
        train_eval='train',
    )

Compute the CPO loss and other metrics for the given batch of inputs for train or test.

### AxolotlKTOTrainer

    core.trainers.trl.AxolotlKTOTrainer()

Extend the base KTOTrainer for axolotl helpers

### AxolotlORPOTrainer

    core.trainers.trl.AxolotlORPOTrainer()

Extend the base ORPOTrainer for axolotl helpers

#### Methods

Name | Description
--- | ---
get_batch_loss_metrics | Compute the ORPO loss and other metrics for the given batch of inputs for train or test.

##### get_batch_loss_metrics

    core.trainers.trl.AxolotlORPOTrainer.get_batch_loss_metrics(
        model,
        batch,
        train_eval='train',
    )

Compute the ORPO loss and other metrics for the given batch of inputs for train or test.

### AxolotlPRMTrainer

    core.trainers.trl.AxolotlPRMTrainer()

Extend the base trl.PRMTrainer for axolotl helpers

### AxolotlRewardTrainer

    core.trainers.trl.AxolotlRewardTrainer()

Extend the base RewardTrainer for axolotl helpers

### TRLPPOTrainer

    core.trainers.trl.TRLPPOTrainer()

Wrapper for TRL PPO trainer to handle customizations