Skip to content

Commit b38ea28

Browse files
Eliminate duplicate text chunk (#290)
Removed redundant sentence about prompt recommendations.
1 parent 4e18fab commit b38ea28

1 file changed

Lines changed: 1 addition & 3 deletions

File tree

units/en/unit2/2.md

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -109,8 +109,6 @@ trainer.train()
109109

110110
DPO requires a [preference dataset](https://huggingface.co/docs/trl/en/dataset_formats#preference). The `DPOTrainer` supports both [conversational](https://huggingface.co/docs/trl/en/dataset_formats#conversational) and [standard](https://huggingface.co/docs/trl/en/dataset_formats#standard) dataset formats. When provided with a conversational dataset, the trainer will automatically apply the chat template to the dataset.
111111

112-
Although the `DPOTrainer` supports both explicit and implicit prompts, we recommend using explicit prompts. If provided with an implicit prompt dataset, the trainer will automatically extract the prompt from the `"chosen"` and `"rejected"` columns. For more information, refer to the [preference style](dataset_formats#preference) section.
113-
114112
Although the `DPOTrainer` supports both explicit and implicit prompts, we recommend using explicit prompts. If provided with an implicit prompt dataset, the trainer will automatically extract the prompt from the `"chosen"` and `"rejected"` columns. For more information, refer to the [preference style](https://huggingface.co/docs/trl/en/dataset_formats#preference) section.
115113

116114
| Parameter | Description | Recommendations |
@@ -149,4 +147,4 @@ Another common issue is distribution shift, where the model performs well on the
149147
- Evaluating alignment quality and model performance
150148
- Deploying your aligned model
151149

152-
After mastering DPO, explore advanced techniques in the [advanced DPO methods](3) section.
150+
After mastering DPO, explore advanced techniques in the [advanced DPO methods](3) section.

0 commit comments

Comments
 (0)