Skip to content

Commit 8607ec8

Browse files
authored
FIX SFT example dataset (#280)
The current [HuggingFaceTB/smoltalk2](https://huggingface.co/datasets/HuggingFaceTB/smoltalk2) dataset structure is not valid for the provided code snippets since the expected `train` and `test` splits are not present. This change uses the same dataset as the example defined when using [hf jobs](https://huggingface.co/learn/smol-course/unit1/5#advanced-jobs-configuration).
1 parent cb2a84a commit 8607ec8

1 file changed

Lines changed: 2 additions & 3 deletions

File tree

units/en/unit1/3.md

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -462,7 +462,7 @@ model = AutoModelForCausalLM.from_pretrained("HuggingFaceTB/SmolLM3-3B-Base")
462462
tokenizer = AutoTokenizer.from_pretrained("HuggingFaceTB/SmolLM3-3B-Base")
463463
464464
# Load SmolTalk2 dataset
465-
dataset = load_dataset("HuggingFaceTB/smoltalk2", "SFT")
465+
dataset = load_dataset("HuggingFaceTB/smoltalk2_everyday_convs_think")
466466
467467
# Configure training with Trackio integration
468468
config = SFTConfig(
@@ -489,8 +489,7 @@ trainer.train()
489489
# Fine-tune SmolLM3 using TRL CLI with Trackio tracking
490490
trl sft \
491491
--model_name_or_path HuggingFaceTB/SmolLM3-3B-Base \
492-
--dataset_name HuggingFaceTB/smoltalk2 \
493-
--dataset_config SFT \
492+
--dataset_name HuggingFaceTB/smoltalk2_everyday_convs_think \
494493
--output_dir ./smollm3-sft-model \
495494
--per_device_train_batch_size 4 \
496495
--learning_rate 5e-5 \

0 commit comments

Comments
 (0)