Spaces:

---

smol-course

/

leaderboard

like 13

Running

Model

https://huggingface.co/Sor0ush/smollm3-jobs-sft-merged

Training

hf jobs uv run
--flavor a10g-large
--timeout 10h
--secrets HF_TOKEN
--env HUB_MODEL_ID=Sor0ush/smollm3-jobs-sft
--env HUB_PRIVATE=0
--env USE_LORA=1
--env MAX_LENGTH=1024
--env TRACKIO_SPACE_ID=Sor0ush/trackio
sft_training.py

Merge (LoRA → full model + tokenizer)

hf jobs uv run
--flavor a10g-large
--timeout 1h
--secrets HF_TOKEN
--env BASE_MODEL=HuggingFaceTB/SmolLM3-3B-Base
--env ADAPTER_ID=Sor0ush/smollm3-jobs-sft
--env MERGED_ID=Sor0ush/smollm3-jobs-sft-merged
merge_lora.py

Evaluation

hf jobs uv run
--flavor a10g-large
--timeout 2h
--with lighteval
--with torch
--with accelerate
--secrets HF_TOKEN
lighteval accelerate
"model_name=Sor0ush/smollm3-jobs-sft-merged,dtype=bfloat16,trust_remote_code=true,override_chat_template=false"
"gsm8k|0"
--push-to-hub
--results-org Sor0ush

Results dataset

Sor0ush/details_Sor0ush__smollm3-jobs-sft-merged_private