Instructions to use rl-rag/qwen3-8B-sft-mix-v20250921_long_form_only with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use rl-rag/qwen3-8B-sft-mix-v20250921_long_form_only with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="rl-rag/qwen3-8B-sft-mix-v20250921_long_form_only")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("rl-rag/qwen3-8B-sft-mix-v20250921_long_form_only")
model = AutoModelForCausalLM.from_pretrained("rl-rag/qwen3-8B-sft-mix-v20250921_long_form_only", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use rl-rag/qwen3-8B-sft-mix-v20250921_long_form_only with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "rl-rag/qwen3-8B-sft-mix-v20250921_long_form_only"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "rl-rag/qwen3-8B-sft-mix-v20250921_long_form_only",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/rl-rag/qwen3-8B-sft-mix-v20250921_long_form_only

SGLang

How to use rl-rag/qwen3-8B-sft-mix-v20250921_long_form_only with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "rl-rag/qwen3-8B-sft-mix-v20250921_long_form_only" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "rl-rag/qwen3-8B-sft-mix-v20250921_long_form_only",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "rl-rag/qwen3-8B-sft-mix-v20250921_long_form_only" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "rl-rag/qwen3-8B-sft-mix-v20250921_long_form_only",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use rl-rag/qwen3-8B-sft-mix-v20250921_long_form_only with Docker Model Runner:
```
docker model run hf.co/rl-rag/qwen3-8B-sft-mix-v20250921_long_form_only
```

qwen3-8B-sft-mix-v20250921_long_form_only / trainer_log.jsonl

rulins

Upload folder using huggingface_hub

cbf6835 verified 11 months ago

Raw

History Blame Contribute Delete

15.8 kB

	{"current_steps": 5, "total_steps": 405, "loss": 1.5427, "lr": 3.902439024390244e-06, "epoch": 0.062402496099843996, "percentage": 1.23, "elapsed_time": "0:09:13", "remaining_time": "12:17:44"}
	{"current_steps": 10, "total_steps": 405, "loss": 1.3696, "lr": 8.78048780487805e-06, "epoch": 0.12480499219968799, "percentage": 2.47, "elapsed_time": "0:17:37", "remaining_time": "11:36:10"}
	{"current_steps": 15, "total_steps": 405, "loss": 1.2251, "lr": 1.3658536585365855e-05, "epoch": 0.187207488299532, "percentage": 3.7, "elapsed_time": "0:26:17", "remaining_time": "11:23:29"}
	{"current_steps": 20, "total_steps": 405, "loss": 1.1254, "lr": 1.8536585365853663e-05, "epoch": 0.24960998439937598, "percentage": 4.94, "elapsed_time": "0:35:15", "remaining_time": "11:18:50"}
	{"current_steps": 25, "total_steps": 405, "loss": 1.0861, "lr": 2.3414634146341463e-05, "epoch": 0.31201248049922, "percentage": 6.17, "elapsed_time": "0:43:49", "remaining_time": "11:06:07"}
	{"current_steps": 30, "total_steps": 405, "loss": 1.0432, "lr": 2.829268292682927e-05, "epoch": 0.374414976599064, "percentage": 7.41, "elapsed_time": "0:52:40", "remaining_time": "10:58:21"}
	{"current_steps": 35, "total_steps": 405, "loss": 1.0154, "lr": 3.3170731707317074e-05, "epoch": 0.43681747269890797, "percentage": 8.64, "elapsed_time": "1:01:33", "remaining_time": "10:50:42"}
	{"current_steps": 40, "total_steps": 405, "loss": 1.0176, "lr": 3.804878048780488e-05, "epoch": 0.49921996879875197, "percentage": 9.88, "elapsed_time": "1:10:28", "remaining_time": "10:43:07"}
	{"current_steps": 45, "total_steps": 405, "loss": 1.0053, "lr": 3.9993296289909065e-05, "epoch": 0.5616224648985959, "percentage": 11.11, "elapsed_time": "1:19:08", "remaining_time": "10:33:07"}
	{"current_steps": 50, "total_steps": 405, "loss": 0.9786, "lr": 3.995234544602496e-05, "epoch": 0.62402496099844, "percentage": 12.35, "elapsed_time": "1:27:30", "remaining_time": "10:21:17"}
	{"current_steps": 55, "total_steps": 405, "loss": 0.9687, "lr": 3.9874244197864856e-05, "epoch": 0.6864274570982839, "percentage": 13.58, "elapsed_time": "1:36:20", "remaining_time": "10:13:05"}
	{"current_steps": 60, "total_steps": 405, "loss": 0.972, "lr": 3.9759137966574936e-05, "epoch": 0.748829953198128, "percentage": 14.81, "elapsed_time": "1:44:43", "remaining_time": "10:02:09"}
	{"current_steps": 65, "total_steps": 405, "loss": 0.9656, "lr": 3.960724107497947e-05, "epoch": 0.8112324492979719, "percentage": 16.05, "elapsed_time": "1:53:10", "remaining_time": "9:52:01"}
	{"current_steps": 70, "total_steps": 405, "loss": 0.9594, "lr": 3.9418836348521045e-05, "epoch": 0.8736349453978159, "percentage": 17.28, "elapsed_time": "2:02:12", "remaining_time": "9:44:48"}
	{"current_steps": 75, "total_steps": 405, "loss": 0.9615, "lr": 3.9194274588651754e-05, "epoch": 0.9360374414976599, "percentage": 18.52, "elapsed_time": "2:10:59", "remaining_time": "9:36:22"}
	{"current_steps": 80, "total_steps": 405, "loss": 0.9639, "lr": 3.8933973919656125e-05, "epoch": 0.9984399375975039, "percentage": 19.75, "elapsed_time": "2:19:47", "remaining_time": "9:27:56"}
	{"current_steps": 85, "total_steps": 405, "loss": 0.8615, "lr": 3.863841901012174e-05, "epoch": 1.0499219968798752, "percentage": 20.99, "elapsed_time": "2:27:12", "remaining_time": "9:14:13"}
	{"current_steps": 90, "total_steps": 405, "loss": 0.8412, "lr": 3.830816017050733e-05, "epoch": 1.1123244929797191, "percentage": 22.22, "elapsed_time": "2:35:53", "remaining_time": "9:05:37"}
	{"current_steps": 95, "total_steps": 405, "loss": 0.8315, "lr": 3.7943812328488464e-05, "epoch": 1.1747269890795633, "percentage": 23.46, "elapsed_time": "2:44:45", "remaining_time": "8:57:36"}
	{"current_steps": 100, "total_steps": 405, "loss": 0.8236, "lr": 3.754605388398884e-05, "epoch": 1.2371294851794072, "percentage": 24.69, "elapsed_time": "2:53:19", "remaining_time": "8:48:37"}
	{"current_steps": 105, "total_steps": 405, "loss": 0.819, "lr": 3.711562544602895e-05, "epoch": 1.2995319812792512, "percentage": 25.93, "elapsed_time": "3:02:10", "remaining_time": "8:40:29"}
	{"current_steps": 110, "total_steps": 405, "loss": 0.8186, "lr": 3.6653328453744125e-05, "epoch": 1.3619344773790951, "percentage": 27.16, "elapsed_time": "3:10:42", "remaining_time": "8:31:27"}
	{"current_steps": 115, "total_steps": 405, "loss": 0.8224, "lr": 3.6160023684139535e-05, "epoch": 1.424336973478939, "percentage": 28.4, "elapsed_time": "3:19:20", "remaining_time": "8:22:40"}
	{"current_steps": 120, "total_steps": 405, "loss": 0.8413, "lr": 3.56366296493606e-05, "epoch": 1.4867394695787832, "percentage": 29.63, "elapsed_time": "3:28:07", "remaining_time": "8:14:16"}
	{"current_steps": 125, "total_steps": 405, "loss": 0.8306, "lr": 3.5084120886463144e-05, "epoch": 1.5491419656786272, "percentage": 30.86, "elapsed_time": "3:37:07", "remaining_time": "8:06:21"}
	{"current_steps": 130, "total_steps": 405, "loss": 0.8199, "lr": 3.450352614286753e-05, "epoch": 1.611544461778471, "percentage": 32.1, "elapsed_time": "3:45:39", "remaining_time": "7:57:21"}
	{"current_steps": 135, "total_steps": 405, "loss": 0.818, "lr": 3.389592646087545e-05, "epoch": 1.6739469578783153, "percentage": 33.33, "elapsed_time": "3:54:30", "remaining_time": "7:49:00"}
	{"current_steps": 140, "total_steps": 405, "loss": 0.8215, "lr": 3.326245316481591e-05, "epoch": 1.7363494539781592, "percentage": 34.57, "elapsed_time": "4:03:09", "remaining_time": "7:40:15"}
	{"current_steps": 145, "total_steps": 405, "loss": 0.8335, "lr": 3.260428575456828e-05, "epoch": 1.7987519500780031, "percentage": 35.8, "elapsed_time": "4:11:41", "remaining_time": "7:31:19"}
	{"current_steps": 150, "total_steps": 405, "loss": 0.8156, "lr": 3.192264970938451e-05, "epoch": 1.861154446177847, "percentage": 37.04, "elapsed_time": "4:20:13", "remaining_time": "7:22:23"}
	{"current_steps": 155, "total_steps": 405, "loss": 0.8173, "lr": 3.121881420609979e-05, "epoch": 1.923556942277691, "percentage": 38.27, "elapsed_time": "4:28:52", "remaining_time": "7:13:40"}
	{"current_steps": 160, "total_steps": 405, "loss": 0.8279, "lr": 3.049408975598016e-05, "epoch": 1.985959438377535, "percentage": 39.51, "elapsed_time": "4:37:32", "remaining_time": "7:04:58"}
	{"current_steps": 165, "total_steps": 405, "loss": 0.7147, "lr": 2.97498257646072e-05, "epoch": 2.0374414976599065, "percentage": 40.74, "elapsed_time": "4:44:31", "remaining_time": "6:53:51"}
	{"current_steps": 170, "total_steps": 405, "loss": 0.6542, "lr": 2.898740801934323e-05, "epoch": 2.0998439937597504, "percentage": 41.98, "elapsed_time": "4:53:32", "remaining_time": "6:45:46"}
	{"current_steps": 175, "total_steps": 405, "loss": 0.665, "lr": 2.820825610905514e-05, "epoch": 2.1622464898595943, "percentage": 43.21, "elapsed_time": "5:02:28", "remaining_time": "6:37:31"}
	{"current_steps": 180, "total_steps": 405, "loss": 0.658, "lr": 2.7413820780901358e-05, "epoch": 2.2246489859594383, "percentage": 44.44, "elapsed_time": "5:11:15", "remaining_time": "6:29:04"}
	{"current_steps": 185, "total_steps": 405, "loss": 0.6498, "lr": 2.6605581239103347e-05, "epoch": 2.287051482059282, "percentage": 45.68, "elapsed_time": "5:20:11", "remaining_time": "6:20:45"}
	{"current_steps": 190, "total_steps": 405, "loss": 0.6594, "lr": 2.5785042390731358e-05, "epoch": 2.3494539781591266, "percentage": 46.91, "elapsed_time": "5:28:59", "remaining_time": "6:12:16"}
	{"current_steps": 195, "total_steps": 405, "loss": 0.6655, "lr": 2.4953732043632523e-05, "epoch": 2.4118564742589705, "percentage": 48.15, "elapsed_time": "5:37:35", "remaining_time": "6:03:33"}
	{"current_steps": 200, "total_steps": 405, "loss": 0.6394, "lr": 2.4113198061718733e-05, "epoch": 2.4742589703588145, "percentage": 49.38, "elapsed_time": "5:46:15", "remaining_time": "5:54:55"}
	{"current_steps": 205, "total_steps": 405, "loss": 0.6544, "lr": 2.3265005482910992e-05, "epoch": 2.5366614664586584, "percentage": 50.62, "elapsed_time": "5:54:59", "remaining_time": "5:46:20"}
	{"current_steps": 210, "total_steps": 405, "loss": 0.6484, "lr": 2.2410733605106462e-05, "epoch": 2.5990639625585024, "percentage": 51.85, "elapsed_time": "6:03:24", "remaining_time": "5:37:27"}
	{"current_steps": 215, "total_steps": 405, "loss": 0.6627, "lr": 2.155197304559413e-05, "epoch": 2.6614664586583463, "percentage": 53.09, "elapsed_time": "6:12:20", "remaining_time": "5:29:02"}
	{"current_steps": 220, "total_steps": 405, "loss": 0.6471, "lr": 2.0690322779394166e-05, "epoch": 2.7238689547581902, "percentage": 54.32, "elapsed_time": "6:21:04", "remaining_time": "5:20:27"}
	{"current_steps": 225, "total_steps": 405, "loss": 0.6588, "lr": 1.9827387162035624e-05, "epoch": 2.786271450858034, "percentage": 55.56, "elapsed_time": "6:29:50", "remaining_time": "5:11:52"}
	{"current_steps": 230, "total_steps": 405, "loss": 0.6592, "lr": 1.896477294231581e-05, "epoch": 2.848673946957878, "percentage": 56.79, "elapsed_time": "6:38:36", "remaining_time": "5:03:17"}
	{"current_steps": 235, "total_steps": 405, "loss": 0.6541, "lr": 1.8104086270603557e-05, "epoch": 2.9110764430577225, "percentage": 58.02, "elapsed_time": "6:47:07", "remaining_time": "4:54:31"}
	{"current_steps": 240, "total_steps": 405, "loss": 0.6581, "lr": 1.724692970825664e-05, "epoch": 2.9734789391575664, "percentage": 59.26, "elapsed_time": "6:55:37", "remaining_time": "4:45:44"}
	{"current_steps": 245, "total_steps": 405, "loss": 0.5885, "lr": 1.6394899243721887e-05, "epoch": 3.0249609984399375, "percentage": 60.49, "elapsed_time": "7:02:50", "remaining_time": "4:36:08"}
	{"current_steps": 250, "total_steps": 405, "loss": 0.5173, "lr": 1.5549581320873715e-05, "epoch": 3.0873634945397814, "percentage": 61.73, "elapsed_time": "7:11:34", "remaining_time": "4:27:34"}
	{"current_steps": 255, "total_steps": 405, "loss": 0.5069, "lr": 1.4712549885124223e-05, "epoch": 3.149765990639626, "percentage": 62.96, "elapsed_time": "7:20:19", "remaining_time": "4:19:00"}
	{"current_steps": 260, "total_steps": 405, "loss": 0.5076, "lr": 1.3885363452804948e-05, "epoch": 3.2121684867394698, "percentage": 64.2, "elapsed_time": "7:28:58", "remaining_time": "4:10:23"}
	{"current_steps": 265, "total_steps": 405, "loss": 0.517, "lr": 1.30695622092768e-05, "epoch": 3.2745709828393137, "percentage": 65.43, "elapsed_time": "7:37:20", "remaining_time": "4:01:36"}
	{"current_steps": 270, "total_steps": 405, "loss": 0.5082, "lr": 1.2266665141171625e-05, "epoch": 3.3369734789391576, "percentage": 66.67, "elapsed_time": "7:46:17", "remaining_time": "3:53:08"}
	{"current_steps": 275, "total_steps": 405, "loss": 0.5002, "lr": 1.1478167208104702e-05, "epoch": 3.3993759750390016, "percentage": 67.9, "elapsed_time": "7:54:56", "remaining_time": "3:44:31"}
	{"current_steps": 280, "total_steps": 405, "loss": 0.5127, "lr": 1.070553655912463e-05, "epoch": 3.4617784711388455, "percentage": 69.14, "elapsed_time": "8:03:43", "remaining_time": "3:35:57"}
	{"current_steps": 285, "total_steps": 405, "loss": 0.5018, "lr": 9.950211799083342e-06, "epoch": 3.5241809672386895, "percentage": 70.37, "elapsed_time": "8:12:26", "remaining_time": "3:27:20"}
	{"current_steps": 290, "total_steps": 405, "loss": 0.4968, "lr": 9.213599310016019e-06, "epoch": 3.5865834633385334, "percentage": 71.6, "elapsed_time": "8:21:22", "remaining_time": "3:18:49"}
	{"current_steps": 295, "total_steps": 405, "loss": 0.5096, "lr": 8.497070632518611e-06, "epoch": 3.6489859594383773, "percentage": 72.84, "elapsed_time": "8:29:31", "remaining_time": "3:09:59"}
	{"current_steps": 300, "total_steps": 405, "loss": 0.5083, "lr": 7.801959911998542e-06, "epoch": 3.7113884555382217, "percentage": 74.07, "elapsed_time": "8:38:23", "remaining_time": "3:01:26"}
	{"current_steps": 305, "total_steps": 405, "loss": 0.5005, "lr": 7.129561414553705e-06, "epoch": 3.7737909516380657, "percentage": 75.31, "elapsed_time": "8:47:04", "remaining_time": "2:52:48"}
	{"current_steps": 310, "total_steps": 405, "loss": 0.4924, "lr": 6.481127117104913e-06, "epoch": 3.8361934477379096, "percentage": 76.54, "elapsed_time": "8:55:56", "remaining_time": "2:44:14"}
	{"current_steps": 315, "total_steps": 405, "loss": 0.5067, "lr": 5.857864376269051e-06, "epoch": 3.8985959438377535, "percentage": 77.78, "elapsed_time": "9:04:40", "remaining_time": "2:35:37"}
	{"current_steps": 320, "total_steps": 405, "loss": 0.5193, "lr": 5.260933680313267e-06, "epoch": 3.9609984399375975, "percentage": 79.01, "elapsed_time": "9:13:29", "remaining_time": "2:27:01"}
	{"current_steps": 325, "total_steps": 405, "loss": 0.4716, "lr": 4.691446488376012e-06, "epoch": 4.0124804992199685, "percentage": 80.25, "elapsed_time": "9:20:59", "remaining_time": "2:18:05"}
	{"current_steps": 330, "total_steps": 405, "loss": 0.4173, "lr": 4.150463160978196e-06, "epoch": 4.074882995319813, "percentage": 81.48, "elapsed_time": "9:29:59", "remaining_time": "2:09:32"}
	{"current_steps": 335, "total_steps": 405, "loss": 0.4122, "lr": 3.6389909856777437e-06, "epoch": 4.137285491419656, "percentage": 82.72, "elapsed_time": "9:38:46", "remaining_time": "2:00:56"}
	{"current_steps": 340, "total_steps": 405, "loss": 0.4154, "lr": 3.157982301543765e-06, "epoch": 4.199687987519501, "percentage": 83.95, "elapsed_time": "9:47:49", "remaining_time": "1:52:22"}
	{"current_steps": 345, "total_steps": 405, "loss": 0.4174, "lr": 2.708332725942353e-06, "epoch": 4.262090483619345, "percentage": 85.19, "elapsed_time": "9:56:22", "remaining_time": "1:43:43"}
	{"current_steps": 350, "total_steps": 405, "loss": 0.4179, "lr": 2.2908794869358044e-06, "epoch": 4.324492979719189, "percentage": 86.42, "elapsed_time": "10:04:59", "remaining_time": "1:35:04"}
	{"current_steps": 355, "total_steps": 405, "loss": 0.4204, "lr": 1.906399864400177e-06, "epoch": 4.386895475819033, "percentage": 87.65, "elapsed_time": "10:13:24", "remaining_time": "1:26:23"}
	{"current_steps": 360, "total_steps": 405, "loss": 0.4018, "lr": 1.555609742763795e-06, "epoch": 4.4492979719188765, "percentage": 88.89, "elapsed_time": "10:22:20", "remaining_time": "1:17:47"}
	{"current_steps": 365, "total_steps": 405, "loss": 0.4075, "lr": 1.2391622780613632e-06, "epoch": 4.511700468018721, "percentage": 90.12, "elapsed_time": "10:30:50", "remaining_time": "1:09:07"}
	{"current_steps": 370, "total_steps": 405, "loss": 0.4212, "lr": 9.576466817857177e-07, "epoch": 4.574102964118564, "percentage": 91.36, "elapsed_time": "10:39:30", "remaining_time": "1:00:29"}
	{"current_steps": 375, "total_steps": 405, "loss": 0.4248, "lr": 7.115871238014982e-07, "epoch": 4.636505460218409, "percentage": 92.59, "elapsed_time": "10:48:03", "remaining_time": "0:51:50"}
	{"current_steps": 380, "total_steps": 405, "loss": 0.41, "lr": 5.014417563635276e-07, "epoch": 4.698907956318253, "percentage": 93.83, "elapsed_time": "10:56:42", "remaining_time": "0:43:12"}
	{"current_steps": 385, "total_steps": 405, "loss": 0.4149, "lr": 3.2760186105712964e-07, "epoch": 4.761310452418097, "percentage": 95.06, "elapsed_time": "11:05:24", "remaining_time": "0:34:33"}
	{"current_steps": 390, "total_steps": 405, "loss": 0.4036, "lr": 1.903911202487363e-07, "epoch": 4.823712948517941, "percentage": 96.3, "elapsed_time": "11:14:16", "remaining_time": "0:25:56"}
	{"current_steps": 395, "total_steps": 405, "loss": 0.4127, "lr": 9.006501440333548e-08, "epoch": 4.886115444617785, "percentage": 97.53, "elapsed_time": "11:23:01", "remaining_time": "0:17:17"}
	{"current_steps": 400, "total_steps": 405, "loss": 0.4156, "lr": 2.681034639087754e-08, "epoch": 4.948517940717629, "percentage": 98.77, "elapsed_time": "11:31:36", "remaining_time": "0:08:38"}
	{"current_steps": 405, "total_steps": 405, "loss": 0.4218, "lr": 7.448936674170349e-10, "epoch": 5.0, "percentage": 100.0, "elapsed_time": "11:39:09", "remaining_time": "0:00:00"}
	{"current_steps": 405, "total_steps": 405, "epoch": 5.0, "percentage": 100.0, "elapsed_time": "11:39:09", "remaining_time": "0:00:00"}