Instructions to use thanaphatt1/qwen3.5-9b-muspsy-fixed with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use thanaphatt1/qwen3.5-9b-muspsy-fixed with PEFT:

from peft import PeftModel
from transformers import AutoModelForCausalLM

base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3.5-9B")
model = PeftModel.from_pretrained(base_model, "thanaphatt1/qwen3.5-9b-muspsy-fixed")

Transformers

How to use thanaphatt1/qwen3.5-9b-muspsy-fixed with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="thanaphatt1/qwen3.5-9b-muspsy-fixed")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("thanaphatt1/qwen3.5-9b-muspsy-fixed", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use thanaphatt1/qwen3.5-9b-muspsy-fixed with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "thanaphatt1/qwen3.5-9b-muspsy-fixed"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "thanaphatt1/qwen3.5-9b-muspsy-fixed",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/thanaphatt1/qwen3.5-9b-muspsy-fixed

SGLang

How to use thanaphatt1/qwen3.5-9b-muspsy-fixed with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "thanaphatt1/qwen3.5-9b-muspsy-fixed" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "thanaphatt1/qwen3.5-9b-muspsy-fixed",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "thanaphatt1/qwen3.5-9b-muspsy-fixed" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "thanaphatt1/qwen3.5-9b-muspsy-fixed",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use thanaphatt1/qwen3.5-9b-muspsy-fixed with Docker Model Runner:
```
docker model run hf.co/thanaphatt1/qwen3.5-9b-muspsy-fixed
```

thanaphatt1 commited on 4 days ago

Commit

3e8193d

verified ·

1 Parent(s): fb43c75

Training in progress, step 1000

Browse files

Files changed (3) hide show

adapter_model.safetensors +1 -1
tokenizer_config.json +1 -0
trainer_log.jsonl +51 -0

adapter_model.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:440a1430788405f5fb805f3cb2eebb054f16932f1f4b8d16ac2f9b9d14026042
 size 346302176

 version https://git-lfs.github.com/spec/v1
+oid sha256:5f1f055ed1be3266d91b245b81954619969aa1a5690552d4accb157c32632f68
 size 346302176

tokenizer_config.json CHANGED Viewed

@@ -24,6 +24,7 @@
   "pad_token": "<|endoftext|>",
   "padding_side": "right",
   "pretokenize_regex": "(?i:'s|'t|'re|'ve|'m|'ll|'d)|[^\\r\\n\\p{L}\\p{N}]?[\\p{L}\\p{M}]+|\\p{N}| ?[^\\s\\p{L}\\p{M}\\p{N}]+[\\r\\n]*|\\s*[\\r\\n]+|\\s+(?!\\S)|\\s+",
   "split_special_tokens": false,
   "tokenizer_class": "Qwen2Tokenizer",
   "unk_token": null,

   "pad_token": "<|endoftext|>",
   "padding_side": "right",
   "pretokenize_regex": "(?i:'s|'t|'re|'ve|'m|'ll|'d)|[^\\r\\n\\p{L}\\p{N}]?[\\p{L}\\p{M}]+|\\p{N}| ?[^\\s\\p{L}\\p{M}\\p{N}]+[\\r\\n]*|\\s*[\\r\\n]+|\\s+(?!\\S)|\\s+",
+  "processor_class": "Qwen3VLProcessor",
   "split_special_tokens": false,
   "tokenizer_class": "Qwen2Tokenizer",
   "unk_token": null,

trainer_log.jsonl CHANGED Viewed

@@ -49,3 +49,54 @@
 {"current_steps": 490, "total_steps": 3831, "loss": 1.3550784111022949, "lr": 0.0001995424544662805, "epoch": 0.38380574729524647, "percentage": 12.79, "elapsed_time": "3:01:17", "remaining_time": "20:36:04"}
 {"current_steps": 500, "total_steps": 3831, "loss": 1.3583318710327148, "lr": 0.0001994512364523196, "epoch": 0.3916385176482107, "percentage": 13.05, "elapsed_time": "3:05:00", "remaining_time": "20:32:34"}
 {"current_steps": 500, "total_steps": 3831, "eval_loss": 1.338908314704895, "epoch": 0.3916385176482107, "percentage": 13.05, "elapsed_time": "3:10:23", "remaining_time": "21:08:24"}

 {"current_steps": 490, "total_steps": 3831, "loss": 1.3550784111022949, "lr": 0.0001995424544662805, "epoch": 0.38380574729524647, "percentage": 12.79, "elapsed_time": "3:01:17", "remaining_time": "20:36:04"}
 {"current_steps": 500, "total_steps": 3831, "loss": 1.3583318710327148, "lr": 0.0001994512364523196, "epoch": 0.3916385176482107, "percentage": 13.05, "elapsed_time": "3:05:00", "remaining_time": "20:32:34"}
 {"current_steps": 500, "total_steps": 3831, "eval_loss": 1.338908314704895, "epoch": 0.3916385176482107, "percentage": 13.05, "elapsed_time": "3:10:23", "remaining_time": "21:08:24"}
+{"current_steps": 510, "total_steps": 3831, "loss": 1.3324827194213866, "lr": 0.0001993517575955301, "epoch": 0.39947128800117493, "percentage": 13.31, "elapsed_time": "3:14:15", "remaining_time": "21:04:56"}
+{"current_steps": 520, "total_steps": 3831, "loss": 1.3564526557922363, "lr": 0.0001992440261590491, "epoch": 0.40730405835413913, "percentage": 13.57, "elapsed_time": "3:18:01", "remaining_time": "21:00:52"}
+{"current_steps": 530, "total_steps": 3831, "loss": 1.3334980964660645, "lr": 0.00019912805109150808, "epoch": 0.41513682870710333, "percentage": 13.83, "elapsed_time": "3:21:39", "remaining_time": "20:55:58"}
+{"current_steps": 540, "total_steps": 3831, "loss": 1.31835880279541, "lr": 0.00019900384202628955, "epoch": 0.42296959906006754, "percentage": 14.1, "elapsed_time": "3:25:17", "remaining_time": "20:51:10"}
+{"current_steps": 550, "total_steps": 3831, "loss": 1.336206817626953, "lr": 0.00019887140928072695, "epoch": 0.4308023694130318, "percentage": 14.36, "elapsed_time": "3:29:00", "remaining_time": "20:46:50"}
+{"current_steps": 560, "total_steps": 3831, "loss": 1.3192202568054199, "lr": 0.00019873076385524754, "epoch": 0.438635139765996, "percentage": 14.62, "elapsed_time": "3:32:43", "remaining_time": "20:42:32"}
+{"current_steps": 570, "total_steps": 3831, "loss": 1.3167536735534668, "lr": 0.00019858191743245883, "epoch": 0.4464679101189602, "percentage": 14.88, "elapsed_time": "3:36:23", "remaining_time": "20:37:59"}
+{"current_steps": 580, "total_steps": 3831, "loss": 1.356813621520996, "lr": 0.00019842488237617793, "epoch": 0.4543006804719244, "percentage": 15.14, "elapsed_time": "3:40:03", "remaining_time": "20:33:25"}
+{"current_steps": 590, "total_steps": 3831, "loss": 1.325494384765625, "lr": 0.00019825967173040478, "epoch": 0.4621334508248886, "percentage": 15.4, "elapsed_time": "3:43:48", "remaining_time": "20:29:25"}
+{"current_steps": 600, "total_steps": 3831, "loss": 1.3333147048950196, "lr": 0.0001980862992182385, "epoch": 0.46996622117785286, "percentage": 15.66, "elapsed_time": "3:47:34", "remaining_time": "20:25:27"}
+{"current_steps": 610, "total_steps": 3831, "loss": 1.3124448776245117, "lr": 0.00019790477924073755, "epoch": 0.47779899153081706, "percentage": 15.92, "elapsed_time": "3:51:22", "remaining_time": "20:21:43"}
+{"current_steps": 620, "total_steps": 3831, "loss": 1.3134421348571776, "lr": 0.00019771512687572366, "epoch": 0.48563176188378127, "percentage": 16.18, "elapsed_time": "3:55:06", "remaining_time": "20:17:36"}
+{"current_steps": 630, "total_steps": 3831, "loss": 1.3247313499450684, "lr": 0.00019751735787652908, "epoch": 0.49346453223674547, "percentage": 16.44, "elapsed_time": "3:58:49", "remaining_time": "20:13:25"}
+{"current_steps": 640, "total_steps": 3831, "loss": 1.3370563507080078, "lr": 0.0001973114886706884, "epoch": 0.5012973025897097, "percentage": 16.71, "elapsed_time": "4:02:25", "remaining_time": "20:08:42"}
+{"current_steps": 650, "total_steps": 3831, "loss": 1.3317548751831054, "lr": 0.00019709753635857368, "epoch": 0.5091300729426739, "percentage": 16.97, "elapsed_time": "4:06:11", "remaining_time": "20:04:47"}
+{"current_steps": 660, "total_steps": 3831, "loss": 1.3153909683227538, "lr": 0.00019687551871197428, "epoch": 0.5169628432956381, "percentage": 17.23, "elapsed_time": "4:10:05", "remaining_time": "20:01:34"}
+{"current_steps": 670, "total_steps": 3831, "loss": 1.3147119522094726, "lr": 0.00019664545417262056, "epoch": 0.5247956136486024, "percentage": 17.49, "elapsed_time": "4:13:53", "remaining_time": "19:57:52"}
+{"current_steps": 680, "total_steps": 3831, "loss": 1.3157793998718261, "lr": 0.00019640736185065193, "epoch": 0.5326283840015665, "percentage": 17.75, "elapsed_time": "4:17:35", "remaining_time": "19:53:39"}
+{"current_steps": 690, "total_steps": 3831, "loss": 1.3172315597534179, "lr": 0.00019616126152302975, "epoch": 0.5404611543545308, "percentage": 18.01, "elapsed_time": "4:21:18", "remaining_time": "19:49:32"}
+{"current_steps": 700, "total_steps": 3831, "loss": 1.3153032302856444, "lr": 0.0001959071736318942, "epoch": 0.5482939247074949, "percentage": 18.27, "elapsed_time": "4:24:58", "remaining_time": "19:45:11"}
+{"current_steps": 710, "total_steps": 3831, "loss": 1.29284610748291, "lr": 0.00019564511928286664, "epoch": 0.5561266950604592, "percentage": 18.53, "elapsed_time": "4:28:39", "remaining_time": "19:40:59"}
+{"current_steps": 720, "total_steps": 3831, "loss": 1.3206818580627442, "lr": 0.00019537512024329621, "epoch": 0.5639594654134235, "percentage": 18.79, "elapsed_time": "4:32:29", "remaining_time": "19:37:22"}
+{"current_steps": 730, "total_steps": 3831, "loss": 1.3023270606994628, "lr": 0.00019509719894045193, "epoch": 0.5717922357663876, "percentage": 19.06, "elapsed_time": "4:36:10", "remaining_time": "19:33:12"}
+{"current_steps": 740, "total_steps": 3831, "loss": 1.3201650619506835, "lr": 0.0001948113784596596, "epoch": 0.5796250061193519, "percentage": 19.32, "elapsed_time": "4:39:52", "remaining_time": "19:29:02"}
+{"current_steps": 750, "total_steps": 3831, "loss": 1.290597915649414, "lr": 0.00019451768254238446, "epoch": 0.587457776472316, "percentage": 19.58, "elapsed_time": "4:43:33", "remaining_time": "19:24:53"}
+{"current_steps": 760, "total_steps": 3831, "loss": 1.332386589050293, "lr": 0.00019421613558425892, "epoch": 0.5952905468252803, "percentage": 19.84, "elapsed_time": "4:47:11", "remaining_time": "19:20:30"}
+{"current_steps": 770, "total_steps": 3831, "loss": 1.322896671295166, "lr": 0.00019390676263305635, "epoch": 0.6031233171782445, "percentage": 20.1, "elapsed_time": "4:50:57", "remaining_time": "19:16:37"}
+{"current_steps": 780, "total_steps": 3831, "loss": 1.3295950889587402, "lr": 0.00019358958938661035, "epoch": 0.6109560875312087, "percentage": 20.36, "elapsed_time": "4:54:40", "remaining_time": "19:12:36"}
+{"current_steps": 790, "total_steps": 3831, "loss": 1.3002716064453126, "lr": 0.0001932646421906802, "epoch": 0.6187888578841729, "percentage": 20.62, "elapsed_time": "4:58:22", "remaining_time": "19:08:34"}
+{"current_steps": 800, "total_steps": 3831, "loss": 1.3059702873229981, "lr": 0.00019293194803676254, "epoch": 0.6266216282371371, "percentage": 20.88, "elapsed_time": "5:02:07", "remaining_time": "19:04:40"}
+{"current_steps": 810, "total_steps": 3831, "loss": 1.3296985626220703, "lr": 0.00019259153455984925, "epoch": 0.6344543985901013, "percentage": 21.14, "elapsed_time": "5:05:52", "remaining_time": "19:00:49"}
+{"current_steps": 820, "total_steps": 3831, "loss": 1.3305760383605958, "lr": 0.00019224343003613212, "epoch": 0.6422871689430656, "percentage": 21.4, "elapsed_time": "5:09:33", "remaining_time": "18:56:42"}
+{"current_steps": 830, "total_steps": 3831, "loss": 1.325657844543457, "lr": 0.0001918876633806539, "epoch": 0.6501199392960297, "percentage": 21.67, "elapsed_time": "5:13:15", "remaining_time": "18:52:38"}
+{"current_steps": 840, "total_steps": 3831, "loss": 1.3022818565368652, "lr": 0.00019152426414490665, "epoch": 0.657952709648994, "percentage": 21.93, "elapsed_time": "5:17:04", "remaining_time": "18:49:00"}
+{"current_steps": 850, "total_steps": 3831, "loss": 1.3478684425354004, "lr": 0.00019115326251437708, "epoch": 0.6657854800019581, "percentage": 22.19, "elapsed_time": "5:20:49", "remaining_time": "18:45:09"}
+{"current_steps": 860, "total_steps": 3831, "loss": 1.3089423179626465, "lr": 0.00019077468930603903, "epoch": 0.6736182503549224, "percentage": 22.45, "elapsed_time": "5:24:31", "remaining_time": "18:41:07"}
+{"current_steps": 870, "total_steps": 3831, "loss": 1.2900199890136719, "lr": 0.0001903885759657939, "epoch": 0.6814510207078867, "percentage": 22.71, "elapsed_time": "5:28:18", "remaining_time": "18:37:21"}
+{"current_steps": 880, "total_steps": 3831, "loss": 1.3203692436218262, "lr": 0.00018999495456585854, "epoch": 0.6892837910608508, "percentage": 22.97, "elapsed_time": "5:31:58", "remaining_time": "18:33:14"}
+{"current_steps": 890, "total_steps": 3831, "loss": 1.3258060455322265, "lr": 0.00018959385780210108, "epoch": 0.6971165614138151, "percentage": 23.23, "elapsed_time": "5:35:40", "remaining_time": "18:29:15"}
+{"current_steps": 900, "total_steps": 3831, "loss": 1.3001131057739257, "lr": 0.00018918531899132527, "epoch": 0.7049493317667792, "percentage": 23.49, "elapsed_time": "5:39:26", "remaining_time": "18:25:27"}
+{"current_steps": 910, "total_steps": 3831, "loss": 1.318901824951172, "lr": 0.00018876937206850294, "epoch": 0.7127821021197435, "percentage": 23.75, "elapsed_time": "5:43:07", "remaining_time": "18:21:22"}
+{"current_steps": 920, "total_steps": 3831, "loss": 1.2912470817565918, "lr": 0.00018834605158395514, "epoch": 0.7206148724727077, "percentage": 24.01, "elapsed_time": "5:46:52", "remaining_time": "18:17:34"}
+{"current_steps": 930, "total_steps": 3831, "loss": 1.3023160934448241, "lr": 0.00018791539270048252, "epoch": 0.7284476428256719, "percentage": 24.28, "elapsed_time": "5:50:45", "remaining_time": "18:14:07"}
+{"current_steps": 940, "total_steps": 3831, "loss": 1.2719347953796387, "lr": 0.00018747743119044405, "epoch": 0.7362804131786361, "percentage": 24.54, "elapsed_time": "5:54:22", "remaining_time": "18:09:53"}
+{"current_steps": 950, "total_steps": 3831, "loss": 1.3201501846313477, "lr": 0.00018703220343278628, "epoch": 0.7441131835316004, "percentage": 24.8, "elapsed_time": "5:58:04", "remaining_time": "18:05:55"}
+{"current_steps": 960, "total_steps": 3831, "loss": 1.2843191146850585, "lr": 0.00018657974641002095, "epoch": 0.7519459538845645, "percentage": 25.06, "elapsed_time": "6:01:44", "remaining_time": "18:01:49"}
+{"current_steps": 970, "total_steps": 3831, "loss": 1.2866954803466797, "lr": 0.0001861200977051535, "epoch": 0.7597787242375288, "percentage": 25.32, "elapsed_time": "6:05:24", "remaining_time": "17:57:44"}
+{"current_steps": 980, "total_steps": 3831, "loss": 1.3130477905273437, "lr": 0.0001856532954985609, "epoch": 0.7676114945904929, "percentage": 25.58, "elapsed_time": "6:09:08", "remaining_time": "17:53:52"}
+{"current_steps": 990, "total_steps": 3831, "loss": 1.3176883697509765, "lr": 0.00018517937856482055, "epoch": 0.7754442649434572, "percentage": 25.84, "elapsed_time": "6:12:48", "remaining_time": "17:49:51"}
+{"current_steps": 1000, "total_steps": 3831, "loss": 1.2918599128723145, "lr": 0.00018469838626948928, "epoch": 0.7832770352964215, "percentage": 26.1, "elapsed_time": "6:16:29", "remaining_time": "17:45:50"}
+{"current_steps": 1000, "total_steps": 3831, "eval_loss": 1.3027687072753906, "epoch": 0.7832770352964215, "percentage": 26.1, "elapsed_time": "6:22:00", "remaining_time": "18:01:27"}