Instructions to use nvidia/NVIDIA-Nemotron-Labs-Teacher-General-Reasoning with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use nvidia/NVIDIA-Nemotron-Labs-Teacher-General-Reasoning with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="nvidia/NVIDIA-Nemotron-Labs-Teacher-General-Reasoning", trust_remote_code=True)
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("nvidia/NVIDIA-Nemotron-Labs-Teacher-General-Reasoning", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("nvidia/NVIDIA-Nemotron-Labs-Teacher-General-Reasoning", trust_remote_code=True, device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use nvidia/NVIDIA-Nemotron-Labs-Teacher-General-Reasoning with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "nvidia/NVIDIA-Nemotron-Labs-Teacher-General-Reasoning"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "nvidia/NVIDIA-Nemotron-Labs-Teacher-General-Reasoning",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/nvidia/NVIDIA-Nemotron-Labs-Teacher-General-Reasoning

SGLang

How to use nvidia/NVIDIA-Nemotron-Labs-Teacher-General-Reasoning with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "nvidia/NVIDIA-Nemotron-Labs-Teacher-General-Reasoning" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "nvidia/NVIDIA-Nemotron-Labs-Teacher-General-Reasoning",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "nvidia/NVIDIA-Nemotron-Labs-Teacher-General-Reasoning" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "nvidia/NVIDIA-Nemotron-Labs-Teacher-General-Reasoning",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use nvidia/NVIDIA-Nemotron-Labs-Teacher-General-Reasoning with Docker Model Runner:
```
docker model run hf.co/nvidia/NVIDIA-Nemotron-Labs-Teacher-General-Reasoning
```

dmax123 commited on 8 days ago

Commit

b623d88

verified ·

1 Parent(s): aada8e1

Add files using upload-large-folder tool

Browse files

This view is limited to 50 files because it contains too many changes. See raw diff

Files changed (50) hide show

.gitattributes +1 -0
model-00001-of-00225.safetensors +3 -0
model-00002-of-00225.safetensors +3 -0
model-00004-of-00225.safetensors +3 -0
model-00006-of-00225.safetensors +3 -0
model-00007-of-00225.safetensors +3 -0
model-00008-of-00225.safetensors +3 -0
model-00009-of-00225.safetensors +3 -0
model-00010-of-00225.safetensors +3 -0
model-00013-of-00225.safetensors +3 -0
model-00016-of-00225.safetensors +3 -0
model-00017-of-00225.safetensors +3 -0
model-00022-of-00225.safetensors +3 -0
model-00023-of-00225.safetensors +3 -0
model-00024-of-00225.safetensors +3 -0
model-00028-of-00225.safetensors +3 -0
model-00035-of-00225.safetensors +3 -0
model-00036-of-00225.safetensors +3 -0
model-00037-of-00225.safetensors +3 -0
model-00038-of-00225.safetensors +3 -0
model-00041-of-00225.safetensors +3 -0
model-00042-of-00225.safetensors +3 -0
model-00048-of-00225.safetensors +3 -0
model-00050-of-00225.safetensors +3 -0
model-00051-of-00225.safetensors +3 -0
model-00056-of-00225.safetensors +3 -0
model-00057-of-00225.safetensors +3 -0
model-00059-of-00225.safetensors +3 -0
model-00060-of-00225.safetensors +3 -0
model-00061-of-00225.safetensors +3 -0
model-00064-of-00225.safetensors +3 -0
model-00065-of-00225.safetensors +3 -0
model-00067-of-00225.safetensors +3 -0
model-00072-of-00225.safetensors +3 -0
model-00075-of-00225.safetensors +3 -0
model-00077-of-00225.safetensors +3 -0
model-00080-of-00225.safetensors +3 -0
model-00082-of-00225.safetensors +3 -0
model-00084-of-00225.safetensors +3 -0
model-00091-of-00225.safetensors +3 -0
model-00092-of-00225.safetensors +3 -0
model-00094-of-00225.safetensors +3 -0
model-00097-of-00225.safetensors +3 -0
model-00098-of-00225.safetensors +3 -0
model-00105-of-00225.safetensors +3 -0
model-00107-of-00225.safetensors +3 -0
model-00110-of-00225.safetensors +3 -0
model-00111-of-00225.safetensors +3 -0
model-00113-of-00225.safetensors +3 -0
model-00114-of-00225.safetensors +3 -0

.gitattributes CHANGED Viewed

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text

 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

model-00001-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7ed40bee09ffcad7a9c53201ab2b8bc9d5a3b2c40a070e5500224554c6b6fa11
+size 4983097968

model-00002-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:24e87acfb297092e9755adde7a894e99b0e9460f7cc6db61efd6902c1062b0d4
+size 4991252496

model-00004-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2a0288430a8ad549a6635e7a026a7bb210d9bf2dc651f91277170827deedf8c2
+size 4991252600

model-00006-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9244ff595ef5eddc261f6f8fd2f7f379d4187065374a083fc175bc16d85617de
+size 4995491168

model-00007-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e1b7b07276e8c61cd59915b11a232101a36bc1e63a1652261b0b0b4b3ba96746
+size 4991252600

model-00008-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:06304dd848f6c3a500656514c988138477946fb80f5f4bb3c5d8498e4772676c
+size 4991252600

model-00009-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1751c6438314b98735629ce1078965ef19a4c2f38f63653a4d592e0ea8bb8351
+size 4991252600

model-00010-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:632881300aa737c60aae927d2e62c364279ae0d7f75704462d2fbceb96021658
+size 4987305680

model-00013-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:30a9fe1af688ec053edd619248fdf525a993739da8ffb321540f34b0f5558a1f
+size 4991252600

model-00016-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:19aa69f60f919d26188157a9d3acb4448fe1029de7b515b1befb76fea0a15122
+size 4991252560

model-00017-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:aaf240fcd395261a59a23b580ba595da8d3b811e213b1f549ea37d148e87d893
+size 4991252600

model-00022-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:90f5ab02aa98744c0dc1badf09e472847e87c4c59c26440fa13d11f47b00ef4d
+size 4991252840

model-00023-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f4414ed85da8b16e708c4ca10fd17cad237c70bab42ecff242dd15b5341ca3e6
+size 4991252840

model-00024-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fe1f2c2555aa30392f288bc697126573539719888f9303667a6b19a91f504adb
+size 4987305808

model-00028-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:684eec143410d565e26155b83d61e2f87ada478adcd7e815bbce401ea4c4882f
+size 4966334304

model-00035-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f26bdf7b1d2a42b2bd56269de1f2548b380248293d4a2a456291fc32a5b0e19f
+size 4991252840

model-00036-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:66ac71803f7ffa747c0787b9343e1b6045c276e01487ede2bd18716de81f8a27
+size 4991252840

model-00037-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e2a33b910178b6b912e628bc9219c1495a3fcbce9c130249c7fb1bd1e2bbad88
+size 4962095640

model-00038-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:32a95e76c9c075f888fd8c256942f2a3b720ad66668fb7b689ca87e8cce1da60
+size 4995491376

model-00041-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:95a0ac055fe51138025a930e6fc1f9bb55b7d4180c1f644eec92831c42814a95
+size 4991252840

model-00042-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9e4881b8a8c362e867a2dd2bae1772dcc00e90fa272c80ed6bada1c252c726a2
+size 4987305872

model-00048-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a53edbf3da793d0f4e3ed29709f29391a3087fe036324ffe96977596c0cb8ffa
+size 4991252800

model-00050-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c9681ffe12a2fdafe2c7d37f44db14bb5b3dd90e0ff67515d9fb9cd11fbeba0e
+size 4991252840

model-00051-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:583f0b92852b568123fd8615c5d6f7449440f53c38e6a6944e5072c954002f2d
+size 4987305912

model-00056-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:33e57cb3d6b25fdf5a1f689088d2a8c230bec46813946c3ab760776260e03629
+size 4987305808

model-00057-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:79fb4113fbd0fa7e7b2c1e36dcbdb129e9a3ab94b9e0e5729040d2806671d210
+size 4991252776

model-00059-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6756602a4dcdd68cceb974caafa6672c3aac69fcfa77a488ee02e2578f74921c
+size 4991252840

model-00060-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:88316b35d072925df8113de26a4ad9d490e22fa7cc29cd8a81991b47ac90df8a
+size 4987305952

model-00061-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f8b11cb13e9ebed06dce4918379edf640ff82ad2a592284e90eaaf47e210a9d6
+size 4991252624

model-00064-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6f7878773333fd94aa2efb24ce329e810041c0795cfe00e442538acdcee31c0a
+size 4991252840

model-00065-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1c1dcacedf40633b3f9ec7eb8c26c011f2863c4d7121eccbe2a9321e4651da72
+size 4991515400

model-00067-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3981d96cf214d0ef8e2a2724b0f6884720b82c25753df0e26032765f480b2a38
+size 4991252840

model-00072-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7e7fb21e6c181607776d95f7cd642bae09bd6cb62c1b1a714b0e6be9ce619cf2
+size 4991252840

model-00075-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:812f0f3eb8fcb25b90a69f174efd660d911bd7c46f5a7d9cc26d4d10d266a3bc
+size 4991252704

model-00077-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5d125d8d51519034b3c6f654caf9b0ea02d062d07f510f88eee9def0582ef810
+size 4991252840

model-00080-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:acee48ba5048706c673be237bfa1eee4c1b2c8daed34090383f98b43c47e656e
+size 4991252800

model-00082-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9792f07d67b56596131ddb8589a64fc1296b7944cfe60315e5ac75cad2a6a2b4
+size 4991252840

model-00084-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4b08e191e4406df749990de0eb91f290249888b6f6fca57f61d3619a6d92f5f2
+size 4991252664

model-00091-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7b23e97af801b1359e59613be19af38b5f0e2b28d2849cf592b1bde0ab6b8519
+size 4991252840

model-00092-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2173c5de06753f410c59136981d9621199d44fa59f4fc3d0fbbab075744fe4af
+size 4987305952

model-00094-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0f1b2b882412f1a64031ebb3acc14c58c41e10bf1e9b0e9307479a3a3f3f39ca
+size 4991252840

model-00097-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d16cf62b81d488b86383f89f2fb08b402d14c34df1576bc75d2a6e3f7ab3e238
+size 4991515400

model-00098-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7b7b14bab63f3bbb7e254024c82074394aa464af69cc9f1e885a620feec6b14e
+size 4991252736

model-00105-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:74a21b1ce27a960b5834b4bc2e3f4b11c1c0f23701ed108f92446d8445ac895d
+size 4991252840

model-00107-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2dfff33d92a5d92fb3ad8db03b8db6766ea8d683b1060f2d579179dc73f9adcf
+size 4991252704

model-00110-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:11acae238f5f65e6abacd0359032c4f407248b46e00b26e92b2f3a83d40ab0f7
+size 4991252840

model-00111-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b4699eb84d22d52574f6055478c351ccc22bb5b908777f770bb694ffe7bf8b7a
+size 4987305824

model-00113-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b59a5445c600ce899153f5e8134261c9ef2ca3245e2e6981995f5615375c4ffe
+size 4991252840

model-00114-of-00225.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3135a24e35adab3dc35d5a52abb203e1e4d6a1a48cad617da269ce591c467751
+size 4991252840