Instructions to use mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF with Transformers:

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF", device_map="auto")

llama-cpp-python

How to use mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF with llama-cpp-python:

# !pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
	repo_id="mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF",
	filename="Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ1_M.gguf",
)

llm.create_chat_completion(
	messages = "No input example has been defined for this model task."
)

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF:Q4_K_M

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF:Q4_K_M
# Run inference directly in the terminal:
./llama-cli -hf mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF:Q4_K_M

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama-cli -hf mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF:Q4_K_M

Use Docker

docker model run hf.co/mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF:Q4_K_M

LM Studio
Jan
Ollama
How to use mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF with Ollama:
```
ollama run hf.co/mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF:Q4_K_M
```

Unsloth Studio

How to use mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF to start chatting

Atomic Chat new
Docker Model Runner
How to use mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF with Docker Model Runner:
```
docker model run hf.co/mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF:Q4_K_M
```

Lemonade

How to use mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull mradermacher/Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF:Q4_K_M

Run and chat with the model

lemonade run user.Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE-i1-GGUF-Q4_K_M

List all available models

lemonade list

mradermacher commited on Nov 11, 2025

Commit

dcd18bc

verified ·

1 Parent(s): 94278f7

uploaded from rain

Browse files

Files changed (25) hide show

.gitattributes +24 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ1_M.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ1_S.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ2_M.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ2_S.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ2_XS.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ2_XXS.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ3_M.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ3_S.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ3_XS.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ3_XXS.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ4_NL.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ4_XS.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q2_K.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q2_K_S.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q3_K_L.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q3_K_M.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q3_K_S.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q4_0.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q4_1.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q4_K_M.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q4_K_S.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q5_K_M.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q5_K_S.gguf +3 -0
Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q6_K.gguf +3 -0

.gitattributes CHANGED Viewed

@@ -34,3 +34,27 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
 Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.imatrix.gguf filter=lfs diff=lfs merge=lfs -text

 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
 Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ1_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c42c90f8238a8774cd9054940cce405e69e468850bbcb15501042eaf0ef20196
+size 541037760

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ1_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:432993305c838c140158da44adf4ffdc806ebc518f0e1ccbf5181e2e26201c34
+size 513104064

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ2_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:abf74c3067c0ec0bc7df126197d39046e48060bb267143ba3b6de928d7f8a4e0
+size 701333184

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ2_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8483cce3d5741f69445fa97904ba83d074f614dc5d1a07752a020714cca5e738
+size 664088256

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ2_XS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8dff5d4ac7a223ca0093a6f0bf28fa640789f92df265a8bd09cff1630c0fd5fa
+size 626903232

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ2_XXS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:99afb5497ce9334e9d8a14a9ffb7992600e0032d1f2d47941047575aee4889cf
+size 587593920

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ3_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c284ec3c44dc67c8253d956cdd9e26805e5952b209fc620549f0461d4d20e6c2
+size 876942528

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ3_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2063c76479ba27e91d0ba22e504c35424257f93617631062a4397c11d721068f
+size 862685376

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ3_XS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2c5b9b15de9aa82f8a20eeca27df4d91a953346fa6ca4780c4829f1e3d7485b6
+size 831977664

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ3_XXS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1eaee82ec200676da4247a11138a185ac828fbd96e2d1d1a22765b29198a7cb3
+size 769070784

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ4_NL.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5cfa72523c8e4b7b7725085dd6e7670486aecd9a499cfc7f75a8defc73667d52
+size 1067604672

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-IQ4_XS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f53dd8909edc9420ed0f11f5eff3507c3d644b759cd84b015d9cfe3bbe97e1aa
+size 1019712192

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q2_K.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:94c80039ef2c3020ac6e3f37478d334472b4f77fc8c133133a37bf02ce4511b4
+size 752881344

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q2_K_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:34377e9f725e268409573e153f59a495b650e7ff6ce690d2bf56bbc6bf7e8f36
+size 716711616

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q3_K_L.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f8d78d26f6c432f29e7f51b60830d2ecff3858ad627223ac1e6027850e1308a2
+size 980441280

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q3_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:14317e850d214d41baee02bb42affdbd2cb064345347ff1cf9b397d9079fa39b
+size 924457152

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q3_K_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8135ec717eaa77c3911342bef7383be2cac38e5d72356a4a45cc3e3c0eef9a02
+size 861223104

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q4_0.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:99d5e2b462faa3b5df24ecc099efa9dfc2bac4d72dc6be857a0921b86802b41b
+size 1068808896

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q4_1.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fe1917e166340f90c0fcf0603cd6cd51777d20e5190027a8865998387b54c557
+size 1162701504

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q4_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:68207f523782be34d9f21ab0d9e6a6050b2bb52c37722906c545efeba814d518
+size 1117321920

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q4_K_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c70141ccae2a29206be48c0e1eb0435fc4e175b691dce63acb98a96ff050ed1c
+size 1071585984

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q5_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:76b5f7c5bf2c1448164cf5636c4014cba1d21e6013b08efdf88c7d7c47417b6d
+size 1285495488

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q5_K_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a05c2953367b3178799ee83feeeaba1fb36f802f5fe482f2942f5d6aee98dc2b
+size 1259174592

Nemotron-Research-Reasoning-Qwen-1.5B-v2-RLVE.i1-Q6_K.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fe266e31449af771049bc6401389feeac5f43e5787c4d712285cbc67b071fce8
+size 1464179904