Instructions to use kernelpool/GLM-5.1-6bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use kernelpool/GLM-5.1-6bit with MLX:

# Make sure mlx-lm is installed
# pip install --upgrade mlx-lm

# Generate text with mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("kernelpool/GLM-5.1-6bit")

prompt = "Write a story about Einstein"
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
    messages, add_generation_prompt=True
)

text = generate(model, tokenizer, prompt=prompt, verbose=True)

Notebooks
Google Colab
Kaggle
Local Apps Settings
LM Studio

How to use kernelpool/GLM-5.1-6bit with Pi:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "kernelpool/GLM-5.1-6bit"

Configure the model in Pi

# Install Pi:
npm install -g @mariozechner/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "mlx-lm": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "kernelpool/GLM-5.1-6bit"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Hermes Agent new

How to use kernelpool/GLM-5.1-6bit with Hermes Agent:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "kernelpool/GLM-5.1-6bit"

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default kernelpool/GLM-5.1-6bit

Run Hermes

hermes

OpenClaw new

How to use kernelpool/GLM-5.1-6bit with OpenClaw:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "kernelpool/GLM-5.1-6bit"

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "kernelpool/GLM-5.1-6bit" \
  --custom-provider-id mlx-lm \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

MLX LM

How to use kernelpool/GLM-5.1-6bit with MLX LM:

Generate or start a chat session

# Install MLX LM
uv tool install mlx-lm
# Interactive chat REPL
mlx_lm.chat --model "kernelpool/GLM-5.1-6bit"

Run an OpenAI-compatible server

# Install MLX LM
uv tool install mlx-lm
# Start the server
mlx_lm.server --model "kernelpool/GLM-5.1-6bit"
# Calling the OpenAI-compatible server with curl
curl -X POST "http://localhost:8000/v1/chat/completions" \
   -H "Content-Type: application/json" \
   --data '{
     "model": "kernelpool/GLM-5.1-6bit",
     "messages": [
       {"role": "user", "content": "Hello"}
     ]
   }'

kernelpool commited on Apr 8

Commit

4b12667

verified ·

1 Parent(s): 3d66279

Add files using upload-large-folder tool

Browse files

Files changed (28) hide show

model-00002-of-00121.safetensors +3 -0
model-00008-of-00121.safetensors +3 -0
model-00010-of-00121.safetensors +3 -0
model-00015-of-00121.safetensors +3 -0
model-00022-of-00121.safetensors +3 -0
model-00027-of-00121.safetensors +3 -0
model-00028-of-00121.safetensors +3 -0
model-00030-of-00121.safetensors +3 -0
model-00035-of-00121.safetensors +3 -0
model-00043-of-00121.safetensors +3 -0
model-00049-of-00121.safetensors +3 -0
model-00051-of-00121.safetensors +3 -0
model-00054-of-00121.safetensors +3 -0
model-00063-of-00121.safetensors +3 -0
model-00066-of-00121.safetensors +3 -0
model-00069-of-00121.safetensors +3 -0
model-00071-of-00121.safetensors +3 -0
model-00074-of-00121.safetensors +3 -0
model-00082-of-00121.safetensors +3 -0
model-00087-of-00121.safetensors +3 -0
model-00088-of-00121.safetensors +3 -0
model-00090-of-00121.safetensors +3 -0
model-00095-of-00121.safetensors +3 -0
model-00103-of-00121.safetensors +3 -0
model-00106-of-00121.safetensors +3 -0
model-00109-of-00121.safetensors +3 -0
model-00111-of-00121.safetensors +3 -0
model-00114-of-00121.safetensors +3 -0

model-00002-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2c981bef5e23ea59d741ceec61b678b5e4c6eb98ce814f78db1e52fdbd27fb6e
+size 5320632555

model-00008-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:727406c744a07e1dfcf21ae752459d8fdb6cbc4f189722858b84fab41ebcd54d
+size 5335155602

model-00010-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8d7f0f7e55b3adc49001834de7f0358745a71f8eca77e5cb9c792f7c5f3b59b4
+size 2994118881

model-00015-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:40a03d33cb21fa1e9b88952729af95f24c5ce620c5aa173534d3958cccb6baba
+size 5309374781

model-00022-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0c21ec9ca0de9f9f6628484316ee45705a58dfc3d42c774537eecf524e0ac766
+size 5275949229

model-00027-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:211bcab274f8a954b979eb0d744f75c95480c167eb7e921314901c804dd76c94
+size 5234492184

model-00028-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3468cd064c45ada39e0365f32baf6ae0a0a13821dc4bc072dc955c632ed3f3c5
+size 5309374865

model-00030-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:73674b05fdfe77b1fb46515833e1b4ef1a34a5cb82252017166a9dceef9a88a2
+size 5275949231

model-00035-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:534dda04ad5200e7b874280ff13f0ef09e6226bf3259f5dbf6bf2f77c67dd7a0
+size 5234492180

model-00043-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:db74d14eba3043117cc6cb034cfea446689161f230d37a8b516ae44970f246dc
+size 5234492188

model-00049-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3a6ffc59e5bc4ad23f98eb3559b8eab8898594b53fcb2539f02babcc1cd3dd13
+size 5309374862

model-00051-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b1c35a2239d01a569249146b499145004e9c3e2ffda26ec2656c4397267ab0de
+size 5234492186

model-00054-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0f204a19b1bf6e0f2793d12ffa64bedab264bb497a63e2701a548fee554b773d
+size 5275949229

model-00063-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2c3d76838ee2093b1dced5297235b52f8e068ab113ae805266ceae46097bc554
+size 5309374865

model-00066-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7d50ff945db40af94dd2859402c4820c320a64a26c235b0304e258428e345cb3
+size 2994118940

model-00069-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:52faf97ea1f9b0a44a7b698d98d7912d93f844dd093965fd1d34198e1dc07e63
+size 5368581202

model-00071-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:265ac295bd9b962fc4b086acd95f5e74b0bd767150044d0eae47ae7f65a53f1f
+size 5309374865

model-00074-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:07d1745d322e38bd684baa4ab10a124fed88a63643fdad72c30ea0e6300618d9
+size 2994118918

model-00082-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a4a19649902b46c8c0e3ca09e569e6069cbb8be7613beeb9d9cb2c0dfeaf6899
+size 2994119008

model-00087-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d9bfe3baa14816194634f032263246a96fa305b7f8d5abde2e922b5ffb3f6a6e
+size 5309374865

model-00088-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:20c7c1174c7c5ff9f1ae08d6686493fa01604a581c674d7720f55169ca43a095
+size 5335155609

model-00090-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3617927568e1217922db4ad66f668aafd53bd5830c8bafb453fa3fc910bd51bf
+size 2994118914

model-00095-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:92d9d7f8a1de95a9c640f66e96f06ee4e36226b4b5e853a6aa7da6a8a902d38c
+size 5309374865

model-00103-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:77694b98d3ea54b32680d048ba091af0338493f31c747f2b5256e71e150f9a87
+size 5309374715

model-00106-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:865a903682c5e9f17605d2ca18dc52b725c2115119d983d8fba4e046071687dd
+size 2994118922

model-00109-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8a013ff698f2dd027f43fad9d48e9b46f7bb68a4053ec495e9779a5578938875
+size 5368581210

model-00111-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6957c35dad9c09c47084c538632bfb676dd6873b81b76bfbb8d8dfc7d7afade6
+size 5309374865

model-00114-of-00121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f6ad6b2a7f536a2e5b8a58fd2c0e9436331624c14200d4970970480dd5c0a125
+size 2994118916