Instructions to use TheStageAI/gemma-4-E4B-it-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use TheStageAI/gemma-4-E4B-it-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf TheStageAI/gemma-4-E4B-it-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf TheStageAI/gemma-4-E4B-it-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf TheStageAI/gemma-4-E4B-it-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf TheStageAI/gemma-4-E4B-it-GGUF:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf TheStageAI/gemma-4-E4B-it-GGUF:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf TheStageAI/gemma-4-E4B-it-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf TheStageAI/gemma-4-E4B-it-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf TheStageAI/gemma-4-E4B-it-GGUF:Q4_K_M
Use Docker
docker model run hf.co/TheStageAI/gemma-4-E4B-it-GGUF:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use TheStageAI/gemma-4-E4B-it-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "TheStageAI/gemma-4-E4B-it-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "TheStageAI/gemma-4-E4B-it-GGUF", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/TheStageAI/gemma-4-E4B-it-GGUF:Q4_K_M
- Ollama
How to use TheStageAI/gemma-4-E4B-it-GGUF with Ollama:
ollama run hf.co/TheStageAI/gemma-4-E4B-it-GGUF:Q4_K_M
- Unsloth Studio
How to use TheStageAI/gemma-4-E4B-it-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for TheStageAI/gemma-4-E4B-it-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for TheStageAI/gemma-4-E4B-it-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for TheStageAI/gemma-4-E4B-it-GGUF to start chatting
- Pi
How to use TheStageAI/gemma-4-E4B-it-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf TheStageAI/gemma-4-E4B-it-GGUF:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "TheStageAI/gemma-4-E4B-it-GGUF:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- OpenClaw new
How to use TheStageAI/gemma-4-E4B-it-GGUF with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf TheStageAI/gemma-4-E4B-it-GGUF:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "TheStageAI/gemma-4-E4B-it-GGUF:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use TheStageAI/gemma-4-E4B-it-GGUF with Docker Model Runner:
docker model run hf.co/TheStageAI/gemma-4-E4B-it-GGUF:Q4_K_M
- Lemonade
How to use TheStageAI/gemma-4-E4B-it-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull TheStageAI/gemma-4-E4B-it-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.gemma-4-E4B-it-GGUF-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use TheStageAI/gemma-4-E4B-it-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf TheStageAI/gemma-4-E4B-it-GGUF:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default TheStageAI/gemma-4-E4B-it-GGUF:Q4_K_M
Run Hermes
hermes
- Atomic Chat
Update private release-card draft v3
Browse files- .gitattributes +1 -0
- README.md +57 -32
- assets/cta-docs.svg +10 -0
- assets/cta-edge-lm.svg +11 -0
- assets/cta-platform.svg +13 -0
- assets/thestage-edge-models-header.png +3 -0
- release-manifest.json +12 -6
.gitattributes
CHANGED
|
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
assets/thestage-edge-models-header.png filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
|
@@ -5,35 +5,52 @@ base_model:
|
|
| 5 |
base_model_relation: quantized
|
| 6 |
library_name: llama.cpp
|
| 7 |
pipeline_tag: text-generation
|
|
|
|
| 8 |
tags:
|
| 9 |
- gguf
|
| 10 |
- llama.cpp
|
| 11 |
-
-
|
| 12 |
- mixed-precision
|
|
|
|
|
|
|
| 13 |
---
|
| 14 |
|
| 15 |
-
|
|
|
|
|
|
|
| 16 |
|
| 17 |
-
|
| 18 |
|
| 19 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 20 |
|
| 21 |
**Gemma 4 family:** [E2B](https://huggingface.co/TheStageAI/gemma-4-E2B-it-GGUF) · **[E4B](https://huggingface.co/TheStageAI/gemma-4-E4B-it-GGUF)** · [12B](https://huggingface.co/TheStageAI/gemma-4-12B-it-GGUF)
|
| 22 |
|
| 23 |
-
##
|
| 24 |
|
| 25 |
-
|
|
| 26 |
| --- | ---: | --- | --- |
|
| 27 |
-
| XS | 2.91 GB |
|
| 28 |
-
| **S** | **3.76 GB** | **Recommended ·
|
| 29 |
-
| M | 4.33 GB | Q4 reference | [GGUF](./gemma-4-E4B-it-M-TS-Q4_K_M.gguf) |
|
| 30 |
-
| L | 8.02 GB |
|
| 31 |
|
| 32 |
Sizes use decimal MB/GB. Exact byte counts are recorded in [`release-manifest.json`](./release-manifest.json).
|
| 33 |
|
| 34 |
-
##
|
| 35 |
|
| 36 |
-
|
| 37 |
|
| 38 |
```bash
|
| 39 |
llama-cli \
|
|
@@ -51,29 +68,35 @@ llama-cli \
|
|
| 51 |
| M | 85.40 / 89.81 | 69.55 |
|
| 52 |
| L | 84.84 / 89.09 | 70.01 |
|
| 53 |
|
| 54 |
-
|
| 55 |
-
- **MMLU-Pro:** complete 12,032-question runs only, native chat template, `enable_thinking=true`, temperature 1, top-p 0.95, 32,768-token output limit.
|
| 56 |
-
- `—` means that no complete headline MMLU-Pro run is reported. Partial-subject accuracies are not used as release scores.
|
| 57 |
|
| 58 |
The benchmarks intentionally exercise different modes: IFEval measures non-thinking instruction and format adherence, while MMLU-Pro includes long sampled reasoning.
|
| 59 |
|
| 60 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 61 |
|
| 62 |
-
|
| 63 |
|
| 64 |
-
##
|
| 65 |
|
| 66 |
-
This release starts from [`google/gemma-4-E4B-it`](https://huggingface.co/google/gemma-4-E4B-it) at revision [`fee6332c1abaafb77f6f9624236c63aa2f1d0187`](https://huggingface.co/google/gemma-4-E4B-it/tree/fee6332c1abaafb77f6f9624236c63aa2f1d0187)
|
| 67 |
|
| 68 |
-
- **XS
|
| 69 |
-
- **
|
| 70 |
-
- **
|
| 71 |
-
- **L:** uniform Q8_0 tensor assignment for maximum fidelity.
|
| 72 |
|
| 73 |
-
The
|
| 74 |
|
| 75 |
<details>
|
| 76 |
-
<summary><b>
|
| 77 |
|
| 78 |
| Variant | Hub selector | GGUF file type | Whole-file BPW |
|
| 79 |
| --- | --- | --- | ---: |
|
|
@@ -82,19 +105,21 @@ The recommendation is selected separately for each base model from the release e
|
|
| 82 |
| M | `Q4_K_M` | `MOSTLY_Q4_K_M` | 4.646 |
|
| 83 |
| L | `Q8_0` | `MOSTLY_Q8_0` | 8.602 |
|
| 84 |
|
| 85 |
-
XS and S are
|
|
|
|
|
|
|
| 86 |
|
| 87 |
</details>
|
| 88 |
|
| 89 |
-
##
|
|
|
|
|
|
|
| 90 |
|
| 91 |
-
|
| 92 |
-
- File size does not include KV cache or runtime buffers; total memory use grows with context length.
|
| 93 |
-
- Small score reversals between BF16 and quantized rows should be read as evaluation variation, not as a claim that quantization improves the base model.
|
| 94 |
|
| 95 |
-
##
|
| 96 |
|
| 97 |
-
The exact base revision, byte sizes, GGUF file types, whole-file BPW, tensor inventories, SHA-256 digests, held-out KL values, and evaluation IDs are recorded in [`release-manifest.json`](./release-manifest.json). Use its SHA-256 digests to verify downloaded files.
|
| 98 |
|
| 99 |
## License
|
| 100 |
|
|
|
|
| 5 |
base_model_relation: quantized
|
| 6 |
library_name: llama.cpp
|
| 7 |
pipeline_tag: text-generation
|
| 8 |
+
thumbnail: https://huggingface.co/TheStageAI/gemma-4-E4B-it-GGUF/resolve/main/assets/thestage-edge-models-header.png
|
| 9 |
tags:
|
| 10 |
- gguf
|
| 11 |
- llama.cpp
|
| 12 |
+
- quantized
|
| 13 |
- mixed-precision
|
| 14 |
+
- local-inference
|
| 15 |
+
- gemma4
|
| 16 |
---
|
| 17 |
|
| 18 |
+
<p align="center">
|
| 19 |
+
<img src="./assets/thestage-edge-models-header.png" width="100%" alt="TheStageAI Edge Models — the right model at every memory budget">
|
| 20 |
+
</p>
|
| 21 |
|
| 22 |
+
<h1 align="center">Gemma 4 E4B IT — TheStageAI GGUF</h1>
|
| 23 |
|
| 24 |
+
<p align="center">
|
| 25 |
+
Four GGUF checkpoints for local inference with llama.cpp, from 2.91 GB to 8.02 GB.
|
| 26 |
+
<br>
|
| 27 |
+
<strong>Start with S — 3.76 GB and 100% of the BF16 instruction-strict IFEval score in our evaluation.</strong>
|
| 28 |
+
</p>
|
| 29 |
+
|
| 30 |
+
<p align="center">
|
| 31 |
+
<a href="https://github.com/TheStageAI/edge-lm"><img src="./assets/cta-edge-lm.svg" height="42" alt="Explore edge-lm on GitHub"></a>
|
| 32 |
+
|
| 33 |
+
<a href="https://docs.thestage.ai/"><img src="./assets/cta-docs.svg" height="42" alt="Read TheStageAI documentation"></a>
|
| 34 |
+
|
| 35 |
+
<a href="https://app.thestage.ai/"><img src="./assets/cta-platform.svg" height="42" alt="Open TheStageAI Platform"></a>
|
| 36 |
+
</p>
|
| 37 |
|
| 38 |
**Gemma 4 family:** [E2B](https://huggingface.co/TheStageAI/gemma-4-E2B-it-GGUF) · **[E4B](https://huggingface.co/TheStageAI/gemma-4-E4B-it-GGUF)** · [12B](https://huggingface.co/TheStageAI/gemma-4-12B-it-GGUF)
|
| 39 |
|
| 40 |
+
## Start here
|
| 41 |
|
| 42 |
+
| Tier | Size | Use | Download |
|
| 43 |
| --- | ---: | --- | --- |
|
| 44 |
+
| XS | 2.91 GB | Smallest | [GGUF](./gemma-4-E4B-it-XS-TS-Q3_K_S.gguf) |
|
| 45 |
+
| **S** | **3.76 GB** | **Recommended · Adaptive compact** | [GGUF](./gemma-4-E4B-it-S-TS-Q4_K_S.gguf) |
|
| 46 |
+
| M | 4.33 GB | Fixed Q4 reference | [GGUF](./gemma-4-E4B-it-M-TS-Q4_K_M.gguf) |
|
| 47 |
+
| L | 8.02 GB | Q8 fidelity reference | [GGUF](./gemma-4-E4B-it-L-TS-Q8_0.gguf) |
|
| 48 |
|
| 49 |
Sizes use decimal MB/GB. Exact byte counts are recorded in [`release-manifest.json`](./release-manifest.json).
|
| 50 |
|
| 51 |
+
## Run with llama.cpp
|
| 52 |
|
| 53 |
+
This command selects the recommended **S** checkpoint by exact filename:
|
| 54 |
|
| 55 |
```bash
|
| 56 |
llama-cli \
|
|
|
|
| 68 |
| M | 85.40 / 89.81 | 69.55 |
|
| 69 |
| L | 84.84 / 89.09 | 70.01 |
|
| 70 |
|
| 71 |
+
Only complete 12,032-question MMLU-Pro runs are reported. `—` means that no complete release score is available; partial-subject results are not promoted to headline metrics.
|
|
|
|
|
|
|
| 72 |
|
| 73 |
The benchmarks intentionally exercise different modes: IFEval measures non-thinking instruction and format adherence, while MMLU-Pro includes long sampled reasoning.
|
| 74 |
|
| 75 |
+
> **Reasoning:** use S, M, or L for long-form reasoning. XS remains available when minimum footprint is the priority.
|
| 76 |
+
|
| 77 |
+
<details>
|
| 78 |
+
<summary><b>Evaluation protocol and XS reasoning note</b></summary>
|
| 79 |
+
|
| 80 |
+
- **IFEval:** 541 prompts, native chat template, `enable_thinking=false`, temperature 0.
|
| 81 |
+
- **MMLU-Pro:** 12,032 questions, native chat template, `enable_thinking=true`, temperature 1, top-p 0.95, 32,768-token output limit.
|
| 82 |
+
- The headline BF16-retention percentage uses instruction-strict IFEval and is capped at 100%; the uncapped raw scores are shown in the table.
|
| 83 |
+
|
| 84 |
+
XS prioritizes minimum footprint and ordinary chat or instruction following. For long-form reasoning, start with S, M, or L. Complete Gemma XS MMLU-Pro results remain in the table so the full measured trade-off stays visible.
|
| 85 |
|
| 86 |
+
</details>
|
| 87 |
|
| 88 |
+
## How these checkpoints were built
|
| 89 |
|
| 90 |
+
This release starts from [`google/gemma-4-E4B-it`](https://huggingface.co/google/gemma-4-E4B-it) at revision [`fee6332c1abaafb77f6f9624236c63aa2f1d0187`](https://huggingface.co/google/gemma-4-E4B-it/tree/fee6332c1abaafb77f6f9624236c63aa2f1d0187).
|
| 91 |
|
| 92 |
+
- **XS and S** use model-specific mixed-precision schedules selected for explicit size targets.
|
| 93 |
+
- **M** keeps fixed Q4_K precision across quantized decoder tensors.
|
| 94 |
+
- **L** keeps fixed Q8_0 precision as the high-fidelity reference.
|
|
|
|
| 95 |
|
| 96 |
+
All four checkpoints receive scale tuning without changing their stored quantized codes or tensor layout. The recommended tier is selected independently for each base model from end-to-end evaluation.
|
| 97 |
|
| 98 |
<details>
|
| 99 |
+
<summary><b>File types, Hub selectors, and effective BPW</b></summary>
|
| 100 |
|
| 101 |
| Variant | Hub selector | GGUF file type | Whole-file BPW |
|
| 102 |
| --- | --- | --- | ---: |
|
|
|
|
| 105 |
| M | `Q4_K_M` | `MOSTLY_Q4_K_M` | 4.646 |
|
| 106 |
| L | `Q8_0` | `MOSTLY_Q8_0` | 8.602 |
|
| 107 |
|
| 108 |
+
XS and S are TheStageAI mixed-precision schedules. Their public Q-type suffixes provide approximate Hub size classes for discoverability; they do not describe every tensor in the payload. M and L use fixed Q4_K and Q8_0 assignments for quantized decoder tensors.
|
| 109 |
+
|
| 110 |
+
The exact tensor-type inventory and SHA-256 digest for every file are recorded in [`release-manifest.json`](./release-manifest.json). File size does not include KV cache or runtime buffers, which grow with context length. GGUF runtimes treat multimodal projectors as separate artifacts; this release contains the language-model files listed above.
|
| 111 |
|
| 112 |
</details>
|
| 113 |
|
| 114 |
+
## TheStageAI edge stack
|
| 115 |
+
|
| 116 |
+
These checkpoints provide a portable llama.cpp deployment path. For native compressed models on Apple Silicon, explore [edge-lm](https://github.com/TheStageAI/edge-lm). For custom compression, compilation, and deployment workflows, use the [TheStageAI Platform](https://app.thestage.ai/) and [documentation](https://docs.thestage.ai/).
|
| 117 |
|
| 118 |
+
Optimizing for a specific device, latency target, or memory budget? [Talk to the TheStageAI team →](https://app.thestage.ai/contact)
|
|
|
|
|
|
|
| 119 |
|
| 120 |
+
## Reproducibility
|
| 121 |
|
| 122 |
+
The exact base revision, byte sizes, GGUF file types, whole-file BPW, tensor inventories, SHA-256 digests, held-out KL values, and evaluation IDs are recorded in [`release-manifest.json`](./release-manifest.json). Use its SHA-256 digests to verify downloaded files. Export and load gates used [llama.cpp revision `bec4772f6a2527d371557b5d2032641e5ff7619c`](https://github.com/ggml-org/llama.cpp/commit/bec4772f6a2527d371557b5d2032641e5ff7619c).
|
| 123 |
|
| 124 |
## License
|
| 125 |
|
assets/cta-docs.svg
ADDED
|
|
assets/cta-edge-lm.svg
ADDED
|
|
assets/cta-platform.svg
ADDED
|
|
assets/thestage-edge-models-header.png
ADDED
|
Git LFS Details
|
release-manifest.json
CHANGED
|
@@ -36,7 +36,7 @@
|
|
| 36 |
},
|
| 37 |
"display_name": "Gemma 4 E4B IT",
|
| 38 |
"family": "Gemma 4",
|
| 39 |
-
"generated_at": "2026-07-
|
| 40 |
"license": "apache-2.0",
|
| 41 |
"model_key": "gemma4_e4b",
|
| 42 |
"reasoning_policy": {
|
|
@@ -48,8 +48,14 @@
|
|
| 48 |
"xs": "non_thinking_only"
|
| 49 |
},
|
| 50 |
"recommended_product": "S",
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 51 |
"repo_id": "TheStageAI/gemma-4-E4B-it-GGUF",
|
| 52 |
-
"schema": "thestageai.
|
|
|
|
| 53 |
"variants": [
|
| 54 |
{
|
| 55 |
"benchmarks": {
|
|
@@ -81,7 +87,7 @@
|
|
| 81 |
"lm_head_policy": "skip_tied",
|
| 82 |
"output_embedding_mode": "tied_alias",
|
| 83 |
"parameter_count": 7463013674,
|
| 84 |
-
"positioning": "
|
| 85 |
"product": "XS",
|
| 86 |
"reasoning_support": "non_thinking_only",
|
| 87 |
"recommended": false,
|
|
@@ -128,7 +134,7 @@
|
|
| 128 |
"lm_head_policy": "skip_tied",
|
| 129 |
"output_embedding_mode": "tied_alias",
|
| 130 |
"parameter_count": 7463013674,
|
| 131 |
-
"positioning": "
|
| 132 |
"product": "S",
|
| 133 |
"reasoning_support": "supported",
|
| 134 |
"recommended": true,
|
|
@@ -176,7 +182,7 @@
|
|
| 176 |
"lm_head_policy": "skip_tied",
|
| 177 |
"output_embedding_mode": "tied_alias",
|
| 178 |
"parameter_count": 7463013674,
|
| 179 |
-
"positioning": "Q4 reference",
|
| 180 |
"product": "M",
|
| 181 |
"reasoning_support": "supported",
|
| 182 |
"recommended": false,
|
|
@@ -219,7 +225,7 @@
|
|
| 219 |
"lm_head_policy": "skip_tied",
|
| 220 |
"output_embedding_mode": "tied_alias",
|
| 221 |
"parameter_count": 7463013674,
|
| 222 |
-
"positioning": "
|
| 223 |
"product": "L",
|
| 224 |
"reasoning_support": "supported",
|
| 225 |
"recommended": false,
|
|
|
|
| 36 |
},
|
| 37 |
"display_name": "Gemma 4 E4B IT",
|
| 38 |
"family": "Gemma 4",
|
| 39 |
+
"generated_at": "2026-07-20T23:43:48.671876+00:00",
|
| 40 |
"license": "apache-2.0",
|
| 41 |
"model_key": "gemma4_e4b",
|
| 42 |
"reasoning_policy": {
|
|
|
|
| 48 |
"xs": "non_thinking_only"
|
| 49 |
},
|
| 50 |
"recommended_product": "S",
|
| 51 |
+
"recommended_quality": {
|
| 52 |
+
"metric": "ifeval_instruction_strict",
|
| 53 |
+
"ratio_to_bf16": 1.0053691275167784,
|
| 54 |
+
"retention_percent_display": 100
|
| 55 |
+
},
|
| 56 |
"repo_id": "TheStageAI/gemma-4-E4B-it-GGUF",
|
| 57 |
+
"schema": "thestageai.gguf_release_manifest_v3",
|
| 58 |
+
"tested_llama_cpp_revision": "bec4772f6a2527d371557b5d2032641e5ff7619c",
|
| 59 |
"variants": [
|
| 60 |
{
|
| 61 |
"benchmarks": {
|
|
|
|
| 87 |
"lm_head_policy": "skip_tied",
|
| 88 |
"output_embedding_mode": "tied_alias",
|
| 89 |
"parameter_count": 7463013674,
|
| 90 |
+
"positioning": "Smallest",
|
| 91 |
"product": "XS",
|
| 92 |
"reasoning_support": "non_thinking_only",
|
| 93 |
"recommended": false,
|
|
|
|
| 134 |
"lm_head_policy": "skip_tied",
|
| 135 |
"output_embedding_mode": "tied_alias",
|
| 136 |
"parameter_count": 7463013674,
|
| 137 |
+
"positioning": "Adaptive compact",
|
| 138 |
"product": "S",
|
| 139 |
"reasoning_support": "supported",
|
| 140 |
"recommended": true,
|
|
|
|
| 182 |
"lm_head_policy": "skip_tied",
|
| 183 |
"output_embedding_mode": "tied_alias",
|
| 184 |
"parameter_count": 7463013674,
|
| 185 |
+
"positioning": "Fixed Q4 reference",
|
| 186 |
"product": "M",
|
| 187 |
"reasoning_support": "supported",
|
| 188 |
"recommended": false,
|
|
|
|
| 225 |
"lm_head_policy": "skip_tied",
|
| 226 |
"output_embedding_mode": "tied_alias",
|
| 227 |
"parameter_count": 7463013674,
|
| 228 |
+
"positioning": "Q8 fidelity reference",
|
| 229 |
"product": "L",
|
| 230 |
"reasoning_support": "supported",
|
| 231 |
"recommended": false,
|