0xSero/Laguna-S-2.1-Hybrid-3.25bpw

Laguna S 2.1 Hybrid 3.25bpw

Verified package. This package was materialized only after the weight transform, compact-package load, and hybrid-serving validation gates passed. The included release manifest seals the source revision, tier map, runtime overlay, validation evidence, and every packaged artifact hash.

Laguna S 2.1 Hybrid 3.25bpw is a two-tier, expert-level quantization of poolside/Laguna-S-2.1-NVFP4. It preserves every expert and the source router topology. REAP saliency is used only to choose the NVFP4 hot tier; it is not expert pruning.

Quantization layout

Each of the 47 sparse MoE layers has 256 routed experts:

Tier	Experts per sparse layer	Storage
Hot	64	source NVFP4, retained byte-exact
Tail	192	calibrated EXL3 Trellis-3

This is a nominal 3.25-bit mixture across the expert weights. Shared experts, the router, attention, embeddings, LM head, and other non-expert tensors remain in their source representation. All 256 experts remain routable.

How the hot tier was selected

The hot experts are ranked independently in each sparse layer using router- weighted expert-output activation saliency over a held-out calibration mixture covering coding, tool and agentic calls, reasoning, mathematics, science, terminal work, CUDA, cybersecurity, and long-context prompts. The score is the mean, over tokens routed to an expert, of the applied router weight multiplied by that expert's output L2 norm. This release includes the exact tier map, source revision, calibration provenance, and artifact hashes.

Runtime status and compatibility

The hybrid requires the accompanying EXL3-tail runtime. It is not a drop-in stock-vLLM checkpoint. The runtime supports two deployment layouts:

• single-Spark TP1, which reconstructs each calibrated tail expert from both stored artifact slices on one device;
• two-Spark TP2, which loads one stored artifact slice per tensor-parallel rank.

Both layouts retain normal compiled execution and CUDA graphs. The package includes the pinned runtime overlay and exact launch recipes. The standalone 53 GB package passed a fresh compact-package load on one DGX Spark with 200k context, Poolside reasoning and tool parsers, structured output support, and full/piecewise CUDA graph capture. Its sealed API suite covers reasoning, parsed tool calls, tool history, JSON schema, exact ASCII output, and a 194,978-token long-context marker-recovery request. The measured stable single-Spark throughput sweep selected concurrency 4 at 58.20 aggregate completion tokens/s. The source checkpoint contains no native MTP tensors; the release therefore does not claim native-MTP throughput.

Do not infer benchmark quality from this card. At the time this package was published, no Terminal-Bench 2.1 result was claimed.

Provenance

• Base model: poolside/Laguna-S-2.1-NVFP4
• Base-model license: OpenMDW-1.1
• Hybrid method: source NVFP4 hot experts plus calibrated EXL3 Trellis-3 tails
• REAP reference: REAP the Experts

Responsible use

This derivative remains subject to the upstream OpenMDW-1.1 license and should be used consistently with the upstream model's acceptable-use guidance.