---
license: apache-2.0
base_model: Pageshift-Entertainment/pagestorm-research-preview-24b-first-chapter-only
base_model_relation: quantized
quantized_by: blockblockblock
library_name: exllamav3
pipeline_tag: text-generation
tags:
  - exl3
  - exllamav3
  - quantized

quantization_format: exl3
bits_per_weight: 4.0
---

<div align="center">

# pagestorm · research · preview · 24b · first · chapter · only

<sub><code>EXL3</code> &nbsp;·&nbsp; <b>4.0&nbsp;bpw</b> &nbsp;·&nbsp; 13.4&nbsp;GB &nbsp;·&nbsp; Dense &nbsp;·&nbsp; 40 layers</sub>

<br/>

[![format](https://img.shields.io/badge/format-EXL3-c63010?style=for-the-badge&labelColor=14120e)](https://github.com/turboderp-org/exllamav3)
[![bpw](https://img.shields.io/badge/bpw-4.0-6b8a76?style=for-the-badge&labelColor=14120e)](#quants)
[![size](https://img.shields.io/badge/size-13.4_GB-6b8a76?style=for-the-badge&labelColor=14120e)](#quants)
[![arch](https://img.shields.io/badge/arch-Mistral-c63010?style=for-the-badge&labelColor=14120e)](https://huggingface.co/Pageshift-Entertainment/pagestorm-research-preview-24b-first-chapter-only)

[![base model](https://img.shields.io/badge/Base-Pageshift--Entertainment%2Fpagestorm--research--preview--24b--first--chapter--only-2a2620?style=flat-square&logo=huggingface&logoColor=white)](https://huggingface.co/Pageshift-Entertainment/pagestorm-research-preview-24b-first-chapter-only)
[![quantized by](https://img.shields.io/badge/Quantized_by-blockblockblock-2a2620?style=flat-square&logo=huggingface&logoColor=white)](https://huggingface.co/blockblockblock)
[![collection](https://img.shields.io/badge/All_bpws-Collection-c63010?style=flat-square&logo=huggingface&logoColor=white)](https://huggingface.co/collections/blockblockblock/pagestorm-research-preview-24b-first-chapter-only-exl3-6a44485dcb159b889ca2233f)

</div>

---

> [!NOTE]
> An [ExLlamaV3](https://github.com/turboderp-org/exllamav3) build of [`Pageshift-Entertainment/pagestorm-research-preview-24b-first-chapter-only`](https://huggingface.co/Pageshift-Entertainment/pagestorm-research-preview-24b-first-chapter-only) at **4.0 bits per weight**. See [Quants](#quants) for sibling repos at other bit&#8209;widths or browse the [collection](https://huggingface.co/collections/blockblockblock/pagestorm-research-preview-24b-first-chapter-only-exl3-6a44485dcb159b889ca2233f).

## Quants

<div align="center">

| BPW &nbsp; | &nbsp; Head bits &nbsp; | &nbsp; Calibration rows &nbsp; | &nbsp; Size &nbsp; | &nbsp; Status |
| :---: | :---: | :---: | ---: | :--- |
| 3.3 | 8 | 250 | 11.4&nbsp;GB | [link](https://huggingface.co/blockblockblock/pagestorm-research-preview-24b-first-chapter-only-exl3-3.3bpw) |
| **4.0** | 8 | 250 | **13.4&nbsp;GB** | <kbd>this repo</kbd> |

</div>

## Inference

<table>
  <thead>
    <tr>
      <th align="left" width="32%">Loader</th>
      <th align="left">Use it for</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td><a href="https://github.com/theroyallab/tabbyAPI"><b>TabbyAPI</b></a></td>
      <td>OpenAI&#8209;compatible HTTP server. Drop&#8209;in for OpenAI clients.</td>
    </tr>
    <tr>
      <td><a href="https://github.com/oobabooga/text-generation-webui"><b>text&#8209;generation&#8209;webui</b></a></td>
      <td>Local chat UI. Pick the <i>ExLlamaV3</i> loader from the model dropdown.</td>
    </tr>
    <tr>
      <td><a href="https://github.com/turboderp-org/exllamav3"><b>ExLlamaV3</b></a></td>
      <td>Direct Python API for embedding the model in your own code or pipeline.</td>
    </tr>
  </tbody>
</table>

## Download

```bash
pip install -U huggingface_hub

hf download \
  blockblockblock/pagestorm-research-preview-24b-first-chapter-only-exl3-4.0bpw \
  --local-dir ./pagestorm-research-preview-24b-first-chapter-only-exl3-4.0bpw
```

<details>
<summary><b>Quantization recipe</b> &nbsp;<sub>(advanced, embedded in <code>quantization_config.json</code>)</sub></summary>

<br/>

| Setting | Value |
| :--- | :--- |
| Format | `EXL3` |
| Bits per weight | `4.0` |
| Head bits | `8` |
| Calibration rows | `250` |
| Codebook | `MCG` |
| Out&#8209;scales | `always` |
| Parallel mode | `enabled` |

Loaded automatically by every ExLlamaV3 loader; reproduced here for searchability.

</details>

## License &amp; use

> [!IMPORTANT]
> Use and license **follow the [base model](https://huggingface.co/Pageshift-Entertainment/pagestorm-research-preview-24b-first-chapter-only)**.
> Quantization adds no additional restrictions. Refer to the upstream repository for terms, citation, and safety documentation.

---

<div align="center">
  <sub><i>Quantized with <a href="https://github.com/Honkware/blockquant"><b>BlockQuant</b></a> &nbsp;·&nbsp; convention&nbsp;<code>{org}/{model}-exl3-{bpw}bpw</code></i></sub>
</div>