---
license: openmdw-1.1
base_model:
- poolside/Laguna-S-2.1
---

This is a GGUF quantization of Poolside's Laguna S 2.1 using an imatrix based on Bartowski's dataset.

It was generated with llama.cpp [846e991e](https://github.com/ggml-org/llama.cpp/commit/846e991ec3c7ccec49112ff2c5b00b710e5f551d) plus the changes from PR [25165](https://github.com/ggml-org/llama.cpp/pull/25165), which at the time of building included commits up to 54f214a09b8

DFlash draft model is available at [wimmmm/poolside-Laguna-S-2.1-DFlash-GGUF](https://huggingface.co/wimmmm/poolside-Laguna-S-2.1-DFlash-GGUF)

To run with DFlash enabled, you can use the following command line (change quantizations as needed):

```
llama serve -hf wimmmm/poolside-Laguna-S-2.1-GGUF:Q4_K_M -hfd wimmmm/poolside-Laguna-S-2.1-DFlash-GGUF:Q4_0 --spec-type draft-dflash --spec-draft-n-max 15 -fa on --jinja --port 8000
```

Have fun!