--- license: llama3 base_model: saturated-labs/T-Rex-mini tags: - gguf - llama.cpp - quantized - iq4_xs - saturated-labs - roleplay - storytelling - language-model quantization: IQ4_XS model_type: llama language: - en --- # 🦖 T-Rex-mini — GGUF IQ4_XS (Quantized) This is a **quantized GGUF version** of [`saturated-labs/T-Rex-mini`](https://huggingface.co/saturated-labs/T-Rex-mini), converted using [llama.cpp](https://github.com/ggerganov/llama.cpp) and quantized to the `IQ4_XS` format. ## 🔧 Quantization Details - **Original Model**: `saturated-labs/T-Rex-mini` - **Format**: GGUF (`.gguf`) - **Quantization Type**: `IQ4_XS` - **Tool Used**: [`llama.cpp`](https://github.com/ggerganov/llama.cpp) - **Command**: ```bash ./llama-quantize.exe trex-mini-f16.gguf trex-mini-iq4_xs.gguf iq4_xs