---
base_model:
- Casual-Autopsy/Maginum-Cydoms-24B
base_model_relation: quantized
pipeline_tag: text-generation
library_name: safetensors
tags:
- exl3
- 4-bit
- 6-bit
- 8-bit
---

# Original model: [Maginum-Cydoms-24B](https://huggingface.co/Casual-Autopsy/Maginum-Cydoms-24B) by [Casual-Autopsy](https://huggingface.co/Casual-Autopsy)

----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

## Available [ExLlamaV3](https://github.com/turboderp-org/exllamav3) (release v0.0.18) quantizations

| Type | Size | CLI |
|------|------|---------|
| [H8-4.0BPW](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/tree/H8-4.0BPW) | 13.16 GB | [Copy-paste the line / Download the batch file](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/resolve/H8-4.0BPW/Download~Casual-Autopsy_Maginum-Cydoms-24B_H8-4.0BPW_EXL3.bat) |
| [H8-6.0BPW](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/tree/H8-6.0BPW) | 18.72 GB | [Copy-paste the line / Download the batch file](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/resolve/H8-6.0BPW/Download~Casual-Autopsy_Maginum-Cydoms-24B_H8-6.0BPW_EXL3.bat) |
| [H8-8.0BPW](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/tree/H8-8.0BPW) | 24.27 GB | [Copy-paste the line / Download the batch file](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/resolve/H8-8.0BPW/Download~Casual-Autopsy_Maginum-Cydoms-24B_H8-8.0BPW_EXL3.bat) |

***Requirements: A python installation with huggingface-hub module to use CLI.***

### Licensing

License detected: unknown

The license for the provided quantized models is derived from the original model. For additional information see the original model's page above, or, if unavailable, the files and the page backups below.

----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

# Backups

[Original files](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/tree/original-files)

<details>
<summary>Original page (click to expand)</summary>

# Maginum-Cydoms-24B

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Methods

This model was merged using the following merge methods:
- [TIES](https://arxiv.org/abs/2306.01708)
- [DELLA](https://arxiv.org/abs/2406.11617)
- [SLERP](https://en.wikipedia.org/wiki/Slerp)

### Models Merged

The following models were included in the merge:
- [anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only](https://huggingface.co/anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only)
- [TheDrummer/Magidonia-24B-v4.3](https://huggingface.co/TheDrummer/Magidonia-24B-v4.3)
- [TheDrummer/Precog-24B-v1](https://huggingface.co/TheDrummer/Precog-24B-v1)
- [zerofata/MS3.2-PaintedFantasy-v3-24B](https://huggingface.co/zerofata/MS3.2-PaintedFantasy-v3-24B)
- [TheDrummer/Cydonia-24B-v4.3](https://huggingface.co/TheDrummer/Cydonia-24B-v4.3)
- [ReadyArt/4.2.0-Broken-Tutu-24b](https://huggingface.co/ReadyArt/4.2.0-Broken-Tutu-24b)
- [zerofata/MS3.2-PaintedFantasy-v2-24B](https://huggingface.co/zerofata/MS3.2-PaintedFantasy-v2-24B)

### Configuration

The following YAML configurations were used to produce this model:

Maginum-Cydoms-S001:
```yaml
models:
  - model: anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only

  - model: TheDrummer/Magidonia-24B-v4.3
    parameters:
      density: 1.0
      weight: 1.0
  - model: TheDrummer/Precog-24B-v1
    parameters:
      density: 0.4
      weight: 0.6
  - model: zerofata/MS3.2-PaintedFantasy-v3-24B
    parameters:
      density: 0.4
      weight: 0.4

merge_method: ties
base_model: anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only
parameters:
  normalize: false
  int8_mask: false
dtype: float32

tokenizer:
  source: union
```

Maginum-Cydoms-S002:
```yaml
models:
  - model: anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only

  - model: TheDrummer/Cydonia-24B-v4.3
    parameters:
      density: 1.0
      weight: 1.0
      epsilon: 0.0
  - model: ReadyArt/4.2.0-Broken-Tutu-24b
    parameters:
      density: 0.4
      weight: 0.6
      epsilon: 0.2
  - model: zerofata/MS3.2-PaintedFantasy-v2-24B
    parameters:
      density: 0.4
      weight: 0.4
      epsilon: 0.2

merge_method: della
base_model: anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only
parameters:
  normalize: false
  int8_mask: false
dtype: float32

tokenizer:
  source: union
```

```yaml
models:
  - model: Maginum-Cydoms-S001
  - model: Maginum-Cydoms-S002

merge_method: slerp
base_model: Maginum-Cydoms-S001
parameters:
  t:
    - filter: self_attn
      value: [0.3, 0.4, 0.6, 0.4, 0.3, 0.4, 0.6, 0.4, 0.3]
    - filter: mlp
      value: [0.7, 0.6, 0.4, 0.6, 0.7, 0.6, 0.4, 0.6, 0.7]
    - value: 0.5
dtype: float32
out_dtype: bfloat16

tokenizer:
  source: union
```

</details>