| --- |
| base_model: |
| - Casual-Autopsy/Maginum-Cydoms-24B |
| base_model_relation: quantized |
| pipeline_tag: text-generation |
| library_name: safetensors |
| tags: |
| - exl3 |
| - 4-bit |
| - 6-bit |
| - 8-bit |
| --- |
| |
| # Original model: [Maginum-Cydoms-24B](https://huggingface.co/Casual-Autopsy/Maginum-Cydoms-24B) by [Casual-Autopsy](https://huggingface.co/Casual-Autopsy) |
|
|
| ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
|
|
| ## Available [ExLlamaV3](https://github.com/turboderp-org/exllamav3) (release v0.0.18) quantizations |
|
|
| | Type | Size | CLI | |
| |------|------|---------| |
| | [H8-4.0BPW](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/tree/H8-4.0BPW) | 13.16 GB | [Copy-paste the line / Download the batch file](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/resolve/H8-4.0BPW/Download~Casual-Autopsy_Maginum-Cydoms-24B_H8-4.0BPW_EXL3.bat) | |
| | [H8-6.0BPW](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/tree/H8-6.0BPW) | 18.72 GB | [Copy-paste the line / Download the batch file](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/resolve/H8-6.0BPW/Download~Casual-Autopsy_Maginum-Cydoms-24B_H8-6.0BPW_EXL3.bat) | |
| | [H8-8.0BPW](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/tree/H8-8.0BPW) | 24.27 GB | [Copy-paste the line / Download the batch file](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/resolve/H8-8.0BPW/Download~Casual-Autopsy_Maginum-Cydoms-24B_H8-8.0BPW_EXL3.bat) | |
|
|
| ***Requirements: A python installation with huggingface-hub module to use CLI.*** |
|
|
| ### Licensing |
|
|
| License detected: unknown |
|
|
| The license for the provided quantized models is derived from the original model. For additional information see the original model's page above, or, if unavailable, the files and the page backups below. |
|
|
| ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
|
|
| # Backups |
|
|
| [Original files](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/tree/original-files) |
|
|
| <details> |
| <summary>Original page (click to expand)</summary> |
|
|
| # Maginum-Cydoms-24B |
|
|
| This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). |
|
|
| ## Merge Details |
| ### Merge Methods |
|
|
| This model was merged using the following merge methods: |
| - [TIES](https://arxiv.org/abs/2306.01708) |
| - [DELLA](https://arxiv.org/abs/2406.11617) |
| - [SLERP](https://en.wikipedia.org/wiki/Slerp) |
|
|
| ### Models Merged |
|
|
| The following models were included in the merge: |
| - [anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only](https://huggingface.co/anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only) |
| - [TheDrummer/Magidonia-24B-v4.3](https://huggingface.co/TheDrummer/Magidonia-24B-v4.3) |
| - [TheDrummer/Precog-24B-v1](https://huggingface.co/TheDrummer/Precog-24B-v1) |
| - [zerofata/MS3.2-PaintedFantasy-v3-24B](https://huggingface.co/zerofata/MS3.2-PaintedFantasy-v3-24B) |
| - [TheDrummer/Cydonia-24B-v4.3](https://huggingface.co/TheDrummer/Cydonia-24B-v4.3) |
| - [ReadyArt/4.2.0-Broken-Tutu-24b](https://huggingface.co/ReadyArt/4.2.0-Broken-Tutu-24b) |
| - [zerofata/MS3.2-PaintedFantasy-v2-24B](https://huggingface.co/zerofata/MS3.2-PaintedFantasy-v2-24B) |
|
|
| ### Configuration |
|
|
| The following YAML configurations were used to produce this model: |
|
|
| Maginum-Cydoms-S001: |
| ```yaml |
| models: |
| - model: anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only |
| |
| - model: TheDrummer/Magidonia-24B-v4.3 |
| parameters: |
| density: 1.0 |
| weight: 1.0 |
| - model: TheDrummer/Precog-24B-v1 |
| parameters: |
| density: 0.4 |
| weight: 0.6 |
| - model: zerofata/MS3.2-PaintedFantasy-v3-24B |
| parameters: |
| density: 0.4 |
| weight: 0.4 |
| |
| merge_method: ties |
| base_model: anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only |
| parameters: |
| normalize: false |
| int8_mask: false |
| dtype: float32 |
| |
| tokenizer: |
| source: union |
| ``` |
|
|
| Maginum-Cydoms-S002: |
| ```yaml |
| models: |
| - model: anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only |
| |
| - model: TheDrummer/Cydonia-24B-v4.3 |
| parameters: |
| density: 1.0 |
| weight: 1.0 |
| epsilon: 0.0 |
| - model: ReadyArt/4.2.0-Broken-Tutu-24b |
| parameters: |
| density: 0.4 |
| weight: 0.6 |
| epsilon: 0.2 |
| - model: zerofata/MS3.2-PaintedFantasy-v2-24B |
| parameters: |
| density: 0.4 |
| weight: 0.4 |
| epsilon: 0.2 |
| |
| merge_method: della |
| base_model: anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only |
| parameters: |
| normalize: false |
| int8_mask: false |
| dtype: float32 |
| |
| tokenizer: |
| source: union |
| ``` |
|
|
| ```yaml |
| models: |
| - model: Maginum-Cydoms-S001 |
| - model: Maginum-Cydoms-S002 |
| |
| merge_method: slerp |
| base_model: Maginum-Cydoms-S001 |
| parameters: |
| t: |
| - filter: self_attn |
| value: [0.3, 0.4, 0.6, 0.4, 0.3, 0.4, 0.6, 0.4, 0.3] |
| - filter: mlp |
| value: [0.7, 0.6, 0.4, 0.6, 0.7, 0.6, 0.4, 0.6, 0.7] |
| - value: 0.5 |
| dtype: float32 |
| out_dtype: bfloat16 |
| |
| tokenizer: |
| source: union |
| ``` |
|
|
| </details> |
|
|
|
|
