--- base_model: - mistralai/Magistral-Small-2509 - Casual-Autopsy/Maginum-Cydoms-24B - DarkArtsForge/Asmodeus-24B-v1 - DarkArtsForge/Asmodeus-24B-v2 - DarkArtsForge/Magistaroth-24B-v1 - DarkArtsForge/Morax-24B-v2 - DarkArtsForge/Paimon-24B-v3 - DarkArtsForge/Zepar-24B-v1 - Naphula/GhostFace-24B-v1 - Naphula/Slimaki-Tavern-24B-v1.3 - Naphula/Slimaki-24B-v1.2 - Naphula/Slimaki-24B-v1 - sophosympatheia/Magistry-24B-v1.0 - TheDrummer/Precog-24B-v1 license: apache-2.0 library_name: transformers tags: - mergekit - merge - mistral - della - uncensored - profanity - roleplay - roleplaying - RP - Writing - creative - story - fiction - mistral - text - adventure - conversational widget: - text: "Morbid-Miasma-24B" output: url: https://cdn-uploads.huggingface.co/production/uploads/68e840caa318194c44ec2a04/E4RtSPJP8OD654cRRXZZ0.png --- > [!CAUTION] > ⚠️ Warning: This model can produce narratives and RP that contain violent and graphic erotic content. Adjust your system prompt accordingly, and use **Mistral Tekken** chat template. > # ☠️ Morbid Miasma 24B ![Morbid-Miasma-24B](https://cdn-uploads.huggingface.co/production/uploads/68e840caa318194c44ec2a04/E4RtSPJP8OD654cRRXZZ0.png) This is a **fully uncensored** merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). The merge is very dark, intelligent, and creative, scoring **16103** at Q0 Bench. ## Merge Details ### Merge Methods This model was merged using the [`della`](https://arxiv.org/abs/2406.11617) merge method using [mistralai/Magistral-Small-2509](mistralai/Magistral-Small-2509) as a base. ### Models Merged The following models were included in the merge: - mistralai/Magistral-Small-2509 - Casual-Autopsy/Maginum-Cydoms-24B - DarkArtsForge/Asmodeus-24B-v1 - DarkArtsForge/Asmodeus-24B-v2 - DarkArtsForge/Magistaroth-24B-v1 - DarkArtsForge/Morax-24B-v2 - DarkArtsForge/Paimon-24B-v3 - DarkArtsForge/Zepar-24B-v1 - Naphula/GhostFace-24B-v1 - Naphula/Slimaki-Tavern-24B-v1.3 - Naphula/Slimaki-24B-v1.2 - Naphula/Slimaki-24B-v1 - sophosympatheia/Magistry-24B-v1.0 - TheDrummer/Precog-24B-v1 ### Configuration ```yaml architecture: MistralForCausalLM models: - model: B:\24B\DarkArtsForge--Asmodeus-24B-v1 parameters: weight: - filter: "lm_head" value: 0.0 - filter: "embed_tokens" value: 0.0 - value: 0.125 density: 0.5 epsilon: 0.25 - model: B:\24B\DarkArtsForge--Asmodeus-24B-v2 parameters: weight: - filter: "lm_head" value: 0.0 - filter: "embed_tokens" value: 0.0 - value: 0.125 density: 0.5 epsilon: 0.25 - model: B:\24B\Morax-24B-v2 parameters: weight: - filter: "lm_head" value: 1.0 - filter: "embed_tokens" value: 0.0 - value: 0.125 density: 0.75 epsilon: 0.25 - model: B:\24B\DarkArtsForge--Paimon-24B-v3 parameters: weight: - filter: "lm_head" value: 0.0 - filter: "embed_tokens" value: 0.0 - value: 0.125 density: 0.75 epsilon: 0.25 - model: B:\24B\DarkArtsForge--Zepar-24B-v1 parameters: weight: - filter: "lm_head" value: 0.0 - filter: "embed_tokens" value: 0.0 - value: 0.125 density: 0.75 epsilon: 0.25 - model: B:\24B\DarkArtsForge--Magistaroth-24B-v1 parameters: weight: - filter: "lm_head" value: 0.0 - filter: "embed_tokens" value: 0.0 - value: 0.125 density: 0.75 epsilon: 0.25 - model: B:\24B\!models--Casual-Autopsy--Maginum-Cydoms-24B parameters: weight: - filter: "lm_head" value: 0.0 - filter: "embed_tokens" value: 0.0 - value: 0.125 density: 0.5 epsilon: 0.25 - model: B:\24B\Naphula--GhostFace-24B-v1 parameters: weight: - filter: "lm_head" value: 0.0 - filter: "embed_tokens" value: 0.0 - value: 0.125 density: 0.75 epsilon: 0.25 - model: B:\24B\Naphula--Slimaki-Tavern-24B-v1.3 parameters: weight: - filter: "lm_head" value: 0.0 - filter: "embed_tokens" value: 0.0 - value: 0.125 density: 0.75 epsilon: 0.25 - model: B:\24B\Naphula--Slimaki-24B-v1.2 parameters: weight: - filter: "lm_head" value: 0.0 - filter: "embed_tokens" value: 0.0 - value: 0.125 density: 0.75 epsilon: 0.25 - model: B:\24B\Naphula--Slimaki-24B-v1 parameters: weight: - filter: "lm_head" value: 0.0 - filter: "embed_tokens" value: 0.0 - value: 0.125 density: 0.75 epsilon: 0.25 - model: B:\24B\sophosympatheia--Magistry-24B-v1.0 parameters: weight: - filter: "lm_head" value: 0.0 - filter: "embed_tokens" value: 0.0 - value: 0.125 density: 0.5 epsilon: 0.25 - model: B:\24B\!models--TheDrummer--Precog-24B-v1 parameters: weight: - filter: "lm_head" value: 0.0 - filter: "embed_tokens" value: 0.0 - value: 0.125 density: 0.9 epsilon: 0.09 merge_method: della base_model: A:\LLM\.cache\24B\!models--mistralai--Magistral-Small-2509\textonly parameters: lambda: 1.0 normalize: false int8_mask: false rescale: true dtype: float32 out_dtype: bfloat16 tokenizer: source: base chat_template: auto name: ☠️ Morbid Miasma 24B ``` ### Audit ```bat [DELLA Audit] Layer: model.layers.33.mlp.down_proj.weight | Lambda=1.00 [BASE] textonly !models--Casual-Autopsy--Maginum-Cydoms-24B : ███ 6.5% (W:0.12 D:0.50 N:2.59 E:0.25) !models--TheDrummer--Precog-24B-v1 : 0.9% (W:0.12 D:0.90 N:0.37 E:0.09) DarkArtsForge--Asmodeus-24B-v1 : ███████ 15.5% (W:0.12 D:0.50 N:6.16 E:0.25) DarkArtsForge--Asmodeus-24B-v2 : ██████ 13.5% (W:0.12 D:0.50 N:5.37 E:0.25) DarkArtsForge--Magistaroth-24B-v1 : 0.8% (W:0.12 D:0.75 N:0.34 E:0.25) DarkArtsForge--Paimon-24B-v3 : ████████ 16.5% (W:0.12 D:0.75 N:6.56 E:0.25) DarkArtsForge--Zepar-24B-v1 : ███ 6.4% (W:0.12 D:0.75 N:2.55 E:0.25) Morax-24B-v2 : ██ 4.8% (W:0.12 D:0.75 N:1.91 E:0.25) Naphula--GhostFace-24B-v1 : ██ 5.3% (W:0.12 D:0.75 N:2.10 E:0.25) Naphula--Slimaki-24B-v1 : ████ 8.3% (W:0.12 D:0.75 N:3.31 E:0.25) Naphula--Slimaki-24B-v1.2 : ████ 8.8% (W:0.12 D:0.75 N:3.52 E:0.25) Naphula--Slimaki-Tavern-24B-v1.3 : ███ 7.0% (W:0.12 D:0.75 N:2.77 E:0.25) sophosympatheia--Magistry-24B-v1.0 : ██ 5.6% (W:0.12 D:0.50 N:2.24 E:0.25) ```