DeathGodlike commited on
Commit
f3a9adb
·
verified ·
1 Parent(s): 55369c7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +153 -153
README.md CHANGED
@@ -1,153 +1,153 @@
1
- ---
2
- base_model:
3
- - Casual-Autopsy/Maginum-Cydoms-24B
4
- base_model_relation: quantized
5
- pipeline_tag: text-generation
6
- library_name: safetensors
7
- tags:
8
- - exl3
9
- - 4-bit
10
- - 6-bit
11
- - 8-bit
12
- ---
13
-
14
- # Original model: [Maginum-Cydoms-24B](https://huggingface.co/Casual-Autopsy/Maginum-Cydoms-24B) by [Casual-Autopsy](https://huggingface.co/Casual-Autopsy)
15
-
16
- ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
17
-
18
- ## Available [ExLlamaV3](https://github.com/turboderp-org/exllamav3) (release v0.0.18) quantizations
19
-
20
- | Type | Size | CLI |
21
- |------|------|---------|
22
- | [H8-4.0BPW](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/tree/H8-4.0BPW) | 13.16 GB | [Copy-paste the line / Download the batch file](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/resolve/H8-4.0BPW/Download~Casual-Autopsy_Maginum-Cydoms-24B_H8-4.0BPW_EXL3.bat) |
23
- | [H8-6.0BPW](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/tree/H8-6.0BPW) | 18.72 GB | [Copy-paste the line / Download the batch file](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/resolve/H8-6.0BPW/Download~Casual-Autopsy_Maginum-Cydoms-24B_H8-6.0BPW_EXL3.bat) |
24
- | [H8-8.0BPW](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/tree/H8-8.0BPW) | 24.27 GB | [Copy-paste the line / Download the batch file](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/resolve/H8-8.0BPW/Download~Casual-Autopsy_Maginum-Cydoms-24B_H8-8.0BPW_EXL3.bat) |
25
-
26
- ***Requirements: A python installation with huggingface-hub module to use CLI.***
27
-
28
- ### Licensing
29
-
30
- License detected: unknown
31
-
32
- The license for the provided quantized models is derived from the original model. For additional information see the original model's page above, or, if unavialable, the files and the page backups below.
33
-
34
- ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
35
-
36
- # Backups
37
-
38
- [Original files](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/tree/original-files)
39
-
40
- <details>
41
- <summary>Original page (click to expand)</summary>
42
-
43
- # Maginum-Cydoms-24B
44
-
45
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
46
-
47
- ## Merge Details
48
- ### Merge Methods
49
-
50
- This model was merged using the following merge methods:
51
- - [TIES](https://arxiv.org/abs/2306.01708)
52
- - [DELLA](https://arxiv.org/abs/2406.11617)
53
- - [SLERP](https://en.wikipedia.org/wiki/Slerp)
54
-
55
- ### Models Merged
56
-
57
- The following models were included in the merge:
58
- - [anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only](https://huggingface.co/anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only)
59
- - [TheDrummer/Magidonia-24B-v4.3](https://huggingface.co/TheDrummer/Magidonia-24B-v4.3)
60
- - [TheDrummer/Precog-24B-v1](https://huggingface.co/TheDrummer/Precog-24B-v1)
61
- - [zerofata/MS3.2-PaintedFantasy-v3-24B](https://huggingface.co/zerofata/MS3.2-PaintedFantasy-v3-24B)
62
- - [TheDrummer/Cydonia-24B-v4.3](https://huggingface.co/TheDrummer/Cydonia-24B-v4.3)
63
- - [ReadyArt/4.2.0-Broken-Tutu-24b](https://huggingface.co/ReadyArt/4.2.0-Broken-Tutu-24b)
64
- - [zerofata/MS3.2-PaintedFantasy-v2-24B](https://huggingface.co/zerofata/MS3.2-PaintedFantasy-v2-24B)
65
-
66
- ### Configuration
67
-
68
- The following YAML configurations were used to produce this model:
69
-
70
- Maginum-Cydoms-S001:
71
- ```yaml
72
- models:
73
- - model: anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only
74
-
75
- - model: TheDrummer/Magidonia-24B-v4.3
76
- parameters:
77
- density: 1.0
78
- weight: 1.0
79
- - model: TheDrummer/Precog-24B-v1
80
- parameters:
81
- density: 0.4
82
- weight: 0.6
83
- - model: zerofata/MS3.2-PaintedFantasy-v3-24B
84
- parameters:
85
- density: 0.4
86
- weight: 0.4
87
-
88
- merge_method: ties
89
- base_model: anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only
90
- parameters:
91
- normalize: false
92
- int8_mask: false
93
- dtype: float32
94
-
95
- tokenizer:
96
- source: union
97
- ```
98
-
99
- Maginum-Cydoms-S002:
100
- ```yaml
101
- models:
102
- - model: anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only
103
-
104
- - model: TheDrummer/Cydonia-24B-v4.3
105
- parameters:
106
- density: 1.0
107
- weight: 1.0
108
- epsilon: 0.0
109
- - model: ReadyArt/4.2.0-Broken-Tutu-24b
110
- parameters:
111
- density: 0.4
112
- weight: 0.6
113
- epsilon: 0.2
114
- - model: zerofata/MS3.2-PaintedFantasy-v2-24B
115
- parameters:
116
- density: 0.4
117
- weight: 0.4
118
- epsilon: 0.2
119
-
120
- merge_method: della
121
- base_model: anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only
122
- parameters:
123
- normalize: false
124
- int8_mask: false
125
- dtype: float32
126
-
127
- tokenizer:
128
- source: union
129
- ```
130
-
131
- ```yaml
132
- models:
133
- - model: Maginum-Cydoms-S001
134
- - model: Maginum-Cydoms-S002
135
-
136
- merge_method: slerp
137
- base_model: Maginum-Cydoms-S001
138
- parameters:
139
- t:
140
- - filter: self_attn
141
- value: [0.3, 0.4, 0.6, 0.4, 0.3, 0.4, 0.6, 0.4, 0.3]
142
- - filter: mlp
143
- value: [0.7, 0.6, 0.4, 0.6, 0.7, 0.6, 0.4, 0.6, 0.7]
144
- - value: 0.5
145
- dtype: float32
146
- out_dtype: bfloat16
147
-
148
- tokenizer:
149
- source: union
150
- ```
151
-
152
- </details>
153
-
 
1
+ ---
2
+ base_model:
3
+ - Casual-Autopsy/Maginum-Cydoms-24B
4
+ base_model_relation: quantized
5
+ pipeline_tag: text-generation
6
+ library_name: safetensors
7
+ tags:
8
+ - exl3
9
+ - 4-bit
10
+ - 6-bit
11
+ - 8-bit
12
+ ---
13
+
14
+ # Original model: [Maginum-Cydoms-24B](https://huggingface.co/Casual-Autopsy/Maginum-Cydoms-24B) by [Casual-Autopsy](https://huggingface.co/Casual-Autopsy)
15
+
16
+ ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
17
+
18
+ ## Available [ExLlamaV3](https://github.com/turboderp-org/exllamav3) (release v0.0.18) quantizations
19
+
20
+ | Type | Size | CLI |
21
+ |------|------|---------|
22
+ | [H8-4.0BPW](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/tree/H8-4.0BPW) | 13.16 GB | [Copy-paste the line / Download the batch file](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/resolve/H8-4.0BPW/Download~Casual-Autopsy_Maginum-Cydoms-24B_H8-4.0BPW_EXL3.bat) |
23
+ | [H8-6.0BPW](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/tree/H8-6.0BPW) | 18.72 GB | [Copy-paste the line / Download the batch file](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/resolve/H8-6.0BPW/Download~Casual-Autopsy_Maginum-Cydoms-24B_H8-6.0BPW_EXL3.bat) |
24
+ | [H8-8.0BPW](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/tree/H8-8.0BPW) | 24.27 GB | [Copy-paste the line / Download the batch file](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/resolve/H8-8.0BPW/Download~Casual-Autopsy_Maginum-Cydoms-24B_H8-8.0BPW_EXL3.bat) |
25
+
26
+ ***Requirements: A python installation with huggingface-hub module to use CLI.***
27
+
28
+ ### Licensing
29
+
30
+ License detected: unknown
31
+
32
+ The license for the provided quantized models is derived from the original model. For additional information see the original model's page above, or, if unavailable, the files and the page backups below.
33
+
34
+ ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
35
+
36
+ # Backups
37
+
38
+ [Original files](https://huggingface.co/DeathGodlike/Maginum-Cydoms-24B_EXL3/tree/original-files)
39
+
40
+ <details>
41
+ <summary>Original page (click to expand)</summary>
42
+
43
+ # Maginum-Cydoms-24B
44
+
45
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
46
+
47
+ ## Merge Details
48
+ ### Merge Methods
49
+
50
+ This model was merged using the following merge methods:
51
+ - [TIES](https://arxiv.org/abs/2306.01708)
52
+ - [DELLA](https://arxiv.org/abs/2406.11617)
53
+ - [SLERP](https://en.wikipedia.org/wiki/Slerp)
54
+
55
+ ### Models Merged
56
+
57
+ The following models were included in the merge:
58
+ - [anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only](https://huggingface.co/anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only)
59
+ - [TheDrummer/Magidonia-24B-v4.3](https://huggingface.co/TheDrummer/Magidonia-24B-v4.3)
60
+ - [TheDrummer/Precog-24B-v1](https://huggingface.co/TheDrummer/Precog-24B-v1)
61
+ - [zerofata/MS3.2-PaintedFantasy-v3-24B](https://huggingface.co/zerofata/MS3.2-PaintedFantasy-v3-24B)
62
+ - [TheDrummer/Cydonia-24B-v4.3](https://huggingface.co/TheDrummer/Cydonia-24B-v4.3)
63
+ - [ReadyArt/4.2.0-Broken-Tutu-24b](https://huggingface.co/ReadyArt/4.2.0-Broken-Tutu-24b)
64
+ - [zerofata/MS3.2-PaintedFantasy-v2-24B](https://huggingface.co/zerofata/MS3.2-PaintedFantasy-v2-24B)
65
+
66
+ ### Configuration
67
+
68
+ The following YAML configurations were used to produce this model:
69
+
70
+ Maginum-Cydoms-S001:
71
+ ```yaml
72
+ models:
73
+ - model: anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only
74
+
75
+ - model: TheDrummer/Magidonia-24B-v4.3
76
+ parameters:
77
+ density: 1.0
78
+ weight: 1.0
79
+ - model: TheDrummer/Precog-24B-v1
80
+ parameters:
81
+ density: 0.4
82
+ weight: 0.6
83
+ - model: zerofata/MS3.2-PaintedFantasy-v3-24B
84
+ parameters:
85
+ density: 0.4
86
+ weight: 0.4
87
+
88
+ merge_method: ties
89
+ base_model: anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only
90
+ parameters:
91
+ normalize: false
92
+ int8_mask: false
93
+ dtype: float32
94
+
95
+ tokenizer:
96
+ source: union
97
+ ```
98
+
99
+ Maginum-Cydoms-S002:
100
+ ```yaml
101
+ models:
102
+ - model: anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only
103
+
104
+ - model: TheDrummer/Cydonia-24B-v4.3
105
+ parameters:
106
+ density: 1.0
107
+ weight: 1.0
108
+ epsilon: 0.0
109
+ - model: ReadyArt/4.2.0-Broken-Tutu-24b
110
+ parameters:
111
+ density: 0.4
112
+ weight: 0.6
113
+ epsilon: 0.2
114
+ - model: zerofata/MS3.2-PaintedFantasy-v2-24B
115
+ parameters:
116
+ density: 0.4
117
+ weight: 0.4
118
+ epsilon: 0.2
119
+
120
+ merge_method: della
121
+ base_model: anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only
122
+ parameters:
123
+ normalize: false
124
+ int8_mask: false
125
+ dtype: float32
126
+
127
+ tokenizer:
128
+ source: union
129
+ ```
130
+
131
+ ```yaml
132
+ models:
133
+ - model: Maginum-Cydoms-S001
134
+ - model: Maginum-Cydoms-S002
135
+
136
+ merge_method: slerp
137
+ base_model: Maginum-Cydoms-S001
138
+ parameters:
139
+ t:
140
+ - filter: self_attn
141
+ value: [0.3, 0.4, 0.6, 0.4, 0.3, 0.4, 0.6, 0.4, 0.3]
142
+ - filter: mlp
143
+ value: [0.7, 0.6, 0.4, 0.6, 0.7, 0.6, 0.4, 0.6, 0.7]
144
+ - value: 0.5
145
+ dtype: float32
146
+ out_dtype: bfloat16
147
+
148
+ tokenizer:
149
+ source: union
150
+ ```
151
+
152
+ </details>
153
+