Hugging Face's logo

keyvan-ai
/
Mankei-1B-Chat-GGUF

Text Generation
GGUF
German
English
llama
german
deutsch
cpu
ollama
llama.cpp
conversational
Model card Files
xet
 Community
Keyven commited on
Commit
4f6a851
·
0 Parent(s):

Initial commit

Browse files
Files changed (9) hide show
  1. .gitattributes +42 -0
  2. Mankei-1B-Chat-f16.gguf +3 -0
  3. Mankei-1B-Chat-q3_k_m.gguf +3 -0
  4. Mankei-1B-Chat-q4_k_m.gguf +3 -0
  5. Mankei-1B-Chat-q5_k_m.gguf +3 -0
  6. Mankei-1B-Chat-q6_k.gguf +3 -0
  7. Mankei-1B-Chat-q8_0.gguf +3 -0
  8. README.md +42 -0
  9. mankei-logo.png +3 -0
.gitattributes ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Mankei-1B-Chat-f16.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Mankei-1B-Chat-q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Mankei-1B-Chat-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Mankei-1B-Chat-q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Mankei-1B-Chat-q6_k.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Mankei-1B-Chat-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
42
+ mankei-logo.png filter=lfs diff=lfs merge=lfs -text
Mankei-1B-Chat-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c411f0a50231c184f6b4f784c301c02effeca9deab4c105f8f88c71f7243e63b
3
+ size 2027486048
Mankei-1B-Chat-q3_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c5bb5f463bcced3ed01b2aad7af9245cb37bbe80dbe5ca80f325e03ddc5fe87
3
+ size 536730464
Mankei-1B-Chat-q4_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e984cb231382a7b45a3d66d18056077f5633d12cf798e11e374b47f8381d8d9c
3
+ size 667425632
Mankei-1B-Chat-q5_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c704fc0e25114ecbd35c77069b898568437a258abe2c7de8510566bcb35dc635
3
+ size 762387296
Mankei-1B-Chat-q6_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f48ceb61e5cbcc80a130686c289c0d23a1491c87ac084abe6ea5e41ddc45bb98
3
+ size 895023968
Mankei-1B-Chat-q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:78d318b76ea9d6c038ef92f8cbe1ef8bab93d2a902120f372bfa80ec57449f59
3
+ size 1077869408
README.md ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: keyvan-ai/Mankei-1B-Chat
3
+ base_model_relation: quantized
4
+ license: apache-2.0
5
+ language:
6
+ - de
7
+ - en
8
+ pipeline_tag: text-generation
9
+ tags:
10
+ - gguf
11
+ - llama
12
+ - german
13
+ - deutsch
14
+ - cpu
15
+ - ollama
16
+ - llama.cpp
17
+ ---
18
+
19
+ <p align="center"><img src="mankei-logo.png" width="200" alt="Mankei"></p>
20
+
21
+ # Mankei-1B-Chat — GGUF
22
+
23
+ GGUF-Quantisierungen von **[keyvan-ai/Mankei-1B-Chat](https://huggingface.co/keyvan-ai/Mankei-1B-Chat)** für **llama.cpp** und **Ollama** — läuft auf der CPU.
24
+
25
+ | Quantisierung | Größe | Download |
26
+ |---|---|---|
27
+ | f16 | 1,9 GB | [Mankei-1B-Chat-f16.gguf](https://huggingface.co/keyvan-ai/Mankei-1B-Chat-GGUF/blob/main/Mankei-1B-Chat-f16.gguf) |
28
+ | Q8_0 | 1,0 GB | [Mankei-1B-Chat-q8_0.gguf](https://huggingface.co/keyvan-ai/Mankei-1B-Chat-GGUF/blob/main/Mankei-1B-Chat-q8_0.gguf) |
29
+ | Q6_K | 854 MB | [Mankei-1B-Chat-q6_k.gguf](https://huggingface.co/keyvan-ai/Mankei-1B-Chat-GGUF/blob/main/Mankei-1B-Chat-q6_k.gguf) |
30
+ | Q5_K_M | 727 MB | [Mankei-1B-Chat-q5_k_m.gguf](https://huggingface.co/keyvan-ai/Mankei-1B-Chat-GGUF/blob/main/Mankei-1B-Chat-q5_k_m.gguf) |
31
+ | Q4_K_M | 637 MB | [Mankei-1B-Chat-q4_k_m.gguf](https://huggingface.co/keyvan-ai/Mankei-1B-Chat-GGUF/blob/main/Mankei-1B-Chat-q4_k_m.gguf) |
32
+ | Q3_K_M | 512 MB | [Mankei-1B-Chat-q3_k_m.gguf](https://huggingface.co/keyvan-ai/Mankei-1B-Chat-GGUF/blob/main/Mankei-1B-Chat-q3_k_m.gguf) |
33
+
34
+ ```bash
35
+ # Ollama
36
+ ollama run hf.co/keyvan-ai/Mankei-1B-Chat-GGUF:Q4_K_M
37
+
38
+ # llama.cpp
39
+ llama-cli -hf keyvan-ai/Mankei-1B-Chat-GGUF:Q4_K_M
40
+ ```
41
+
42
+ Empfohlenes Sampling: `temperature 0.7 · top_p 0.9 · repetition_penalty 1.15`.
mankei-logo.png ADDED

Git LFS Details

  • SHA256: f85cdf24546aa53c14aa1dae1f00bd383470744374ddcadc05482e7e147bd456
  • Pointer size: 131 Bytes
  • Size of remote file: 415 kB