Transformers
GGUF
Spanish
English
axolotl
Generated from Trainer
llama-cpp
1b
4-bit precision
nsfw
koboldcpp
sillytavern
llama3.2
rp
roleplay
Not-For-All-Audiences
imatrix
Novaciano commited on
Commit
4aed78f
·
verified ·
1 Parent(s): cbd0a58

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -44
README.md CHANGED
@@ -4,7 +4,7 @@ tags:
4
  - axolotl
5
  - generated_from_trainer
6
  - llama-cpp
7
- - gguf-my-repo
8
  datasets:
9
  - ChaoticNeutrals/Luminous_Opus
10
  - ChaoticNeutrals/Synthetic-Dark-RP
@@ -13,48 +13,10 @@ base_model: mrcuddle/Tiny-Darkllama3.2-1B-Instruct
13
  model-index:
14
  - name: Tiny-Darkllama3.2-1B-Instruct
15
  results: []
 
 
 
 
16
  ---
17
 
18
- # Novaciano/Tiny-Darkllama3.2-1B-Instruct-Q5_K_M-GGUF
19
- This model was converted to GGUF format from [`mrcuddle/Tiny-Darkllama3.2-1B-Instruct`](https://huggingface.co/mrcuddle/Tiny-Darkllama3.2-1B-Instruct) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
20
- Refer to the [original model card](https://huggingface.co/mrcuddle/Tiny-Darkllama3.2-1B-Instruct) for more details on the model.
21
-
22
- ## Use with llama.cpp
23
- Install llama.cpp through brew (works on Mac and Linux)
24
-
25
- ```bash
26
- brew install llama.cpp
27
-
28
- ```
29
- Invoke the llama.cpp server or the CLI.
30
-
31
- ### CLI:
32
- ```bash
33
- llama-cli --hf-repo Novaciano/Tiny-Darkllama3.2-1B-Instruct-Q5_K_M-GGUF --hf-file tiny-darkllama3.2-1b-instruct-q5_k_m-imat.gguf -p "The meaning to life and the universe is"
34
- ```
35
-
36
- ### Server:
37
- ```bash
38
- llama-server --hf-repo Novaciano/Tiny-Darkllama3.2-1B-Instruct-Q5_K_M-GGUF --hf-file tiny-darkllama3.2-1b-instruct-q5_k_m-imat.gguf -c 2048
39
- ```
40
-
41
- Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
42
-
43
- Step 1: Clone llama.cpp from GitHub.
44
- ```
45
- git clone https://github.com/ggerganov/llama.cpp
46
- ```
47
-
48
- Step 2: Move into the llama.cpp folder and build it with `LLAMA_CURL=1` flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).
49
- ```
50
- cd llama.cpp && LLAMA_CURL=1 make
51
- ```
52
-
53
- Step 3: Run inference through the main binary.
54
- ```
55
- ./llama-cli --hf-repo Novaciano/Tiny-Darkllama3.2-1B-Instruct-Q5_K_M-GGUF --hf-file tiny-darkllama3.2-1b-instruct-q5_k_m-imat.gguf -p "The meaning to life and the universe is"
56
- ```
57
- or
58
- ```
59
- ./llama-server --hf-repo Novaciano/Tiny-Darkllama3.2-1B-Instruct-Q5_K_M-GGUF --hf-file tiny-darkllama3.2-1b-instruct-q5_k_m-imat.gguf -c 2048
60
- ```
 
4
  - axolotl
5
  - generated_from_trainer
6
  - llama-cpp
7
+ - not-for-all-audiences
8
  datasets:
9
  - ChaoticNeutrals/Luminous_Opus
10
  - ChaoticNeutrals/Synthetic-Dark-RP
 
13
  model-index:
14
  - name: Tiny-Darkllama3.2-1B-Instruct
15
  results: []
16
+ license: apache-2.0
17
+ language:
18
+ - es
19
+ - en
20
  ---
21
 
22
+ # Darkllama3.2 1B RPGateway School