lancejames221b commited on
Commit
b6c7dbd
·
verified ·
1 Parent(s): 874da54

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +13 -1
README.md CHANGED
@@ -88,11 +88,23 @@ Because the dominant donor is reasoning-derived, RazorStrike-v1 can produce long
88
 
89
  **llama.cpp:**
90
  ```bash
91
- llama-server -hf lancejames221b/razorstrike-v1-GGUF --port 8080
92
  # or, if downloaded locally:
93
  llama-server -m razorstrike-v1-Q4_K_M.gguf --port 8080 -c 32768
94
  ```
95
 
 
 
 
 
 
 
 
 
 
 
 
 
96
  **Ollama:**
97
  ```bash
98
  ollama pull hf.co/lancejames221b/razorstrike-v1-GGUF
 
88
 
89
  **llama.cpp:**
90
  ```bash
91
+ llama-server -hf lancejames221b/razorstrike-v1-GGUF:Q4_K_M --port 8080
92
  # or, if downloaded locally:
93
  llama-server -m razorstrike-v1-Q4_K_M.gguf --port 8080 -c 32768
94
  ```
95
 
96
+ Then query it with the recommended settings and a "think fast" system prompt:
97
+ ```bash
98
+ curl http://localhost:8080/v1/chat/completions -H "Content-Type: application/json" -d '{
99
+ "messages": [
100
+ {"role": "system", "content": "Think fast, not long - a few sentences of reasoning at most, then answer directly."},
101
+ {"role": "user", "content": "Write a Python function that reverses a linked list."}
102
+ ],
103
+ "temperature": 0.6, "top_p": 0.95, "top_k": 20, "min_p": 0.0,
104
+ "max_tokens": 1024
105
+ }'
106
+ ```
107
+
108
  **Ollama:**
109
  ```bash
110
  ollama pull hf.co/lancejames221b/razorstrike-v1-GGUF