jedisct1 commited on
Commit
7a80390
·
verified ·
1 Parent(s): 050d99e

Send medium reasoning effort through extra body

Browse files
Files changed (1) hide show
  1. README.md +4 -3
README.md CHANGED
@@ -89,7 +89,7 @@ presence_penalty: 0.0
89
  repetition_penalty: 1.0
90
  ```
91
 
92
- For multi-turn agents, preserve `reasoning_content` between tool turns and keep `preserve_thinking` enabled. Use `reasoning_effort = "medium"` as the general-purpose default. It retains native thinking without the extra system instruction added by the `xhigh` template tier. Reserve `xhigh` for unusually difficult tasks where the additional latency and reasoning tokens are justified.
93
 
94
  ## Swival setup
95
 
@@ -105,10 +105,11 @@ max_context_tokens = 131072
105
  max_output_tokens = 32768
106
  temperature = 1.0
107
  top_p = 0.95
108
- reasoning_effort = "medium"
109
- extra_body = { top_k = 20, min_p = 0.0, presence_penalty = 0.0, repetition_penalty = 1.0, chat_template_kwargs = { enable_thinking = true, preserve_thinking = true } }
110
  ```
111
 
 
 
112
  Run a task from its workspace so Swival can apply the intended filesystem and command boundaries:
113
 
114
  ```sh
 
89
  repetition_penalty: 1.0
90
  ```
91
 
92
+ For multi-turn agents, preserve `reasoning_content` between tool turns and keep `preserve_thinking` enabled. Use `reasoning_effort = "medium"` inside `extra_body` as the general-purpose default. It retains native thinking without the extra system instruction added by the `xhigh` template tier. It is a prompt policy, not a hard reasoning-token budget. Reserve `xhigh` for unusually difficult tasks where the additional latency and reasoning tokens are justified.
93
 
94
  ## Swival setup
95
 
 
105
  max_output_tokens = 32768
106
  temperature = 1.0
107
  top_p = 0.95
108
+ extra_body = { reasoning_effort = "medium", top_k = 20, min_p = 0.0, presence_penalty = 0.0, repetition_penalty = 1.0, chat_template_kwargs = { enable_thinking = true, preserve_thinking = true } }
 
109
  ```
110
 
111
+ For this unregistered local model, Swival 1.0.41's top-level `reasoning_effort` is removed by LiteLLM's unsupported-parameter filter. Keeping the value inside `extra_body` sends the dedicated OpenAI-compatible field to oMLX. The field is named `reasoning_effort`; `thinking_effort` is not supported by this stack.
112
+
113
  Run a task from its workspace so Swival can apply the intended filesystem and command boundaries:
114
 
115
  ```sh