--- license: llama3.3 base_model_relation: quantized tags: - finetune - roleplay - chat - wings-of-fire - nsfw - not-for-all-audiences base_model: - Darkhn/L3.3-70B-Animus-V12.5 ---
Send me your support to help me feed the data beast! also taking comissions for universe specific models
Support on Ko-fiThis model uses the Llama 3 instruction template. Ensure your client is configured correctly to avoid degraded performance.
Human-Readable Format:
<|start_header_id|>system<|end_header_id|>\n\n[SYSTEM_PROMPT]<|eot_id|><|start_header_id|>user<|end_header_id|>\n\n[USER_MESSAGE]<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n
Jinja Template:
{{- bos_token }}{%- if custom_tools is defined %}{%- set tools = custom_tools %}{%- endif %}{%- if not tools_in_user_message is defined %}{%- set tools_in_user_message = true %}{%- endif %}{%- if not date_string is defined %}{%- set date_string = "26 Jul 2024" %}{%- endif %}{%- if not tools is defined %}{%- set tools = none %}{%- endif %}{%- if messages[0]['role'] == 'system' %}{%- set system_message = messages[0]['content']|trim %}{%- set messages = messages[1:] %}{%- else %}{%- set system_message = "" %}{%- endif %}{{- "<|start_header_id|>system<|end_header_id|>\n\n" }}{%- if builtin_tools is defined or tools is not none %}{{- "Environment: ipython\n" }}{%- endif %}{%- if builtin_tools is defined %}{{- "Tools: " + builtin_tools | reject('equalto', 'code_interpreter') | join(", ") + "\n\n"}}{%- endif %}{{- "Cutting Knowledge Date: December 2023\n" }}{{- "Today Date: " + date_string + "\n\n" }}{%- if tools is not none and not tools_in_user_message %}{{- "You have access to the following functions. To call a function, please respond with JSON for a function call." }}{{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}{{- "Do not use variables.\n\n" }}{%- for t in tools %}{{- t | tojson(indent=4) }}{{- "\n\n" }}{%- endfor %}{%- endif %}{{- system_message }}{{- "<|eot_id|>" }}{%- if tools_in_user_message and not tools is none %}{%- if messages | length != 0 %}{%- set first_user_message = messages[0]['content']|trim %}{%- set messages = messages[1:] %}{%- else %}{{- raise_exception("Cannot put tools in the first user message when there's no first user message!") }}{%- endif %}{{- '<|start_header_id|>user<|end_header_id|>\n\n' -}}{{- "Given the following functions, please respond with a JSON for a function call " }}{{- "with its proper arguments that best answers the given prompt.\n\n" }}{{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}{{- "Do not use variables.\n\n" }}{%- for t in tools %}{{- t | tojson(indent=4) }}{{- "\n\n" }}{%- endfor %}{{- first_user_message + "<|eot_id|>"}}{%- endif %}{%- for message in messages %}{%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %}{{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' }}{%- elif 'tool_calls' in message %}{%- if not message.tool_calls|length == 1 %}{{- raise_exception("This model only supports single tool-calls at once!") }}{%- endif %}{%- set tool_call = message.tool_calls[0].function %}{%- if builtin_tools is defined and tool_call.name in builtin_tools %}{{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}{{- "<|python_tag|>" + tool_call.name + ".call(" }}{%- for arg_name, arg_val in tool_call.arguments | items %}{{- arg_name + '="' + arg_val + '"' }}{%- if not loop.last %}{{- ", " }}{%- endif %}{%- endfor %}{{- ")" }}{%- else %}{{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}{{- '{"name": "' + tool_call.name + '", ' }}{{- '"parameters": ' }}{{- tool_call.arguments | tojson }}{{- "}" }}{%- endif %}{%- if builtin_tools is defined %}{{- "<|eom_id|>" }}{%- else %}{{- "<|eot_id|>" }}{%- endif %}{%- elif message.role == "tool" or message.role == "ipython" %}{{- "<|start_header_id|>ipython<|end_header_id|>\n\n" }}{%- if message.content is mapping or message.content is iterable %}{{- message.content | tojson }}{%- else %}{{- message.content }}{%- endif %}{{- "<|eot_id|>" }}{%- endif %}{%- endfor %}{%- if add_generation_prompt %}{{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }}{%- endif %}
The quantized model files are available for download. Click the buttons below to view the files.
Download GGUF Files → Download compressed-tensors for vLLM →You can download specific model quantizations using the Hugging Face Command Line Interface (CLI). This allows you to select the exact version you need.
1. Install huggingface-hub with CLI support:
pip install -U "huggingface_hub[cli]"
2. Download a specific quant:
Use the command below, replacing "4.5bpw_H6" with the desired model version from the repository's branches.
huggingface-cli download Darkhn-Quants-2/L3.3-70B-Animus-V12.5-EXL3 --revision "6.0bpw_H6" --local-dir ./L3.3-70B-Animus-V12.5-EXL3
Browse All Branches →
For the best roleplaying experience, it is highly recommended to use the provided character card and lore book. These files help guide the model's persona and provide rich, in-universe context.
Download Files →For a seamless setup in SillyTavern, you can download pre-configured sampler presets. These are tuned to provide an optimal balance between creativity and narrative coherence for this model.
Simply download the .json file below and import it into SillyTavern's sampler presets menu.
Temp: 1
Min P: 0.02
Dry: 0.8 , 1.75, 4
For the best results, use this structured format. This helps the AI clearly distinguish between actions, inner thoughts, and dialogue.
*He walked across the room and stared out the window.**-I wonder what she's thinking.-*Alex (Curious): "What do you see out there?"Standard novel-style formatting is also understood, but this structured format is preferred for clarity.
Click the button below to view a full, unedited chatlog demonstrating the model's narrative style and character portrayal.
View Chatlog Example →This is Version 12.5, in the Animus series. V12.5 is a direct fine-tune of kldzj/Llama-3.3-70B-Instruct-heretic.
V12.5's strength comes from a novel dataset designed to teach the model the why behind the lore, not just the what. The training data is a mix of:
The result is a model with exceptionally strong prose and a deep grasp of in-universe lore, making for a highly immersive and accurate roleplaying experience.
Note for roleplay, it follows system prompt and first message, meaning if the first assistant message is short, the following messages will be short.
V12.5 marks a shift from model merging to a focused, direct fine-tuning approach. This allows for greater control over the final model's characteristics.
The V12.5 dataset consists of 6,000 high-quality examples, a combination of two distinct types:
Both datasets underwent a rigorous cleaning process to remove formatting artifacts, such as **scene transitions**, resulting in a cleaner and more natural narrative style.
**scene transitions**. The model should now produce cleaner prose.