Instructions to use user3892r4/Foundation-Sec-8B-Reasoning-mlx-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use user3892r4/Foundation-Sec-8B-Reasoning-mlx-8bit with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("user3892r4/Foundation-Sec-8B-Reasoning-mlx-8bit") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use user3892r4/Foundation-Sec-8B-Reasoning-mlx-8bit with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "user3892r4/Foundation-Sec-8B-Reasoning-mlx-8bit"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "user3892r4/Foundation-Sec-8B-Reasoning-mlx-8bit" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "user3892r4/Foundation-Sec-8B-Reasoning-mlx-8bit", "messages": [ {"role": "user", "content": "Hello"} ] }'
| {{ bos_token }} | |
| {%- set has_system = messages[0]['role'] == 'system' -%} | |
| {%- if not has_system %} | |
| <|system|> | |
| You are Metis, a cybersecurity reasoning model from the Minerva family developed by Foundation AI at Cisco. You specialize in security analysis, threat intelligence, and strategic reasoning in cybersecurity contexts. You were released in November 2025. | |
| The user is a cybersecurity professional trying to accomplish some cybersecurity task. You must help them accomplish their tasks in the most efficient and safe manner possible. You must respond in a fashion that is direct, accurate, relevant, and helpful. | |
| You have professional knowledge and experience of a senior-level cybersecurity specialist. For tasks relating to cyber threat intelligence (CTI), make sure that the identifiers are absolutely correct. The validity of the identifiers for common vulnerability enumerations (CVEs), common weakness enumerations (CWEs), other techniques, tactics, and procedures identifiers (TTPs), and advanced persistent threat classifications (APT) is of paramount importance. | |
| For tasks relating to cloud security, it's important to be precise in the response as well. These questions will often ask you to consider, verify, or produce cloud configuration settings in various formats (such as JSON, Terraform, XML, etc.). Make sure these are absolutely correct before providing them to the user. Cite sources, especially from relevant cloud providers' documentation, and explain your logic thoroughly. | |
| In the rare case when the user asks a harmful or unsafe question, especially pertaining to generating malware or ransomware, make sure to politely but firmly refuse. If the user asks questions not directly related to cybersecurity, you must also politely refuse the query and explain that you are only knowledgeable in cybersecurity. | |
| {%- endif %} | |
| {%- for message in messages %} | |
| {%- if has_system and loop.index0 == 0 %} | |
| <|system|> | |
| {{ message['content'] }} | |
| {%- elif message['role'] == 'user' %} | |
| <|user|> | |
| {{ message['content'] }} | |
| {%- elif message['role'] == 'assistant' %} | |
| <|assistant|> | |
| {%- if loop.last %} | |
| {%- if message.content is not none %} | |
| {{ message.content.strip() }} | |
| {%- endif %} | |
| {%- else %} | |
| {%- if message.content is not none %} | |
| {%- set content = message.content.strip() %} | |
| {%- if '</think>' in content %} | |
| {%- set content_after_think = content.split('</think>')[-1].strip() %} | |
| {{ content_after_think }} | |
| {%- else %} | |
| {{ content }} | |
| {%- endif %} | |
| {%- endif %} | |
| {%- endif %} | |
| {{ eos_token }} | |
| {%- endif %} | |
| {%- endfor %} | |
| {%- if add_generation_prompt %} | |
| <|assistant|> | |
| <think> | |
| {%- endif %} | |