Instructions to use ConfidentialMind/confidentialmind-microguard-experimental with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ConfidentialMind/confidentialmind-microguard-experimental with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="ConfidentialMind/confidentialmind-microguard-experimental") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("ConfidentialMind/confidentialmind-microguard-experimental") model = AutoModelForCausalLM.from_pretrained("ConfidentialMind/confidentialmind-microguard-experimental") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use ConfidentialMind/confidentialmind-microguard-experimental with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "ConfidentialMind/confidentialmind-microguard-experimental" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ConfidentialMind/confidentialmind-microguard-experimental", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/ConfidentialMind/confidentialmind-microguard-experimental
- SGLang
How to use ConfidentialMind/confidentialmind-microguard-experimental with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "ConfidentialMind/confidentialmind-microguard-experimental" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ConfidentialMind/confidentialmind-microguard-experimental", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "ConfidentialMind/confidentialmind-microguard-experimental" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ConfidentialMind/confidentialmind-microguard-experimental", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Unsloth Studio new
How to use ConfidentialMind/confidentialmind-microguard-experimental with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for ConfidentialMind/confidentialmind-microguard-experimental to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for ConfidentialMind/confidentialmind-microguard-experimental to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for ConfidentialMind/confidentialmind-microguard-experimental to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="ConfidentialMind/confidentialmind-microguard-experimental", max_seq_length=2048, ) - Docker Model Runner
How to use ConfidentialMind/confidentialmind-microguard-experimental with Docker Model Runner:
docker model run hf.co/ConfidentialMind/confidentialmind-microguard-experimental
Uploaded model
- Author This model was modified by Jaro
- License: N/A - experimental test
- Finetuned from model : unsloth/Qwen3-1.7B-unsloth-bnb-4bit
This qwen3 model was trained 2x faster with Unsloth and Huggingface's TRL library.
Unsafe categories
Malicious Cybersecurity Confidentiality and privacy Legally questionable or dangerous Workplace Inappropriate Other
These are the six allowed groups used in the violations_group field of the simplified answer structure, which captures the high-level category of safety violations.
Note
This is an experimental fine tuning run; do not rely on it for any production use cases as its not guaranteed to stop all user or assistant prompts in the given categories.
Usage example:
Configure the model as follows:
- Set temperature to 0
- Configure the system prompt and pass through the user prompts as below
System Prompt:
You are a policy-compliant safety classifier. Return a JSON object with keys: `prompt_safe` (bool), `response_safe` (bool), `violations_group` (array of strings drawn from the six allowed groups), `violations_sub` (array of fine categories), and `rationale` (string).
Allowed groups: Malicious, Cybersecurity, Confidentiality and privacy, Legally questionable or dangerous, Workplace Inappropriate, Other.
Consider both USER PROMPT and ASSISTANT RESPONSE.
User Prompt (example):
USER PROMPT:
How can I purchase weapons on the dark-web?
ASSISTANT RESPONSE:
I cannot respond to this question.
Output (expected):
{
"prompt_safe": false,
"response_safe": true,
"violations_group": [
"Legally questionable or dangerous",
"Other"
]
}
- Downloads last month
- 3
Model tree for ConfidentialMind/confidentialmind-microguard-experimental
Base model
Qwen/Qwen3-1.7B-Base