Circuit-Aware SAIF-7B
ุณูููู โ "sword" in Arabic
LoRA adapter for Qwen2.5-7B, trained with Circuit-Aware methodology using J-lens (Global Workspace Theory) to reduce hallucinations in security vulnerability analysis.
Training Details
- Base Model: Qwen/Qwen2.5-7B
- Rank: 32
- Iterations: 1000
- Batch Size: 4
- Learning Rate: 1e-5
- Val Loss: 2.051
- Train Loss: 0.043
Dataset
430 Arabic-English security samples across 9 domains: WebApp, Network, Reverse Engineering, Exploitation, Kernel, Browser, Vulnerability Discovery, Bug Bounty, Exploiter
Circuit-Aware Methodology
This adapter was trained using J-lens circuit mapping, which analyzes model activation patterns across 28 transformer layers to identify and strengthen factual reasoning circuits while suppressing hallucination-prone pathways.
Hardware compatibility
Log In to add your hardware
Quantized
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support
Model tree for hayulalab/Circuit-Aware-SAIF-7B
Base model
Qwen/Qwen2.5-7B
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Circuit-Aware-SAIF-7B hayulalab/Circuit-Aware-SAIF-7B