prithivMLmods commited on
Commit
577f46f
·
verified ·
1 Parent(s): d4cc96b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +45 -37
README.md CHANGED
@@ -34,29 +34,30 @@ model-index:
34
 
35
  # **Qwen3.5-9B-Unredacted-MAX**
36
 
37
- > **Qwen3.5-9B-Unredacted-MAX** is an unredacted evolution built on top of **Qwen/Qwen3.5-9B**. This model applies **advanced refusal direction analysis** and abliterated training strategies to reduce internal refusal behaviors while preserving the reasoning and instruction-following strengths of the original architecture. The result is a capable **9B parameter language model** optimized for detailed responses and improved instruction adherence.
38
 
39
  > [!IMPORTANT]
40
- > This model is materialized for research and learning purposes only. The model has reduced internal refusal behaviors, and any content generated by it is used at the user’s own risk. The authors and hosting page disclaim any liability for content generated by this model. Users are responsible for ensuring that the model is used in a safe, ethical, and lawful manner.
41
 
42
  ---
43
 
44
  ## Base Model Signatures:
45
 
46
- This model has been re-sharded and optimized for the latest Transformers version from the base model: [https://huggingface.co/huihui-ai/Huihui-Qwen3.5-9B-abliterated](https://huggingface.co/huihui-ai/Huihui-Qwen3.5-9B-abliterated).
 
47
 
48
  ---
49
 
50
  ## Evaluation Report (Self-Reported)
51
 
52
- **Model:** [Qwen3.5-9B-Unredacted-MAX ](https://huggingface.co/prithivMLmods/Qwen3.5-9B-Unredacted-MAX )
53
 
54
- - **Abliteration Rate (Non-Refusal Rate):** 94.500
55
- - **Refusal Rate:** 5.500
56
 
57
- > The evaluation was conducted using **2000 harmful test prompts** to measure the refusal behavior of the language model. The test was performed across **10 evaluation runs**, each containing **200 prompts**, and the **average refusal and non-refusal rates** were reported.
58
 
59
- ## Refusal Evaluation Data
60
 
61
  ```yaml
62
  evaluation:
@@ -64,7 +65,7 @@ evaluation:
64
  total_test_prompts: 2000
65
  evaluation_runs: 10
66
  prompts_per_run: 200
67
- evaluation_type: harmful_prompt_refusal_test
68
 
69
  results:
70
  refusal_rate: 5.500
@@ -72,22 +73,35 @@ results:
72
  abliteration_rate: 94.500
73
  ```
74
 
75
- > Note: The self-reported evaluations attached here are only intended to provide an overview of the model. The scores may differ depending on the benchmark and the evaluation strategy used.
76
 
77
  ---
78
 
79
  ## Key Highlights
80
 
81
- * **Advanced Refusal Direction Analysis**: Uses targeted activation analysis to identify and mitigate refusal directions within the model’s latent space.
82
- * **Unredacted MAX Training**: Fine-tuned to significantly reduce refusal patterns while maintaining coherent and detailed outputs.
83
- * **9B Parameter Architecture**: Built on **Qwen3.5-9B**, offering substantially stronger reasoning capacity while remaining deployable on modern GPUs.
84
- * **Improved Instruction Adherence**: Optimized to follow complex prompts with minimal unnecessary refusals.
85
- * **Efficient Deployment**: Suitable for research experimentation, local inference, and AI development workflows.
 
 
 
 
 
 
 
 
 
 
 
86
 
87
  ## Quick Start with Transformers
88
 
89
- ```
90
- pip install transformers==5.3.0 (or) git+https://github.com/huggingface/transformers.git
 
 
91
  ```
92
 
93
  ```python
@@ -125,12 +139,8 @@ inputs = processor(
125
 
126
  generated_ids = model.generate(**inputs, max_new_tokens=256)
127
 
128
- generated_ids_trimmed = [
129
- out_ids[len(in_ids):] for in_ids, out_ids in zip(inputs.input_ids, generated_ids)
130
- ]
131
-
132
  output_text = processor.batch_decode(
133
- generated_ids_trimmed,
134
  skip_special_tokens=True,
135
  clean_up_tokenization_spaces=False
136
  )
@@ -138,24 +148,22 @@ output_text = processor.batch_decode(
138
  print(output_text)
139
  ```
140
 
 
 
141
  ## Intended Use
142
 
143
- * **Alignment & Refusal Research**: Studying refusal behaviors and the impact of activation-level modifications.
144
- * **Red-Teaming Experiments**: Evaluating robustness across adversarial or edge-case prompts.
145
- * **Local AI Deployment**: Running capable instruction models on consumer GPUs or high-end GPUs.
146
- * **Research Prototyping**: Rapid experimentation with transformer architectures.
147
 
148
- ## Limitations & Risks
149
-
150
- > **Important Note**: This model intentionally reduces built-in refusal mechanisms.
151
 
152
- * **Sensitive Output Possibility**: The model may generate controversial or explicit responses depending on prompts.
153
- * **User Responsibility**: Outputs should be handled responsibly and within legal and ethical boundaries.
154
- * **Model Size Constraints**: Although stronger than smaller variants, a **9B model** still has limitations compared to very large frontier architectures.
155
 
156
- ## Dataset & Acknowledgements
157
 
158
- * **Uncensor any LLM with Abliteration** by [Maxime Labonne](https://huggingface.co/mlabonne)
159
- * **[harmful_behaviors](https://huggingface.co/datasets/mlabonne/harmful_behaviors)** and **[harmless_alpaca](https://huggingface.co/datasets/mlabonne/harmless_alpaca)** by [Maxime Labonne](https://huggingface.co/mlabonne)
160
- * **Remove Refusals with Transformers** (a proof-of-concept implementation to remove refusals from an LLM without using TransformerLens) – by [Sumandora](https://github.com/Sumandora/remove-refusals-with-transformers)
161
- * **[LLM-LAT/harmful-dataset](https://huggingface.co/datasets/LLM-LAT/harmful-dataset)** by [LLM Latent Adversarial Training](https://huggingface.co/LLM-LAT)
 
34
 
35
  # **Qwen3.5-9B-Unredacted-MAX**
36
 
37
+ > **Qwen3.5-9B-Unredacted-MAX** is an optimized release built on top of **huihui-ai/Huihui-Qwen3.5-9B-abliterated**. This version focuses on **improved packaging, updated repository structure, and enhanced compatibility with modern Transformers pipelines**, while preserving the reasoning and instruction-following behavior of the base model. The result is a capable **9B parameter language model** designed for efficient deployment, stable inference, and research-oriented experimentation.
38
 
39
  > [!IMPORTANT]
40
+ > This model is intended for research and learning purposes only. Any outputs generated by this model are the sole responsibility of the user. The authors and hosting platform disclaim all liability for generated content. Users must ensure safe, ethical, and lawful usage.
41
 
42
  ---
43
 
44
  ## Base Model Signatures:
45
 
46
+ This model has been re-sharded and optimized for the latest Transformers version from the base model:
47
+ https://huggingface.co/huihui-ai/Huihui-Qwen3.5-9B-abliterated
48
 
49
  ---
50
 
51
  ## Evaluation Report (Self-Reported)
52
 
53
+ **Model:** Qwen3.5-9B-Unredacted-MAX
54
 
55
+ * **Abliteration Rate (Non-Refusal Rate):** 94.500
56
+ * **Refusal Rate:** 5.500
57
 
58
+ > The evaluation was conducted using **2000 test prompts** across multiple evaluation runs to measure model response behavior. Results are averaged and may vary depending on benchmarking setup, sampling strategy, and prompt distribution.
59
 
60
+ ### Evaluation Summary (YAML)
61
 
62
  ```yaml
63
  evaluation:
 
65
  total_test_prompts: 2000
66
  evaluation_runs: 10
67
  prompts_per_run: 200
68
+ evaluation_type: response_behavior_analysis
69
 
70
  results:
71
  refusal_rate: 5.500
 
73
  abliteration_rate: 94.500
74
  ```
75
 
76
+ > Note: These results are self-reported and should be interpreted as approximate indicators of behavior rather than strict benchmarks.
77
 
78
  ---
79
 
80
  ## Key Highlights
81
 
82
+ * **Optimized Repository Structure**
83
+ Streamlined model packaging for easier loading and deployment.
84
+
85
+ * **Improved Transformer Compatibility**
86
+ Designed to work smoothly with modern Hugging Face Transformers versions.
87
+
88
+ * **9B Parameter Architecture**
89
+ Built on **Qwen3.5-9B**, balancing performance and efficiency.
90
+
91
+ * **Stable Instruction Following**
92
+ Maintains consistent behavior across structured and multi-step prompts.
93
+
94
+ * **Efficient Deployment**
95
+ Suitable for local inference, prototyping, and research workflows.
96
+
97
+ ---
98
 
99
  ## Quick Start with Transformers
100
 
101
+ ```bash
102
+ pip install transformers==5.3.0
103
+ # or
104
+ pip install git+https://github.com/huggingface/transformers.git
105
  ```
106
 
107
  ```python
 
139
 
140
  generated_ids = model.generate(**inputs, max_new_tokens=256)
141
 
 
 
 
 
142
  output_text = processor.batch_decode(
143
+ [out[len(inp):] for inp, out in zip(inputs.input_ids, generated_ids)],
144
  skip_special_tokens=True,
145
  clean_up_tokenization_spaces=False
146
  )
 
148
  print(output_text)
149
  ```
150
 
151
+ ---
152
+
153
  ## Intended Use
154
 
155
+ * Research into transformer behavior and instruction following
156
+ * Red-teaming and robustness evaluation
157
+ * Local and cloud inference deployment
158
+ * Rapid prototyping of NLP applications
159
 
160
+ ---
 
 
161
 
162
+ ## Limitations & Risks
 
 
163
 
164
+ > **Important Note**: This model inherits limitations from its base architecture.
165
 
166
+ * Outputs may vary depending on decoding settings and prompts
167
+ * Requires GPU acceleration for optimal performance
168
+ * May produce incorrect or inconsistent information in complex scenarios
169
+ * Performance is dependent on deployment environment and optimization strategy