Guy Edward DuGan II commited on
Commit
b379076
·
verified ·
1 Parent(s): 865fd8c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +193 -18
README.md CHANGED
@@ -13,22 +13,197 @@ datasets:
13
  - TeichAI/gpt-5-codex-250x
14
  - TeichAI/gpt-5.1-high-reasoning-1000x
15
  ---
16
- base_model:
17
- - gss1147/GPT2.5.2-high-reasoning-codex-0.4B
18
- - openai-community/gpt2-medium
19
- tags:
20
- - generated_from_trainer
21
- model-index:
22
- - name: gpt2-finetuned
23
- results: []
24
- datasets:
25
- - TeichAI/gpt-5.1-codex-max-1000x
26
- - TeichAI/gpt-5.2-high-reasoning-250x
27
- - jjmachan/NSFW-reddit
28
- - gss1147/GPT-2-to-GPT-5-5k
29
- - TeichAI/gpt-5-codex-250x
30
- - TeichAI/gpt-5.1-high-reasoning-1000x
31
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
32
 
33
- ----THIS IS A NSFW MODEL---
34
- ---NSFW--warning--NSFW----
 
 
13
  - TeichAI/gpt-5-codex-250x
14
  - TeichAI/gpt-5.1-high-reasoning-1000x
15
  ---
16
+ GPT2.5.2-NSFW-Codex-0.4B
17
+
18
+ 📌 Model Overview
19
+
20
+ Model Name: WithinUsAI/GPT2.5.2-NSFW-Codex-0.4B
21
+ Organization: Within Us AI
22
+ Base Model: openai-community/gpt2-medium (~0.4B parameters) 
23
+ Model Type: Instruction-Tuned Code + General Text LLM
24
+ Parameter Size: ~0.4B
25
+ Primary Focus: Lightweight coding + uncensored responses + dataset-driven evolution
26
+
27
+ This model represents a heavily evolved GPT-2 Medium, upgraded through dataset-driven training and reasoning/coding distillation.
28
+
29
+ 🧬 Name Meaning
30
+
31
+ “GPT2.5.2” = Evolution lineage
32
+
33
+ * 2 → GPT-2 Medium base
34
+ * .5 → Mid-generation upgrade (reasoning + instruction tuning)
35
+ * .2 → Codex-style refinement phase
36
+
37
+ 👉 In short:
38
+ A GPT-2 model pushed forward toward modern coding + reasoning behavior using curated datasets, not architecture scaling.
39
+
40
+
41
+
42
+ 🧬 Architecture & Lineage
43
+
44
+ Base Foundation
45
+
46
+ * Transformer architecture from GPT-2 Medium (~345M–400M parameters class) 
47
+ * Dense, autoregressive language model
48
+
49
+ Evolution Process
50
+
51
+ This model was not scaled up, but instead evolved through data and training strategy:
52
+
53
+ * Instruction tuning
54
+ * Coding dataset exposure (Codex-style tasks)
55
+ * Reasoning trace influence
56
+ * Behavioral refinement toward modern LLM outputs
57
+
58
+
59
+
60
+ 🧠 Core Design Philosophy
61
+
62
+ Don’t scale the model… evolve it.
63
+
64
+ Instead of increasing parameters, this model:
65
+
66
+ * Improves behavior through data quality
67
+ * Mimics newer model reasoning styles
68
+ * Pushes GPT-2 into modern task domains
69
+
70
+ Think of it like a classic engine rebuilt with modern parts 🔧
71
+
72
+
73
+
74
+ ⚙️ Key Capabilities
75
+
76
+ 💻 Coding (Codex-Inspired)
77
+
78
+ * Basic code generation (Python, JS, etc.)
79
+ * Simple debugging assistance
80
+ * Structured function outputs
81
+
82
+ 🧠 Reasoning (Lightweight)
83
+
84
+ * Step-by-step responses (limited depth)
85
+ * Instruction-following improvements over base GPT-2
86
+
87
+ 🔓 Uncensored Behavior
88
+
89
+ * Reduced refusal tendencies
90
+ * More permissive outputs compared to aligned models
91
+
92
+
93
+
94
+ 📦 Model Characteristics
95
+
96
+ Attribute Value
97
+ Parameters ~0.4B
98
+ Architecture GPT-2 (dense transformer)
99
+ Strength Efficiency
100
+ Weakness Limited deep reasoning
101
+
102
+
103
+
104
+ 🚀 Intended Use
105
+
106
+ ✅ Ideal Use Cases
107
+
108
+ * Ultra-lightweight local LLMs
109
+ * Experimental coding assistants
110
+ * Dataset-driven model research
111
+ * Uncensored response exploration
112
+ * Edge/low-resource environments
113
+
114
+ ⚠️ Limitations
115
+
116
+ * Significantly weaker than modern 7B+ models
117
+ * Limited context and reasoning depth
118
+ * Can produce incorrect or low-quality code
119
+ * No built-in safety filtering
120
+
121
+
122
+
123
+ 🛠️ Example Usage (Transformers)
124
+
125
+ from transformers import AutoTokenizer, AutoModelForCausalLM
126
+ model_name = "WithinUsAI/GPT2.5.2-NSFW-Codex-0.4B"
127
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
128
+ model = AutoModelForCausalLM.from_pretrained(model_name)
129
+ prompt = "Write a Python function to reverse a string."
130
+ inputs = tokenizer(prompt, return_tensors="pt")
131
+ outputs = model.generate(**inputs, max_new_tokens=100)
132
+ print(tokenizer.decode(outputs[0]))
133
+
134
+
135
+
136
+ 🧪 Training Methodology
137
+
138
+ Within Us AI approach:
139
+
140
+ * Dataset-driven evolution (primary driver)
141
+ * Instruction + coding task fine-tuning
142
+ * Reasoning-style output shaping
143
+ * No claim of architecture modification
144
+
145
+ Data Sources
146
+
147
+ * Proprietary datasets created by Within Us AI
148
+ * Third-party datasets used without ownership claims
149
+ * Likely includes:
150
+ * Coding tasks
151
+ * Instruction datasets
152
+ * Reasoning traces
153
+
154
+
155
+
156
+ 📊 Expected Performance Profile
157
+
158
+ Capability Strength
159
+ Efficiency Very High
160
+ Coding (basic) Moderate
161
+ Reasoning Low–Moderate
162
+ Creativity Moderate
163
+ Safety filtering Minimal
164
+
165
+
166
+
167
+ 📜 License
168
+
169
+ License Type: Based on GPT-2 (OpenAI open model lineage)**
170
+
171
+ Attribution Notes:
172
+
173
+ * Base model: OpenAI GPT-2 Medium
174
+ * Training / evolution: Within Us AI
175
+ * Third-party datasets used without ownership claims
176
+ * Credit belongs to original dataset and model creators
177
+
178
+
179
+
180
+ 🙏 Acknowledgements
181
+
182
+ * OpenAI (GPT-2 architecture)
183
+ * Hugging Face (model hosting ecosystem)
184
+ * Open-source dataset contributors
185
+ * Coding dataset communities
186
+
187
+
188
+
189
+ 🔗 Links
190
+
191
+ * Model: https://huggingface.co/WithinUsAI/GPT2.5.2-NSFW-Codex-0.4B
192
+ * Organization: https://huggingface.co/WithinUsAI
193
+
194
+
195
+
196
+ 🧩 Closing Note
197
+
198
+ This model is like a time traveler from 2019 carrying tools from 2026 ⏳⚡
199
+
200
+ Same small brain…
201
+ but trained to think in a much bigger world.
202
+
203
+
204
+
205
+ If you want, I can next:
206
 
207
+ * 🔥  Turn this into a high-visibility HF card (badges + visuals)
208
+ * 📊  Compare it directly vs GPT-2 base vs Phi vs TinyLlama
209
+ * ⚙️ Or  build a tiny-agent framework optimized specifically for this 0.4B model